Oct 30 23:15:59.786081 ip-10-0-142-208 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Oct 30 23:15:59.786091 ip-10-0-142-208 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Oct 30 23:15:59.786098 ip-10-0-142-208 systemd[1]: kubelet.service: Failed with result 'resources'.
Oct 30 23:15:59.786324 ip-10-0-142-208 systemd[1]: Failed to start Kubernetes Kubelet.
Oct 30 23:16:09.962643 ip-10-0-142-208 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Oct 30 23:16:09.962654 ip-10-0-142-208 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e1f92c97a55a4be28e796815f9394da5 --
Oct 30 23:18:18.511239 ip-10-0-142-208 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 23:18:18.885842 ip-10-0-142-208 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 23:18:18.885842 ip-10-0-142-208 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 23:18:18.885842 ip-10-0-142-208 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 23:18:18.885842 ip-10-0-142-208 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 23:18:18.891716 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891629    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:18:18.891716 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891715    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:18:18.891716 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891721    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891726    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891729    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891732    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891735    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891738    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891740    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891743    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891745    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891748    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891751    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891753    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891756    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891759    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891761    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891764    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891767    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891770    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891773    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891775    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:18:18.891867 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891778    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:18:18.892345 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891781    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:18:18.892345 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891783    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:18:18.892345 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891786    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:18:18.892345 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891788    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:18:18.892345 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891791    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:18:18.892345 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891793    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:18:18.892345 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891796    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:18:18.892345 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891804    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:18:18.892345 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891808    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:18:18.892345 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891812    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:18:18.892345 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891816    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:18:18.892345 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891818    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:18:18.892345 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891821    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:18:18.892345 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891824    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:18:18.892345 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891826    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:18:18.892345 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891829    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:18:18.892345 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891832    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:18:18.892345 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891834    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:18:18.892345 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891837    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891840    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891843    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891846    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891849    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891851    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891854    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891857    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891859    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891861    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891864    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891866    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891869    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891872    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891875    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891877    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891880    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891883    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891885    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891888    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:18:18.892792 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891891    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:18:18.893281 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891894    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:18:18.893281 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891897    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:18:18.893281 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891899    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:18:18.893281 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891902    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:18:18.893281 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891904    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:18:18.893281 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891907    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:18:18.893281 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891910    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:18:18.893281 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891913    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:18:18.893281 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891916    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:18:18.893281 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891918    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:18:18.893281 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891938    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:18:18.893281 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891942    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:18:18.893281 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891944    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:18:18.893281 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891947    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:18:18.893281 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891949    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:18:18.893281 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891952    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:18:18.893281 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891955    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:18:18.893281 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891957    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:18:18.893281 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891960    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891962    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891965    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891969    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891971    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891974    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891977    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891979    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891982    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891984    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891987    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891990    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891992    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891995    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.891998    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892001    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892003    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892006    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892008    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892011    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:18:18.893772 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892014    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:18:18.894296 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892016    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:18:18.894296 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892019    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:18:18.894296 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892022    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:18:18.894296 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892025    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:18:18.894296 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892027    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:18:18.894296 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892836    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:18:18.894296 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892844    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:18:18.894296 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892849    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:18:18.894296 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892854    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:18:18.894296 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892857    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:18:18.894296 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892860    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:18:18.894296 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892863    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:18:18.894296 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892866    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:18:18.894296 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892868    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:18:18.894296 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892871    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:18:18.894296 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892874    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:18:18.894296 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892877    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:18:18.894296 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892880    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:18:18.894734 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892882    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:18:18.894734 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892885    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:18:18.894734 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892888    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:18:18.894734 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892890    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:18:18.894734 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892893    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:18:18.894734 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892896    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:18:18.894734 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892899    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:18:18.894734 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892903    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:18:18.894734 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892906    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:18:18.894734 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892909    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:18:18.894734 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892912    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:18:18.894734 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892915    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:18:18.894734 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892917    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:18:18.894734 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892939    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:18:18.894734 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892942    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:18:18.894734 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892945    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:18:18.894734 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892948    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:18:18.894734 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892950    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:18:18.894734 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892953    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892956    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892958    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892961    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892964    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892967    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892969    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892972    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892974    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892977    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892979    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892982    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892985    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892988    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892990    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892993    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892996    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.892999    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893001    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893004    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:18:18.895202 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893007    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893009    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893013    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893015    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893018    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893020    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893023    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893027    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893029    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893032    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893034    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893037    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893039    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893042    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893044    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893047    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893049    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893052    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893054    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893057    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:18:18.895678 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893060    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893062    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893065    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893067    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893070    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893073    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893076    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893079    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893081    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893084    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893086    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893089    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893092    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893094    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893097    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893099    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893102    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893105    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893107    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893110    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:18:18.896201 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893112    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:18:18.896676 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893115    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:18:18.896676 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893117    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:18:18.896676 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893120    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:18:18.896676 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893122    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:18:18.896676 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893125    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:18:18.896676 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893127    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:18:18.896676 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893130    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:18:18.896676 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893132    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:18:18.896676 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893135    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:18:18.896676 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893138    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:18:18.896676 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893141    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:18:18.896676 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893143    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:18:18.896676 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893146    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:18:18.896676 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893148    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:18:18.896676 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893668    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:18:18.896676 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893675    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:18:18.896676 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893679    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:18:18.896676 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893682    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:18:18.896676 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893685    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893688    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893691    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893693    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893696    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893699    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893701    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893703    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893706    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893709    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893711    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893713    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893716    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893718    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893721    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893723    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893726    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893728    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893731    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893733    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:18:18.897126 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893736    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893738    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893741    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893744    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893747    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893749    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893752    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893755    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893757    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893760    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893763    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893766    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893769    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893771    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893774    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893777    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893779    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893782    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893784    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893788    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:18:18.897624 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893792    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893795    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893797    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893800    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893802    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893805    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893807    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893810    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893813    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893815    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893818    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893820    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893823    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893825    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893837    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893840    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893842    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893845    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893848    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893851    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:18:18.898125 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893853    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:18:18.898697 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893856    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:18:18.898697 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893859    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:18:18.898697 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893861    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:18:18.898697 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893864    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:18:18.898697 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893867    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:18:18.898697 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893869    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:18:18.898697 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893872    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:18:18.898697 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893874    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:18:18.898697 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893876    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:18:18.898697 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893879    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:18:18.898697 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893882    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:18:18.898697 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893885    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:18:18.898697 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893887    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:18:18.898697 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893890    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:18:18.898697 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893892    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:18:18.898697 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893895    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:18:18.898697 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893897    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:18:18.898697 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893900    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:18:18.898697 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893902    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:18:18.899216 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893905    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:18:18.899216 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893907    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:18:18.899216 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893910    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:18:18.899216 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893912    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:18:18.899216 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893915    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:18:18.899216 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893919    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:18:18.899216 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893941    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:18:18.899216 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893945    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:18:18.899216 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893948    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:18:18.899216 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893951    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:18:18.899216 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893953    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:18:18.899216 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893959    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:18:18.899216 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893962    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:18:18.899216 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893965    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:18:18.899216 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893968    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:18:18.899216 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893971    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:18:18.899216 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893973    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:18:18.899216 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893977    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:18:18.899216 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893980    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893983    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893985    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.893988    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895070    2577 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895080    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895087    2577 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895092    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895096    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895099    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895103    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895107    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895111    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895114    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895117    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895120    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895123    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895126    2577 flags.go:64] FLAG: --cgroup-root=""
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895131    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895134    2577 flags.go:64] FLAG: --client-ca-file=""
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895137    2577 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895140    2577 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895144    2577 flags.go:64] FLAG: --cluster-domain=""
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895146    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 23:18:18.899674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895149    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895154    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895158    2577 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895161    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895164    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895167    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895170    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895174    2577 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895177    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895180    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895183    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895186    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895190    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895193    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895196    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895199    2577 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895201    2577 flags.go:64] FLAG: --enable-server="true"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895204    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895209    2577 flags.go:64] FLAG: --event-burst="100"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895212    2577 flags.go:64] FLAG: --event-qps="50"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895215    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895218    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895221    2577 flags.go:64] FLAG: --eviction-hard=""
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895226    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 23:18:18.900244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895229    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895232    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895236    2577 flags.go:64] FLAG: --eviction-soft=""
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895239    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895242    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895245    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895248    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895250    2577 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895253    2577 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895257    2577 flags.go:64] FLAG: --feature-gates=""
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895260    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895263    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895266    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895269    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895272    2577 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895275    2577 flags.go:64] FLAG: --help="false"
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895278    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895281    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895284    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895287    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895290    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895294    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895296    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 23:18:18.900839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895299    2577 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895302    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895305    2577 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895308    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895310    2577 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895313    2577 flags.go:64] FLAG: --kube-reserved=""
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895316    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895319    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895321    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895324    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895327    2577 flags.go:64] FLAG: --lock-file=""
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895330    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895332    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895335    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895341    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895344    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895347    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895349    2577 flags.go:64] FLAG: --logging-format="text"
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895352    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895356    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895358    2577 flags.go:64] FLAG: --manifest-url=""
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895361    2577 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895366    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895369    2577 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895372    2577 flags.go:64] FLAG: --max-pods="110"
Oct 30 23:18:18.901402 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895375    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895378    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895382    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895385    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895387    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895390    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895393    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895400    2577 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895403    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895406    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895409    2577 flags.go:64] FLAG: --pod-cidr=""
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895412    2577 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895414    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895417    2577 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895420    2577 flags.go:64] FLAG: --port="10250"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895423    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895426    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-061e8cecd64aa092c"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895429    2577 flags.go:64] FLAG: --qos-reserved=""
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895431    2577 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895435    2577 flags.go:64] FLAG: --register-node="true"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895437    2577 flags.go:64] FLAG: --register-with-taints=""
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895441    2577 flags.go:64] FLAG: --registry-burst="10"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895444    2577 flags.go:64] FLAG: --registry-qps="5"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895446    2577 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895449    2577 flags.go:64] FLAG: --reserved-memory=""
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895453    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 23:18:18.902050 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895456    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895459    2577 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895462    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895465    2577 flags.go:64] FLAG: --runonce="false"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895467    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895470    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895473    2577 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895476    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895479    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895482    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895485    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895488    2577 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895491    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895493    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895496    2577 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895499    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895502    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895505    2577 flags.go:64] FLAG: --system-cgroups=""
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895507    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895513    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895515    2577 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895518    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895522    2577 flags.go:64] FLAG: --tls-min-version=""
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895524    2577 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895527    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 23:18:18.902661 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895530    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895533    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895536    2577 flags.go:64] FLAG: --v="2"
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895540    2577 flags.go:64] FLAG: --version="false"
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895544    2577 flags.go:64] FLAG: --vmodule=""
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895548    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.895552    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895689    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895692    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895695    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895697    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895700    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895703    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895706    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895708    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895711    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895714    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895717    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895719    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895722    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895724    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895727    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:18:18.903258 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895729    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:18:18.903777 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895732    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:18:18.903777 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895734    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:18:18.903777 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895737    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:18:18.903777 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895739    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:18:18.903777 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895742    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:18:18.903777 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895744    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:18:18.903777 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895747    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:18:18.903777 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895750    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:18:18.903777 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895754    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:18:18.903777 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895758    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:18:18.903777 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895762    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:18:18.903777 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895765    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:18:18.903777 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895768    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:18:18.903777 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895771    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:18:18.903777 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895774    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:18:18.903777 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895776    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:18:18.903777 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895779    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:18:18.903777 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895781    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:18:18.903777 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895784    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:18:18.904312 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895787    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:18:18.904312 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895790    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:18:18.904312 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895792    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:18:18.904312 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895795    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:18:18.904312 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895797    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:18:18.904312 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895800    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:18:18.904312 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895802    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:18:18.904312 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895805    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:18:18.904312 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895808    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:18:18.904312 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895810    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:18:18.904312 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895813    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:18:18.904312 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895815    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:18:18.904312 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895818    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:18:18.904312 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895820    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:18:18.904312 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895823    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:18:18.904312 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895825    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:18:18.904312 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895828    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:18:18.904312 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895830    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:18:18.904312 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895832    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895835    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895839    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895843    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895845    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895848    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895851    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895853    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895856    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895859    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895861    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895864    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895867    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895869    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895872    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895874    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895877    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895879    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895882    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895884    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:18:18.904752 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895887    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895889    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895892    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895895    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895897    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895900    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895902    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895905    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895907    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895909    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895912    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895915    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895917    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895937    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895942    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895946    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895949    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895952    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895954    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895957    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:18:18.905267 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895959    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:18:18.905740 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895962    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:18:18.905740 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895964    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:18:18.905740 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895967    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:18:18.905740 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895969    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:18:18.905740 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895972    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:18:18.905740 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895974    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:18:18.905740 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895977    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:18:18.905740 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895979    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:18:18.905740 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895984    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:18:18.905740 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895988    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:18:18.905740 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895991    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:18:18.905740 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.895994    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:18:18.905740 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.896022    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 23:18:18.905740 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896057    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:18:18.905740 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896061    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896064    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896067    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896069    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896072    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896074    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896077    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896080    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896083    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896085    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896088    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896091    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896094    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896097    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896100    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896103    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896105    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896108    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896110    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896113    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:18:18.906127 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896115    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:18:18.906600 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896118    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:18:18.906600 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896120    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:18:18.906600 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896123    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:18:18.906600 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896126    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:18:18.906600 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896128    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:18:18.906600 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896131    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:18:18.906600 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896135    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:18:18.906600 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896138    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:18:18.906600 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896141    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:18:18.906600 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896144    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:18:18.906600 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896147    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:18:18.906600 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896149    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:18:18.906600 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896152    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:18:18.906600 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896155    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:18:18.906600 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896158    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:18:18.906600 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896160    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:18:18.906600 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896163    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:18:18.906600 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896165    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:18:18.906600 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896168    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:18:18.907063 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896170    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:18:18.907063 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896173    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:18:18.907063 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896175    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:18:18.907063 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896179    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:18:18.907063 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896182    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:18:18.907063 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896185    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:18:18.907063 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896188    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:18:18.907063 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896190    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:18:18.907063 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896193    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:18:18.907063 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896196    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:18:18.907063 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896198    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:18:18.907063 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896201    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:18:18.907063 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896203    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:18:18.907063 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896206    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:18:18.907063 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896209    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:18:18.907063 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896211    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:18:18.907063 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896214    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:18:18.907063 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896217    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:18:18.907063 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896219    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896221    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896224    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896228    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896230    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896233    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896235    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896238    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896241    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896243    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896246    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896248    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896251    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896253    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896256    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896258    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896261    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896265    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896267    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896271    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:18:18.907510 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896273    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896276    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896279    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896281    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896284    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896286    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896289    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896292    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896294    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896297    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896299    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896302    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896304    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896306    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896309    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896311    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896314    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896316    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896319    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896321    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:18:18.908117 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896324    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:18:18.908580 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896326    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:18:18.908580 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896329    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:18:18.908580 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896332    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:18:18.908580 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896334    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:18:18.908580 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896337    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:18:18.908580 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.896341    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:18:18.908580 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.904326    2577 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 23:18:18.908580 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.904343    2577 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 23:18:18.908580 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.904356    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 23:18:18.908580 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.904360    2577 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 23:18:18.908580 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904419    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:18:18.908580 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904424    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:18:18.908580 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904427    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:18:18.908580 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904431    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:18:18.908580 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904433    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:18:18.908580 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904436    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:18:18.908580 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904439    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:18:18.908580 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904442    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:18:18.908580 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904444    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904447    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904449    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904452    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904454    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904459    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904463    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904466    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904469    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904472    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904475    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904478    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904481    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904484    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904487    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904490    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904493    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904495    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904498    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904501    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:18:18.909043 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904504    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:18:18.909518 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904507    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:18:18.909518 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904509    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:18:18.909518 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904512    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:18:18.909518 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904515    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:18:18.909518 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904518    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:18:18.909518 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904520    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:18:18.909518 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904523    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:18:18.909518 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904525    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:18:18.909518 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904527    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:18:18.909518 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904530    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:18:18.909518 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904532    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:18:18.909518 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904535    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:18:18.909518 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904537    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:18:18.909518 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904540    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:18:18.909518 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904542    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:18:18.909518 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904545    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:18:18.909518 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904547    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:18:18.909518 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904550    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:18:18.909518 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904552    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904555    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904557    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904559    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904562    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904564    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904567    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904570    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904572    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904575    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904577    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904580    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904583    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904586    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904589    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904591    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904594    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904596    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904599    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904601    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:18:18.909985 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904604    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:18:18.910452 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904606    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:18:18.910452 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904609    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:18:18.910452 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904612    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:18:18.910452 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904614    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:18:18.910452 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904616    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:18:18.910452 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904619    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:18:18.910452 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904621    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:18:18.910452 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904624    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:18:18.910452 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904626    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:18:18.910452 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904629    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:18:18.910452 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904631    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:18:18.910452 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904634    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:18:18.910452 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904636    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:18:18.910452 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904639    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:18:18.910452 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904641    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:18:18.910452 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904644    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:18:18.910452 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904646    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:18:18.910452 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904649    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:18:18.910452 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904651    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:18:18.910918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904653    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:18:18.910918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904656    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:18:18.910918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904661    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:18:18.910918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904664    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:18:18.910918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904667    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:18:18.910918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904670    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:18:18.910918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904673    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:18:18.910918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904677    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:18:18.910918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904681    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:18:18.910918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904684    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:18:18.910918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904687    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:18:18.910918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904690    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:18:18.910918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904692    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:18:18.910918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904695    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:18:18.910918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904697    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:18:18.910918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904700    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:18:18.910918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904702    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:18:18.910918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904705    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:18:18.910918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904707    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:18:18.911380 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.904735    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 23:18:18.911380 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904878    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:18:18.911380 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904883    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:18:18.911380 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904887    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:18:18.911380 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904889    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:18:18.911380 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904892    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:18:18.911380 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904895    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:18:18.911380 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904897    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:18:18.911380 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904899    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:18:18.911380 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904902    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:18:18.911380 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904904    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:18:18.911380 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904907    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:18:18.911380 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904909    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:18:18.911380 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904911    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:18:18.911380 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904914    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:18:18.911380 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904916    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:18:18.911758 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904936    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:18:18.911758 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904940    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:18:18.911758 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904943    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:18:18.911758 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904946    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:18:18.911758 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904948    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:18:18.911758 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904951    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:18:18.911758 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904954    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:18:18.911758 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904957    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:18:18.911758 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904959    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:18:18.911758 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904962    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:18:18.911758 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904964    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:18:18.911758 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904967    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:18:18.911758 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904969    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:18:18.911758 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904972    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:18:18.911758 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904974    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:18:18.911758 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904977    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:18:18.911758 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904980    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:18:18.911758 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904982    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:18:18.911758 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904985    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904987    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904990    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904992    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904995    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904997    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.904999    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905002    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905004    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905007    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905010    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905012    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905015    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905017    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905020    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905023    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905025    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905028    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905031    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905033    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:18:18.912268 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905036    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905039    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905042    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905046    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905049    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905051    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905054    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905057    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905059    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905062    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905064    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905067    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905069    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905071    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905075    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905077    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905080    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905082    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905085    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905087    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:18:18.912720 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905090    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:18:18.913203 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905092    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:18:18.913203 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905095    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:18:18.913203 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905097    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:18:18.913203 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905100    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:18:18.913203 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905102    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:18:18.913203 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905104    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:18:18.913203 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905107    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:18:18.913203 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905110    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:18:18.913203 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905113    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:18:18.913203 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905115    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:18:18.913203 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905117    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:18:18.913203 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905120    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:18:18.913203 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905122    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:18:18.913203 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905125    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:18:18.913203 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905127    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:18:18.913203 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905130    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:18:18.913203 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905132    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:18:18.913203 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905136    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:18:18.913203 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905140    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:18:18.913657 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905142    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:18:18.913657 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905145    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:18:18.913657 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905147    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:18:18.913657 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905150    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:18:18.913657 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905152    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:18:18.913657 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905155    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:18:18.913657 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905157    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:18:18.913657 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905160    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:18:18.913657 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905162    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:18:18.913657 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905165    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:18:18.913657 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905168    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:18:18.913657 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905170    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:18:18.913657 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905173    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:18:18.913657 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.905199    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 23:18:18.913657 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905237    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:18:18.913657 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905242    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905244    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905247    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905250    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905252    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905255    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905258    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905261    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905263    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905266    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905268    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905271    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905274    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905277    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905280    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905283    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905286    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905288    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905291    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905293    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:18:18.914218 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905295    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:18:18.914965 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905298    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:18:18.914965 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905300    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:18:18.914965 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905303    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:18:18.914965 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905305    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:18:18.914965 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905308    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:18:18.914965 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905311    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:18:18.914965 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905313    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:18:18.914965 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905316    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:18:18.914965 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905318    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:18:18.914965 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905321    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:18:18.914965 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905323    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:18:18.914965 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905326    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:18:18.914965 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905328    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:18:18.914965 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905331    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:18:18.914965 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905333    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:18:18.914965 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905336    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:18:18.914965 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905338    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:18:18.914965 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905341    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:18:18.914965 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905344    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905346    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905349    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905351    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905353    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905356    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905358    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905361    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905363    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905366    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905368    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905370    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905373    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905375    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905378    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905380    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905382    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905385    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905388    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905390    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:18:18.915435 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905393    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:18:18.915897 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905395    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:18:18.915897 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905399    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:18:18.915897 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905401    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:18:18.915897 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905404    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:18:18.915897 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905407    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:18:18.915897 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905409    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:18:18.915897 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905411    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:18:18.915897 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905414    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:18:18.915897 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905416    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:18:18.915897 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905421    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:18:18.915897 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905424    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:18:18.915897 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905429    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:18:18.915897 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905432    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:18:18.915897 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905435    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:18:18.915897 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905437    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:18:18.915897 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905440    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:18:18.915897 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905442    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:18:18.915897 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905444    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:18:18.915897 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905447    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905449    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905452    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905454    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905456    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905459    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905461    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905464    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905467    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905469    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905472    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905474    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905477    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905479    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905482    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905484    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905487    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905489    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905492    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905494    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:18:18.916350 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905496    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:18:18.916812 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905499    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:18:18.916812 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905501    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:18:18.916812 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905503    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:18:18.916812 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905506    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:18:18.916812 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905509    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:18:18.916812 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:18.905511    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:18:18.916812 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.905562    2577 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 23:18:18.916812 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.908050    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 23:18:18.916812 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.909111    2577 server.go:1014] "Starting client certificate rotation"
Oct 30 23:18:18.916812 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.909212    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 23:18:18.916812 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.909246    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 23:18:18.916812 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.911707    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 23:18:18.920966 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.920948    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 23:18:18.933298 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.933278    2577 log.go:25] "Validated CRI v1 runtime API"
Oct 30 23:18:18.937530 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.937516    2577 log.go:25] "Validated CRI v1 image API"
Oct 30 23:18:18.938431 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.938407    2577 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 23:18:18.944008 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.943978    2577 fs.go:135] Filesystem UUIDs: map[44f0ccee-8286-4022-9b7e-b88c2a50ea91:/dev/nvme0n1p4 7814ac1c-2b8b-4c77-ad9c-bec2aac44828:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Oct 30 23:18:18.944078 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.944007    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 23:18:18.949221 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.949114    2577 manager.go:217] Machine: {Timestamp:2026-10-30 23:18:18.947639977 +0000 UTC m=+0.340559149 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100645 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b1defd723cf0874fc4a86446bec91 SystemUUID:ec2b1def-d723-cf08-74fc-4a86446bec91 BootID:e1f92c97-a55a-4be2-8e79-6815f9394da5 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c5:1f:19:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c5:1f:19:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:4b:e3:c4:bf:69 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 23:18:18.949221 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.949221    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 23:18:18.949332 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.949297    2577 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 23:18:18.950443 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.950429    2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 23:18:18.953146 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.953117    2577 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 23:18:18.953279 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.953149    2577 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-208.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 23:18:18.953345 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.953281    2577 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 23:18:18.953345 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.953288    2577 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 23:18:18.953345 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.953322    2577 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 23:18:18.953345 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.953340    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 23:18:18.954656 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.954646    2577 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 23:18:18.959252 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.959240    2577 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 23:18:18.959376 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.959367    2577 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 23:18:18.959410 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.959403    2577 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 23:18:18.959440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.959415    2577 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 23:18:18.959440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.959425    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 23:18:18.959440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.959436    2577 kubelet.go:405] "Adding apiserver pod source"
Oct 30 23:18:18.959513 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.959444    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 23:18:18.959821 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.959808    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 23:18:18.962417 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.962400    2577 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 23:18:18.969614 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.969600    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 23:18:18.970551 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.970539    2577 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 23:18:18.970592 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.970569    2577 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 23:18:18.970730 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.970720    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 23:18:18.970763 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.970735    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 23:18:18.970763 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.970742    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 23:18:18.970763 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.970748    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 23:18:18.970763 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.970754    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 23:18:18.970763 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.970760    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 23:18:18.971447 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.971438    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 23:18:18.971476 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.971448    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 23:18:18.971476 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.971455    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 23:18:18.971476 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.971461    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 23:18:18.971476 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.971471    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 23:18:18.971659 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.971481    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 23:18:18.972988 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.972972    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 23:18:18.972988 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.972983    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 23:18:18.978196 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.978179    2577 server.go:1263] "Started kubelet"
Oct 30 23:18:18.978337 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.978286    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 23:18:18.978337 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.978270    2577 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 23:18:18.978428 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.978356    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 23:18:18.978962 ip-10-0-142-208 systemd[1]: Started Kubernetes Kubelet.
Oct 30 23:18:18.979849 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.979835    2577 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 23:18:18.980360 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.980345    2577 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 23:18:18.980719 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.980679    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-208.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 23:18:18.983819 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:18.983800    2577 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 23:18:18.987226 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.987210    2577 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 23:18:18.987344 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.987277    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 23:18:18.987448 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:18.987354    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-208.us-east-2.compute.internal\" not found"
Oct 30 23:18:18.988172 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.987988    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 23:18:18.988172 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.988024    2577 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 23:18:18.988172 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.988048    2577 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 23:18:18.988359 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.988265    2577 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 23:18:18.988359 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.988274    2577 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 23:18:18.989219 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.989205    2577 factory.go:55] Registering systemd factory
Oct 30 23:18:18.989219 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.989220    2577 factory.go:223] Registration of the systemd container factory successfully
Oct 30 23:18:18.989440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.989421    2577 factory.go:153] Registering CRI-O factory
Oct 30 23:18:18.989440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.989440    2577 factory.go:223] Registration of the crio container factory successfully
Oct 30 23:18:18.989551 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.989492    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 23:18:18.989551 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.989518    2577 factory.go:103] Registering Raw factory
Oct 30 23:18:18.989551 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.989533    2577 manager.go:1199] Started watching for new ooms in manager
Oct 30 23:18:18.990501 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:18.990474    2577 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-208.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 23:18:18.990603 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:18.990534    2577 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 30 23:18:18.990603 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.990576    2577 manager.go:319] Starting recovery of all containers
Oct 30 23:18:18.991092 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:18.991064    2577 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-208.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 23:18:18.992109 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:18.990892    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-208.us-east-2.compute.internal.18e371e399f56e3e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-208.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-208.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 23:18:18.978102846 +0000 UTC m=+0.371022018,LastTimestamp:2026-10-30 23:18:18.978102846 +0000 UTC m=+0.371022018,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-208.us-east-2.compute.internal,}"
Oct 30 23:18:18.996475 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:18.996446    2577 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 30 23:18:18.996751 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.996686    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 23:18:18.998659 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:18.998631    2577 manager.go:324] Recovery completed
Oct 30 23:18:19.002291 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.002264    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v5z6h"
Oct 30 23:18:19.006187 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.006174    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:18:19.008131 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.008112    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:18:19.008206 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.008151    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:18:19.008206 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.008166    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:18:19.008728 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.008712    2577 cpu_manager.go:226] "Starting" policy="none"
Oct 30 23:18:19.008728 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.008726    2577 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 23:18:19.008837 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.008742    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:18:19.008837 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.008745    2577 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 23:18:19.009411 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.009397    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:18:19.009466 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.009423    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:18:19.009466 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.009433    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:18:19.010230 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:19.010168    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-208.us-east-2.compute.internal.18e371e39bbfa465  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-208.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-208.us-east-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-208.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 23:18:19.008132197 +0000 UTC m=+0.401051376,LastTimestamp:2026-10-30 23:18:19.008132197 +0000 UTC m=+0.401051376,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-208.us-east-2.compute.internal,}"
Oct 30 23:18:19.011051 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.011039    2577 policy_none.go:50] "Start"
Oct 30 23:18:19.011097 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.011054    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 23:18:19.011097 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.011065    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 23:18:19.012994 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.012981    2577 policy_none.go:44] "Start"
Oct 30 23:18:19.014069 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.014050    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v5z6h"
Oct 30 23:18:19.071811 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.058588    2577 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 23:18:19.071811 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.063455    2577 manager.go:341] "Starting Device Plugin manager"
Oct 30 23:18:19.071811 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:19.063481    2577 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 23:18:19.071811 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.063490    2577 server.go:87] "Starting device plugin registration server"
Oct 30 23:18:19.071811 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.063695    2577 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 23:18:19.071811 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.063707    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 23:18:19.071811 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.063791    2577 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 23:18:19.071811 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.063879    2577 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 23:18:19.071811 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.063886    2577 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 23:18:19.071811 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.064396    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 23:18:19.071811 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.064418    2577 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 23:18:19.071811 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.064450    2577 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 23:18:19.071811 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:19.064481    2577 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 23:18:19.071811 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:19.064725    2577 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 23:18:19.071811 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:19.064774    2577 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-208.us-east-2.compute.internal\" not found"
Oct 30 23:18:19.071811 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.068103    2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 23:18:19.164558 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.164488    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:18:19.164705 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.164571    2577 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal"]
Oct 30 23:18:19.164705 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.164635    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:18:19.165529 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.165511    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:18:19.165599 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.165536    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:18:19.165599 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.165548    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:18:19.165599 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.165515    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:18:19.165699 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.165615    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:18:19.165699 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.165628    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:18:19.165699 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.165661    2577 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:19.167993 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.167980    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:18:19.168127 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.168112    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:19.168185 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.168148    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:18:19.168616 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.168599    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:18:19.168702 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.168632    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:18:19.168702 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.168647    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:18:19.168789 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.168705    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:18:19.168789 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.168723    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:18:19.168789 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.168738    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:18:19.170886 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.170874    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:19.170947 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.170897    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:18:19.171701 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.171683    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:18:19.171765 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.171710    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:18:19.171765 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.171720    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:18:19.175975 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.175961    2577 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:19.176051 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:19.175980    2577 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-208.us-east-2.compute.internal\": node \"ip-10-0-142-208.us-east-2.compute.internal\" not found"
Oct 30 23:18:19.189569 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.189547    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72589e04a8c3b3f1c88140c7d0f5529b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal\" (UID: \"72589e04a8c3b3f1c88140c7d0f5529b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:19.189658 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.189580    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72589e04a8c3b3f1c88140c7d0f5529b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal\" (UID: \"72589e04a8c3b3f1c88140c7d0f5529b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:19.189658 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.189598    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2cfc9340daa6f45c0fb8540343ee68d0-config\") pod \"kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal\" (UID: \"2cfc9340daa6f45c0fb8540343ee68d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:19.202496 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:19.202479    2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-208.us-east-2.compute.internal\" not found" node="ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:19.205183 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:19.205165    2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-208.us-east-2.compute.internal\" not found" node="ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:19.205294 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:19.205282    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-208.us-east-2.compute.internal\" not found"
Oct 30 23:18:19.290474 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.290447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72589e04a8c3b3f1c88140c7d0f5529b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal\" (UID: \"72589e04a8c3b3f1c88140c7d0f5529b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:19.290589 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.290475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72589e04a8c3b3f1c88140c7d0f5529b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal\" (UID: \"72589e04a8c3b3f1c88140c7d0f5529b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:19.290589 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.290493    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2cfc9340daa6f45c0fb8540343ee68d0-config\") pod \"kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal\" (UID: \"2cfc9340daa6f45c0fb8540343ee68d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:19.290589 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.290553    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2cfc9340daa6f45c0fb8540343ee68d0-config\") pod \"kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal\" (UID: \"2cfc9340daa6f45c0fb8540343ee68d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:19.290589 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.290560    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72589e04a8c3b3f1c88140c7d0f5529b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal\" (UID: \"72589e04a8c3b3f1c88140c7d0f5529b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:19.290736 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.290560    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72589e04a8c3b3f1c88140c7d0f5529b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal\" (UID: \"72589e04a8c3b3f1c88140c7d0f5529b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:19.306368 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:19.306347    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-208.us-east-2.compute.internal\" not found"
Oct 30 23:18:19.406832 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:19.406805    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-208.us-east-2.compute.internal\" not found"
Oct 30 23:18:19.507529 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:19.507470    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-208.us-east-2.compute.internal\" not found"
Oct 30 23:18:19.507529 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.507523    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:19.510715 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.510698    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:19.608412 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:19.608385    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-208.us-east-2.compute.internal\" not found"
Oct 30 23:18:19.708944 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:19.708900    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-208.us-east-2.compute.internal\" not found"
Oct 30 23:18:19.809420 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:19.809353    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-208.us-east-2.compute.internal\" not found"
Oct 30 23:18:19.909863 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:19.909836    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-208.us-east-2.compute.internal\" not found"
Oct 30 23:18:19.909863 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.909856    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 23:18:19.910318 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.909999    2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 23:18:19.953159 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:19.953137    2577 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 23:18:20.010403 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:20.010371    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-208.us-east-2.compute.internal\" not found"
Oct 30 23:18:20.019546 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:20.019517    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 23:13:20 +0000 UTC" deadline="2028-07-31 21:39:34.56855797 +0000 UTC"
Oct 30 23:18:20.019659 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:20.019545    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15358h21m14.549016359s"
Oct 30 23:18:20.083893 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:20.083808    2577 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 23:18:20.111202 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:20.111180    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-208.us-east-2.compute.internal\" not found"
Oct 30 23:18:20.134469 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:20.134445    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cfc9340daa6f45c0fb8540343ee68d0.slice/crio-9721ca05ece86f1ab8994e2ff5dcffb9f38efab1f240cda7154bb2af27c56aef WatchSource:0}: Error finding container 9721ca05ece86f1ab8994e2ff5dcffb9f38efab1f240cda7154bb2af27c56aef: Status 404 returned error can't find the container with id 9721ca05ece86f1ab8994e2ff5dcffb9f38efab1f240cda7154bb2af27c56aef
Oct 30 23:18:20.138420 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:20.138401    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72589e04a8c3b3f1c88140c7d0f5529b.slice/crio-9dbf9d7ad4443212e8208f0481360d30dbba209b7ad5ec315257f930efc9dd6f WatchSource:0}: Error finding container 9dbf9d7ad4443212e8208f0481360d30dbba209b7ad5ec315257f930efc9dd6f: Status 404 returned error can't find the container with id 9dbf9d7ad4443212e8208f0481360d30dbba209b7ad5ec315257f930efc9dd6f
Oct 30 23:18:20.141623 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:20.141604    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 23:18:20.211295 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:20.211271    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-208.us-east-2.compute.internal\" not found"
Oct 30 23:18:20.311747 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:20.311722    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-208.us-east-2.compute.internal\" not found"
Oct 30 23:18:20.323758 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:20.323734    2577 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 23:18:20.387811 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:20.387750    2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:20.402832 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:20.402809    2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 23:18:20.403993 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:20.403980    2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:18:20.410978 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:20.410966    2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 23:18:22.074511 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.074479    2577 apiserver.go:52] "Watching apiserver"
Oct 30 23:18:22.081316 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.081295    2577 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 23:18:22.081777 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.081760    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-smpnh","openshift-multus/multus-jr84v","openshift-network-diagnostics/network-check-target-mhrmm","openshift-network-operator/iptables-alerter-l6h2l","openshift-cluster-node-tuning-operator/tuned-jkxzf","openshift-dns/node-resolver-pnk7r","openshift-image-registry/node-ca-xjtcb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal","openshift-multus/network-metrics-daemon-bcpxq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw","kube-system/global-pull-secret-syncer-nd66m","kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal","openshift-ovn-kubernetes/ovnkube-node-jkk8z","kube-system/konnectivity-agent-6kctl"]
Oct 30 23:18:22.084552 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.084514    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xjtcb"
Oct 30 23:18:22.087607 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.087577    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.088944 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.088928    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 23:18:22.089035 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.089013    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 23:18:22.089131 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.089075    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 23:18:22.089205 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.089190    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4bbvk\""
Oct 30 23:18:22.089928 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.089870    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:22.090025 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:22.089932    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhrmm" podUID="11f70cd2-d0b3-4a44-b936-1659972c6605"
Oct 30 23:18:22.090496 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.090480    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 23:18:22.090787 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.090770    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 23:18:22.090787 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.090785    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 23:18:22.091041 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.091027    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 23:18:22.091110 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.091089    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jt8kr\""
Oct 30 23:18:22.091160 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.091093    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 23:18:22.091293 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.091273    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 23:18:22.092165 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.092146    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l6h2l"
Oct 30 23:18:22.094866 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.094346    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.096736 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.096713    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pnk7r"
Oct 30 23:18:22.098954 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.098934    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:22.099052 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:22.099002    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpxq" podUID="23c01b5c-af64-4567-9350-41572e762182"
Oct 30 23:18:22.101545 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.101355    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.101862 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.101842    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 23:18:22.104059 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.104039    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.106407 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.106389    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.108830 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.108808    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:22.108924 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:22.108879    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd66m" podUID="1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1"
Oct 30 23:18:22.111627 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.111429    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6kctl"
Oct 30 23:18:22.113011 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.112991    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-sys\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.113111 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113022    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-var-lib-kubelet\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.113111 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113045    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e911a1c-c73e-40ed-ba22-74845a60e738-tmp\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.113111 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113068    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-hostroot\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.113224 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113111    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54c28267-55bc-4f8e-bb07-47e47951468d-multus-daemon-config\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.113224 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113136    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/deb3bcf9-5f63-469d-b5d5-c5d62ffada99-serviceca\") pod \"node-ca-xjtcb\" (UID: \"deb3bcf9-5f63-469d-b5d5-c5d62ffada99\") " pod="openshift-image-registry/node-ca-xjtcb"
Oct 30 23:18:22.113224 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113160    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csc8h\" (UniqueName: \"kubernetes.io/projected/6d27d7b3-0f5f-4604-86b1-eeb9d380104f-kube-api-access-csc8h\") pod \"iptables-alerter-l6h2l\" (UID: \"6d27d7b3-0f5f-4604-86b1-eeb9d380104f\") " pod="openshift-network-operator/iptables-alerter-l6h2l"
Oct 30 23:18:22.113224 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113192    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9047f37e-2d3c-4978-a5c1-4078d505ab15-hosts-file\") pod \"node-resolver-pnk7r\" (UID: \"9047f37e-2d3c-4978-a5c1-4078d505ab15\") " pod="openshift-dns/node-resolver-pnk7r"
Oct 30 23:18:22.113224 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-run-netns\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.113224 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113221    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-var-lib-openvswitch\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.113465 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113236    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkt4n\" (UniqueName: \"kubernetes.io/projected/66938436-5c78-44c3-93f6-f52272cc9a6a-kube-api-access-vkt4n\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.113465 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113250    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9047f37e-2d3c-4978-a5c1-4078d505ab15-tmp-dir\") pod \"node-resolver-pnk7r\" (UID: \"9047f37e-2d3c-4978-a5c1-4078d505ab15\") " pod="openshift-dns/node-resolver-pnk7r"
Oct 30 23:18:22.113465 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113264    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-kubernetes\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.113465 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113302    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-lib-modules\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.113465 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113317    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1d1b3c8-a603-476b-b51d-8add45d50b13-cnibin\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.113465 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113330    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/66938436-5c78-44c3-93f6-f52272cc9a6a-ovnkube-config\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.113465 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113353    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-698bb\" (UniqueName: \"kubernetes.io/projected/9047f37e-2d3c-4978-a5c1-4078d505ab15-kube-api-access-698bb\") pod \"node-resolver-pnk7r\" (UID: \"9047f37e-2d3c-4978-a5c1-4078d505ab15\") " pod="openshift-dns/node-resolver-pnk7r"
Oct 30 23:18:22.113465 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113368    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1d1b3c8-a603-476b-b51d-8add45d50b13-system-cni-dir\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.113465 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113387    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b1d1b3c8-a603-476b-b51d-8add45d50b13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.113465 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113408    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-var-lib-cni-multus\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.113465 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113427    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-var-lib-kubelet\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.113465 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113448    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-cni-netd\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.113954 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113474    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/66938436-5c78-44c3-93f6-f52272cc9a6a-ovn-node-metrics-cert\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.113954 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113489    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1d1b3c8-a603-476b-b51d-8add45d50b13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.113954 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113536    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbxgf\" (UniqueName: \"kubernetes.io/projected/deb3bcf9-5f63-469d-b5d5-c5d62ffada99-kube-api-access-cbxgf\") pod \"node-ca-xjtcb\" (UID: \"deb3bcf9-5f63-469d-b5d5-c5d62ffada99\") " pod="openshift-image-registry/node-ca-xjtcb"
Oct 30 23:18:22.113954 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113558    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-kubelet\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.113954 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113580    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-run-systemd\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.113954 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113621    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-run-ovn-kubernetes\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.113954 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113658    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d27d7b3-0f5f-4604-86b1-eeb9d380104f-host-slash\") pod \"iptables-alerter-l6h2l\" (UID: \"6d27d7b3-0f5f-4604-86b1-eeb9d380104f\") " pod="openshift-network-operator/iptables-alerter-l6h2l"
Oct 30 23:18:22.113954 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113673    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-sysctl-d\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.113954 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113688    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b1d1b3c8-a603-476b-b51d-8add45d50b13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.113954 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113702    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-multus-socket-dir-parent\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.113954 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113720    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-multus-conf-dir\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.113954 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113737    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-run\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.113954 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113755    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl7lx\" (UniqueName: \"kubernetes.io/projected/23c01b5c-af64-4567-9350-41572e762182-kube-api-access-pl7lx\") pod \"network-metrics-daemon-bcpxq\" (UID: \"23c01b5c-af64-4567-9350-41572e762182\") " pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:22.113954 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113776    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1d1b3c8-a603-476b-b51d-8add45d50b13-cni-binary-copy\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.113954 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113799    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-run-multus-certs\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.113954 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113819    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/deb3bcf9-5f63-469d-b5d5-c5d62ffada99-host\") pod \"node-ca-xjtcb\" (UID: \"deb3bcf9-5f63-469d-b5d5-c5d62ffada99\") " pod="openshift-image-registry/node-ca-xjtcb"
Oct 30 23:18:22.114440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113833    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-run-openvswitch\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.114440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113847    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-systemd\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.114440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113861    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs\") pod \"network-metrics-daemon-bcpxq\" (UID: \"23c01b5c-af64-4567-9350-41572e762182\") " pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:22.114440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113876    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-slash\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.114440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113890    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-etc-openvswitch\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.114440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113909    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/66938436-5c78-44c3-93f6-f52272cc9a6a-env-overrides\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.114440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113923    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-modprobe-d\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.114440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.113936    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-sysconfig\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.114440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114016    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9pl4\" (UniqueName: \"kubernetes.io/projected/b1d1b3c8-a603-476b-b51d-8add45d50b13-kube-api-access-l9pl4\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.114440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114032    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-system-cni-dir\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.114440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-cnibin\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.114440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114061    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-run-k8s-cni-cncf-io\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.114440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114084    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-etc-kubernetes\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.114440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114104    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbp7k\" (UniqueName: \"kubernetes.io/projected/54c28267-55bc-4f8e-bb07-47e47951468d-kube-api-access-pbp7k\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.114440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114123    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vg5p\" (UniqueName: \"kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p\") pod \"network-check-target-mhrmm\" (UID: \"11f70cd2-d0b3-4a44-b936-1659972c6605\") " pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:22.114440 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114143    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-multus-cni-dir\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.114974 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114157    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-systemd-units\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.114974 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114171    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-cni-bin\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.114974 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114193    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/66938436-5c78-44c3-93f6-f52272cc9a6a-ovnkube-script-lib\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.114974 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114210    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-run-netns\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.114974 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114225    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.114974 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114245    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d27d7b3-0f5f-4604-86b1-eeb9d380104f-iptables-alerter-script\") pod \"iptables-alerter-l6h2l\" (UID: \"6d27d7b3-0f5f-4604-86b1-eeb9d380104f\") " pod="openshift-network-operator/iptables-alerter-l6h2l"
Oct 30 23:18:22.114974 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114276    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-sysctl-conf\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.114974 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114292    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6flp\" (UniqueName: \"kubernetes.io/projected/8e911a1c-c73e-40ed-ba22-74845a60e738-kube-api-access-x6flp\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.114974 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114309    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-tuned\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.114974 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114326    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54c28267-55bc-4f8e-bb07-47e47951468d-cni-binary-copy\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.114974 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-host\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.114974 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114357    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-var-lib-cni-bin\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.114974 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114373    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-run-ovn\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.114974 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114393    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-log-socket\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.114974 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.114407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-node-log\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.122585 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.122561    2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 23:18:22.138381 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.138354    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g8fnj"
Oct 30 23:18:22.152979 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.152954    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g8fnj"
Oct 30 23:18:22.182886 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.182837    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal" event={"ID":"72589e04a8c3b3f1c88140c7d0f5529b","Type":"ContainerStarted","Data":"9dbf9d7ad4443212e8208f0481360d30dbba209b7ad5ec315257f930efc9dd6f"}
Oct 30 23:18:22.183980 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.183954    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal" event={"ID":"2cfc9340daa6f45c0fb8540343ee68d0","Type":"ContainerStarted","Data":"9721ca05ece86f1ab8994e2ff5dcffb9f38efab1f240cda7154bb2af27c56aef"}
Oct 30 23:18:22.192703 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.192677    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 23:18:22.192920 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.192898    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 23:18:22.193001 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.192941    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lwvlw\""
Oct 30 23:18:22.193261 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193108    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 23:18:22.193261 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193173    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 23:18:22.193261 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193189    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 23:18:22.193261 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193193    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 23:18:22.193261 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193213    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qwtvf\""
Oct 30 23:18:22.193261 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193225    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kc52k\""
Oct 30 23:18:22.193261 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193217    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 23:18:22.193261 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193239    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 23:18:22.193577 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193415    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 23:18:22.193577 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193442    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 23:18:22.193577 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193475    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 23:18:22.193577 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193578    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 23:18:22.193792 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193617    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 23:18:22.193792 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193637    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 23:18:22.193792 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193704    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k8dwv\""
Oct 30 23:18:22.193792 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193739    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 23:18:22.193792 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193772    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-82xnp\""
Oct 30 23:18:22.194011 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193813    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 23:18:22.194011 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193836    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 23:18:22.194011 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193865    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-qmkhv\""
Oct 30 23:18:22.194011 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193890    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 23:18:22.194011 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.193933    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-n9xrj\""
Oct 30 23:18:22.202806 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.202787    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 23:18:22.214740 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.214679    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjqgs\" (UniqueName: \"kubernetes.io/projected/ff444d55-69cb-484d-a989-9dcd7b96524f-kube-api-access-mjqgs\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.214740 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.214716    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-sysctl-conf\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.214740 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.214739    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6flp\" (UniqueName: \"kubernetes.io/projected/8e911a1c-c73e-40ed-ba22-74845a60e738-kube-api-access-x6flp\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.214897 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.214760    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-socket-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.214897 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.214890    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-sysctl-conf\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.214967 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.214898    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-tuned\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.214967 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.214938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54c28267-55bc-4f8e-bb07-47e47951468d-cni-binary-copy\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.215044 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.214971    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-registration-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.215044 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.214999    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-host\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.215044 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-var-lib-cni-bin\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.215196 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215064    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-host\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.215196 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-run-ovn\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.215196 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215105    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-var-lib-cni-bin\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.215196 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215136    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-run-ovn\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.215196 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215142    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-log-socket\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.215196 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215182    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-sys-fs\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.215484 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215208    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-node-log\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.215484 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215183    2577 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 23:18:22.215484 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215230    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-log-socket\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.215484 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215239    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-sys\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.215484 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215266    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-var-lib-kubelet\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.215484 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215283    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e911a1c-c73e-40ed-ba22-74845a60e738-tmp\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.215484 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215273    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-node-log\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.215484 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215298    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-hostroot\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.215484 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215324    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-hostroot\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.215484 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215328    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54c28267-55bc-4f8e-bb07-47e47951468d-multus-daemon-config\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.215484 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215337    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-sys\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.215484 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215356    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/deb3bcf9-5f63-469d-b5d5-c5d62ffada99-serviceca\") pod \"node-ca-xjtcb\" (UID: \"deb3bcf9-5f63-469d-b5d5-c5d62ffada99\") " pod="openshift-image-registry/node-ca-xjtcb"
Oct 30 23:18:22.215484 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215359    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-var-lib-kubelet\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.215484 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215399    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csc8h\" (UniqueName: \"kubernetes.io/projected/6d27d7b3-0f5f-4604-86b1-eeb9d380104f-kube-api-access-csc8h\") pod \"iptables-alerter-l6h2l\" (UID: \"6d27d7b3-0f5f-4604-86b1-eeb9d380104f\") " pod="openshift-network-operator/iptables-alerter-l6h2l"
Oct 30 23:18:22.215484 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215430    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9047f37e-2d3c-4978-a5c1-4078d505ab15-hosts-file\") pod \"node-resolver-pnk7r\" (UID: \"9047f37e-2d3c-4978-a5c1-4078d505ab15\") " pod="openshift-dns/node-resolver-pnk7r"
Oct 30 23:18:22.215484 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215456    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.215484 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215477    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-kubelet-config\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:22.216154 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215506    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-run-netns\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.216154 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215507    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9047f37e-2d3c-4978-a5c1-4078d505ab15-hosts-file\") pod \"node-resolver-pnk7r\" (UID: \"9047f37e-2d3c-4978-a5c1-4078d505ab15\") " pod="openshift-dns/node-resolver-pnk7r"
Oct 30 23:18:22.216154 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215539    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-var-lib-openvswitch\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.216154 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215558    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-run-netns\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.216154 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215566    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkt4n\" (UniqueName: \"kubernetes.io/projected/66938436-5c78-44c3-93f6-f52272cc9a6a-kube-api-access-vkt4n\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.216154 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215623    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-var-lib-openvswitch\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.216154 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215640    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9047f37e-2d3c-4978-a5c1-4078d505ab15-tmp-dir\") pod \"node-resolver-pnk7r\" (UID: \"9047f37e-2d3c-4978-a5c1-4078d505ab15\") " pod="openshift-dns/node-resolver-pnk7r"
Oct 30 23:18:22.216154 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215667    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-device-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.216154 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215693    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:22.216154 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215761    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/499f7257-2e41-413c-b6b7-12089b9514a7-konnectivity-ca\") pod \"konnectivity-agent-6kctl\" (UID: \"499f7257-2e41-413c-b6b7-12089b9514a7\") " pod="kube-system/konnectivity-agent-6kctl"
Oct 30 23:18:22.216154 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215787    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-kubernetes\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.216154 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215846    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-kubernetes\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.216154 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215883    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-lib-modules\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.216154 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1d1b3c8-a603-476b-b51d-8add45d50b13-cnibin\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.216154 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215943    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/66938436-5c78-44c3-93f6-f52272cc9a6a-ovnkube-config\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.216154 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.215985    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-698bb\" (UniqueName: \"kubernetes.io/projected/9047f37e-2d3c-4978-a5c1-4078d505ab15-kube-api-access-698bb\") pod \"node-resolver-pnk7r\" (UID: \"9047f37e-2d3c-4978-a5c1-4078d505ab15\") " pod="openshift-dns/node-resolver-pnk7r"
Oct 30 23:18:22.216154 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216011    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1d1b3c8-a603-476b-b51d-8add45d50b13-system-cni-dir\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.216932 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216036    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b1d1b3c8-a603-476b-b51d-8add45d50b13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.216932 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216064    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-var-lib-cni-multus\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.216932 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216132    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9047f37e-2d3c-4978-a5c1-4078d505ab15-tmp-dir\") pod \"node-resolver-pnk7r\" (UID: \"9047f37e-2d3c-4978-a5c1-4078d505ab15\") " pod="openshift-dns/node-resolver-pnk7r"
Oct 30 23:18:22.216932 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216216    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-lib-modules\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.216932 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216237    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-var-lib-kubelet\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.216932 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216253    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-cni-netd\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.216932 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/66938436-5c78-44c3-93f6-f52272cc9a6a-ovn-node-metrics-cert\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.216932 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216285    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.216932 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216287    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/deb3bcf9-5f63-469d-b5d5-c5d62ffada99-serviceca\") pod \"node-ca-xjtcb\" (UID: \"deb3bcf9-5f63-469d-b5d5-c5d62ffada99\") " pod="openshift-image-registry/node-ca-xjtcb"
Oct 30 23:18:22.216932 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216302    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-dbus\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:22.216932 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216318    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1d1b3c8-a603-476b-b51d-8add45d50b13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.216932 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216346    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54c28267-55bc-4f8e-bb07-47e47951468d-cni-binary-copy\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.216932 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216363    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbxgf\" (UniqueName: \"kubernetes.io/projected/deb3bcf9-5f63-469d-b5d5-c5d62ffada99-kube-api-access-cbxgf\") pod \"node-ca-xjtcb\" (UID: \"deb3bcf9-5f63-469d-b5d5-c5d62ffada99\") " pod="openshift-image-registry/node-ca-xjtcb"
Oct 30 23:18:22.216932 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216379    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-kubelet\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.216932 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216393    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-run-systemd\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.216932 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216400    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-var-lib-kubelet\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.216932 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216408    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-run-ovn-kubernetes\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.217776 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216423    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d27d7b3-0f5f-4604-86b1-eeb9d380104f-host-slash\") pod \"iptables-alerter-l6h2l\" (UID: \"6d27d7b3-0f5f-4604-86b1-eeb9d380104f\") " pod="openshift-network-operator/iptables-alerter-l6h2l"
Oct 30 23:18:22.217776 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216436    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-sysctl-d\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.217776 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216453    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b1d1b3c8-a603-476b-b51d-8add45d50b13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.217776 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216476    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-multus-socket-dir-parent\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.217776 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216490    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-multus-conf-dir\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.217776 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-run\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.217776 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216525    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1d1b3c8-a603-476b-b51d-8add45d50b13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.217776 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216654    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-run\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.217776 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216658    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-multus-socket-dir-parent\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.217776 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216688    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-var-lib-cni-multus\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.217776 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216705    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-run-systemd\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.217776 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216725    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b1d1b3c8-a603-476b-b51d-8add45d50b13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.217776 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216763    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1d1b3c8-a603-476b-b51d-8add45d50b13-cnibin\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.217776 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216803    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1d1b3c8-a603-476b-b51d-8add45d50b13-system-cni-dir\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.217776 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216846    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl7lx\" (UniqueName: \"kubernetes.io/projected/23c01b5c-af64-4567-9350-41572e762182-kube-api-access-pl7lx\") pod \"network-metrics-daemon-bcpxq\" (UID: \"23c01b5c-af64-4567-9350-41572e762182\") " pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:22.217776 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216874    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1d1b3c8-a603-476b-b51d-8add45d50b13-cni-binary-copy\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.217776 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216878    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-cni-netd\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.218626 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216901    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-run-multus-certs\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.218626 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/deb3bcf9-5f63-469d-b5d5-c5d62ffada99-host\") pod \"node-ca-xjtcb\" (UID: \"deb3bcf9-5f63-469d-b5d5-c5d62ffada99\") " pod="openshift-image-registry/node-ca-xjtcb"
Oct 30 23:18:22.218626 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216931    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-run-ovn-kubernetes\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.218626 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-run-openvswitch\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.218626 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.216979    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-run-multus-certs\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.218626 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217021    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d27d7b3-0f5f-4604-86b1-eeb9d380104f-host-slash\") pod \"iptables-alerter-l6h2l\" (UID: \"6d27d7b3-0f5f-4604-86b1-eeb9d380104f\") " pod="openshift-network-operator/iptables-alerter-l6h2l"
Oct 30 23:18:22.218626 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217048    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-systemd\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.218626 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs\") pod \"network-metrics-daemon-bcpxq\" (UID: \"23c01b5c-af64-4567-9350-41572e762182\") " pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:22.218626 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217076    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-sysctl-d\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.218626 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217102    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-slash\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.218626 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217129    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-etc-openvswitch\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.218626 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217158    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/66938436-5c78-44c3-93f6-f52272cc9a6a-env-overrides\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.218626 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217183    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-modprobe-d\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.218626 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:22.217200    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:18:22.218626 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217212    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-sysconfig\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.218626 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:22.217346    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs podName:23c01b5c-af64-4567-9350-41572e762182 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:22.717323084 +0000 UTC m=+2.996573336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs") pod "network-metrics-daemon-bcpxq" (UID: "23c01b5c-af64-4567-9350-41572e762182") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:18:22.218626 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9pl4\" (UniqueName: \"kubernetes.io/projected/b1d1b3c8-a603-476b-b51d-8add45d50b13-kube-api-access-l9pl4\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.219563 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-system-cni-dir\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.219563 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217411    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-cnibin\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.219563 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217436    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-run-k8s-cni-cncf-io\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.219563 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217445    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/66938436-5c78-44c3-93f6-f52272cc9a6a-ovnkube-config\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.219563 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217473    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-etc-kubernetes\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.219563 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217499    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbp7k\" (UniqueName: \"kubernetes.io/projected/54c28267-55bc-4f8e-bb07-47e47951468d-kube-api-access-pbp7k\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.219563 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217508    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-kubelet\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.219563 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vg5p\" (UniqueName: \"kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p\") pod \"network-check-target-mhrmm\" (UID: \"11f70cd2-d0b3-4a44-b936-1659972c6605\") " pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:22.219563 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217539    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-run-openvswitch\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.219563 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217551    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-multus-cni-dir\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.219563 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217577    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-systemd-units\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.219563 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217585    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-sysconfig\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.219563 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217622    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-cni-bin\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.219563 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217647    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/66938436-5c78-44c3-93f6-f52272cc9a6a-ovnkube-script-lib\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.219563 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217675    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-slash\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.219563 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217676    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/499f7257-2e41-413c-b6b7-12089b9514a7-agent-certs\") pod \"konnectivity-agent-6kctl\" (UID: \"499f7257-2e41-413c-b6b7-12089b9514a7\") " pod="kube-system/konnectivity-agent-6kctl"
Oct 30 23:18:22.219563 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-run-netns\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.219563 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.220439 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217747    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-systemd\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.220439 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217711    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/deb3bcf9-5f63-469d-b5d5-c5d62ffada99-host\") pod \"node-ca-xjtcb\" (UID: \"deb3bcf9-5f63-469d-b5d5-c5d62ffada99\") " pod="openshift-image-registry/node-ca-xjtcb"
Oct 30 23:18:22.220439 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217790    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d27d7b3-0f5f-4604-86b1-eeb9d380104f-iptables-alerter-script\") pod \"iptables-alerter-l6h2l\" (UID: \"6d27d7b3-0f5f-4604-86b1-eeb9d380104f\") " pod="openshift-network-operator/iptables-alerter-l6h2l"
Oct 30 23:18:22.220439 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217973    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b1d1b3c8-a603-476b-b51d-8add45d50b13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.220439 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217997    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-system-cni-dir\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.220439 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.218047    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-modprobe-d\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.220439 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.218056    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-cnibin\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.220439 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.218094    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.220439 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.218151    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-etc-openvswitch\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.220439 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.218406    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d27d7b3-0f5f-4604-86b1-eeb9d380104f-iptables-alerter-script\") pod \"iptables-alerter-l6h2l\" (UID: \"6d27d7b3-0f5f-4604-86b1-eeb9d380104f\") " pod="openshift-network-operator/iptables-alerter-l6h2l"
Oct 30 23:18:22.220439 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.218454    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-run-netns\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.220439 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.218640    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/66938436-5c78-44c3-93f6-f52272cc9a6a-env-overrides\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.220439 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.218672    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1d1b3c8-a603-476b-b51d-8add45d50b13-cni-binary-copy\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.220439 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.218730    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-etc-kubernetes\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.220439 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.218783    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-run-k8s-cni-cncf-io\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.220439 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.218798    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/66938436-5c78-44c3-93f6-f52272cc9a6a-ovnkube-script-lib\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.220439 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.217648    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-multus-conf-dir\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.220439 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.218829    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-multus-cni-dir\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.221203 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.218836    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-systemd-units\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.221203 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.218861    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-cni-bin\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.221203 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.219344    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54c28267-55bc-4f8e-bb07-47e47951468d-multus-daemon-config\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.221203 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.220984    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-tuned\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.221203 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.221040    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e911a1c-c73e-40ed-ba22-74845a60e738-tmp\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.221203 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.221156    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/66938436-5c78-44c3-93f6-f52272cc9a6a-ovn-node-metrics-cert\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.229823 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:22.229801    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 23:18:22.229931 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:22.229830    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 23:18:22.229931 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:22.229846    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9vg5p for pod openshift-network-diagnostics/network-check-target-mhrmm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:18:22.229931 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:22.229906    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p podName:11f70cd2-d0b3-4a44-b936-1659972c6605 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:22.729888371 +0000 UTC m=+3.009138616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9vg5p" (UniqueName: "kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p") pod "network-check-target-mhrmm" (UID: "11f70cd2-d0b3-4a44-b936-1659972c6605") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:18:22.233562 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.233543    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbxgf\" (UniqueName: \"kubernetes.io/projected/deb3bcf9-5f63-469d-b5d5-c5d62ffada99-kube-api-access-cbxgf\") pod \"node-ca-xjtcb\" (UID: \"deb3bcf9-5f63-469d-b5d5-c5d62ffada99\") " pod="openshift-image-registry/node-ca-xjtcb"
Oct 30 23:18:22.233687 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.233564    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9pl4\" (UniqueName: \"kubernetes.io/projected/b1d1b3c8-a603-476b-b51d-8add45d50b13-kube-api-access-l9pl4\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.234114 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.234064    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkt4n\" (UniqueName: \"kubernetes.io/projected/66938436-5c78-44c3-93f6-f52272cc9a6a-kube-api-access-vkt4n\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.234682 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.234439    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl7lx\" (UniqueName: \"kubernetes.io/projected/23c01b5c-af64-4567-9350-41572e762182-kube-api-access-pl7lx\") pod \"network-metrics-daemon-bcpxq\" (UID: \"23c01b5c-af64-4567-9350-41572e762182\") " pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:22.234682 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.234642    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csc8h\" (UniqueName: \"kubernetes.io/projected/6d27d7b3-0f5f-4604-86b1-eeb9d380104f-kube-api-access-csc8h\") pod \"iptables-alerter-l6h2l\" (UID: \"6d27d7b3-0f5f-4604-86b1-eeb9d380104f\") " pod="openshift-network-operator/iptables-alerter-l6h2l"
Oct 30 23:18:22.234816 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.234744    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6flp\" (UniqueName: \"kubernetes.io/projected/8e911a1c-c73e-40ed-ba22-74845a60e738-kube-api-access-x6flp\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.235328 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.235302    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbp7k\" (UniqueName: \"kubernetes.io/projected/54c28267-55bc-4f8e-bb07-47e47951468d-kube-api-access-pbp7k\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.237380 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.237359    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-698bb\" (UniqueName: \"kubernetes.io/projected/9047f37e-2d3c-4978-a5c1-4078d505ab15-kube-api-access-698bb\") pod \"node-resolver-pnk7r\" (UID: \"9047f37e-2d3c-4978-a5c1-4078d505ab15\") " pod="openshift-dns/node-resolver-pnk7r"
Oct 30 23:18:22.319351 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.319313    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-sys-fs\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.319524 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.319378    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.319524 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.319470    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-kubelet-config\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:22.319524 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.319512    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-device-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.319706 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.319544    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:22.319706 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.319649    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/499f7257-2e41-413c-b6b7-12089b9514a7-konnectivity-ca\") pod \"konnectivity-agent-6kctl\" (UID: \"499f7257-2e41-413c-b6b7-12089b9514a7\") " pod="kube-system/konnectivity-agent-6kctl"
Oct 30 23:18:22.319706 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.319688    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.319788 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.319715    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-dbus\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:22.319922 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.319903    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/499f7257-2e41-413c-b6b7-12089b9514a7-agent-certs\") pod \"konnectivity-agent-6kctl\" (UID: \"499f7257-2e41-413c-b6b7-12089b9514a7\") " pod="kube-system/konnectivity-agent-6kctl"
Oct 30 23:18:22.319989 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.319946    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjqgs\" (UniqueName: \"kubernetes.io/projected/ff444d55-69cb-484d-a989-9dcd7b96524f-kube-api-access-mjqgs\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.319989 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.319981    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-socket-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.320225 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.320204    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-registration-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.323759 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:22.323734    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 23:18:22.323861 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:22.323823    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret podName:1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:22.823801996 +0000 UTC m=+3.103052240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret") pod "global-pull-secret-syncer-nd66m" (UID: "1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1") : object "kube-system"/"original-pull-secret" not registered
Oct 30 23:18:22.324124 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.324106    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-sys-fs\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.324244 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.324230    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.324311 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.324295    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-kubelet-config\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:22.324372 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.324357    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-device-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.324445 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.324429    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-dbus\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:22.324955 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.324925    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/499f7257-2e41-413c-b6b7-12089b9514a7-konnectivity-ca\") pod \"konnectivity-agent-6kctl\" (UID: \"499f7257-2e41-413c-b6b7-12089b9514a7\") " pod="kube-system/konnectivity-agent-6kctl"
Oct 30 23:18:22.325040 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.325017    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.325640 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.325616    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-socket-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.325729 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.325677    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-registration-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.327810 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.327788    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/499f7257-2e41-413c-b6b7-12089b9514a7-agent-certs\") pod \"konnectivity-agent-6kctl\" (UID: \"499f7257-2e41-413c-b6b7-12089b9514a7\") " pod="kube-system/konnectivity-agent-6kctl"
Oct 30 23:18:22.338992 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.338966    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjqgs\" (UniqueName: \"kubernetes.io/projected/ff444d55-69cb-484d-a989-9dcd7b96524f-kube-api-access-mjqgs\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.341824 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.341805    2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 23:18:22.401878 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.401840    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xjtcb"
Oct 30 23:18:22.414547 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:22.414516    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb3bcf9_5f63_469d_b5d5_c5d62ffada99.slice/crio-2a581223b6a0bc240f6f015313ae331cb0eded56903e9e6747b69be989f868a7 WatchSource:0}: Error finding container 2a581223b6a0bc240f6f015313ae331cb0eded56903e9e6747b69be989f868a7: Status 404 returned error can't find the container with id 2a581223b6a0bc240f6f015313ae331cb0eded56903e9e6747b69be989f868a7
Oct 30 23:18:22.425393 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.425370    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l6h2l"
Oct 30 23:18:22.431510 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.431484    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:22.432516 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.432496    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:18:22.433853 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:22.433829    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d27d7b3_0f5f_4604_86b1_eeb9d380104f.slice/crio-5d2f44ce8f28e7c05dd734fd61b25bd1364701feb5f0152a4c6d73c62dc453a9 WatchSource:0}: Error finding container 5d2f44ce8f28e7c05dd734fd61b25bd1364701feb5f0152a4c6d73c62dc453a9: Status 404 returned error can't find the container with id 5d2f44ce8f28e7c05dd734fd61b25bd1364701feb5f0152a4c6d73c62dc453a9
Oct 30 23:18:22.434529 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.434510    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pnk7r"
Oct 30 23:18:22.441918 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:22.441893    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66938436_5c78_44c3_93f6_f52272cc9a6a.slice/crio-a1cebb79bcf702596831550d1591c21eeba29e71ffc66e0af4d3b190c40a5b88 WatchSource:0}: Error finding container a1cebb79bcf702596831550d1591c21eeba29e71ffc66e0af4d3b190c40a5b88: Status 404 returned error can't find the container with id a1cebb79bcf702596831550d1591c21eeba29e71ffc66e0af4d3b190c40a5b88
Oct 30 23:18:22.445386 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:22.445361    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e911a1c_c73e_40ed_ba22_74845a60e738.slice/crio-a41dc858c716f6d85d3949a8a43c2a7f72fc3c7c99f09dfce6d70f20862f2673 WatchSource:0}: Error finding container a41dc858c716f6d85d3949a8a43c2a7f72fc3c7c99f09dfce6d70f20862f2673: Status 404 returned error can't find the container with id a41dc858c716f6d85d3949a8a43c2a7f72fc3c7c99f09dfce6d70f20862f2673
Oct 30 23:18:22.447826 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:22.447804    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9047f37e_2d3c_4978_a5c1_4078d505ab15.slice/crio-fb41cc09d0b7611a512e13fe4212b4ff8cd572d88c9002c98ce5c7d4383e1b81 WatchSource:0}: Error finding container fb41cc09d0b7611a512e13fe4212b4ff8cd572d88c9002c98ce5c7d4383e1b81: Status 404 returned error can't find the container with id fb41cc09d0b7611a512e13fe4212b4ff8cd572d88c9002c98ce5c7d4383e1b81
Oct 30 23:18:22.459357 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.459335    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jr84v"
Oct 30 23:18:22.461509 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.461486    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:18:22.467290 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.467272    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:18:22.469413 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.469395    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6kctl"
Oct 30 23:18:22.471957 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:22.471934    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c28267_55bc_4f8e_bb07_47e47951468d.slice/crio-2fff18e2c3dd870d20aaf9d2f9493ea6127941a9079b5705f503452f63a755e9 WatchSource:0}: Error finding container 2fff18e2c3dd870d20aaf9d2f9493ea6127941a9079b5705f503452f63a755e9: Status 404 returned error can't find the container with id 2fff18e2c3dd870d20aaf9d2f9493ea6127941a9079b5705f503452f63a755e9
Oct 30 23:18:22.476174 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:22.476150    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1d1b3c8_a603_476b_b51d_8add45d50b13.slice/crio-0343f872b6a8a39ba35e68b6956ee5712ee6265093488876bc05232087a5ecab WatchSource:0}: Error finding container 0343f872b6a8a39ba35e68b6956ee5712ee6265093488876bc05232087a5ecab: Status 404 returned error can't find the container with id 0343f872b6a8a39ba35e68b6956ee5712ee6265093488876bc05232087a5ecab
Oct 30 23:18:22.478648 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:22.478585    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff444d55_69cb_484d_a989_9dcd7b96524f.slice/crio-75743a85f02fdc5fac445ecc7a98dbca88d7047474d96dc08377e2ba8467cda9 WatchSource:0}: Error finding container 75743a85f02fdc5fac445ecc7a98dbca88d7047474d96dc08377e2ba8467cda9: Status 404 returned error can't find the container with id 75743a85f02fdc5fac445ecc7a98dbca88d7047474d96dc08377e2ba8467cda9
Oct 30 23:18:22.481383 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:22.481368    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod499f7257_2e41_413c_b6b7_12089b9514a7.slice/crio-7ed8ffb072f8f912613db8e51dca5fa6f57e4c121fdf050b852ce02c03c3248c WatchSource:0}: Error finding container 7ed8ffb072f8f912613db8e51dca5fa6f57e4c121fdf050b852ce02c03c3248c: Status 404 returned error can't find the container with id 7ed8ffb072f8f912613db8e51dca5fa6f57e4c121fdf050b852ce02c03c3248c
Oct 30 23:18:22.724047 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.723973    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs\") pod \"network-metrics-daemon-bcpxq\" (UID: \"23c01b5c-af64-4567-9350-41572e762182\") " pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:22.724195 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:22.724137    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:18:22.724195 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:22.724190    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs podName:23c01b5c-af64-4567-9350-41572e762182 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:23.72417752 +0000 UTC m=+4.003427749 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs") pod "network-metrics-daemon-bcpxq" (UID: "23c01b5c-af64-4567-9350-41572e762182") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:18:22.824523 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.824493    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:22.824695 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:22.824558    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vg5p\" (UniqueName: \"kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p\") pod \"network-check-target-mhrmm\" (UID: \"11f70cd2-d0b3-4a44-b936-1659972c6605\") " pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:22.824695 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:22.824655    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 23:18:22.824823 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:22.824696    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 23:18:22.824823 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:22.824713    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 23:18:22.824823 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:22.824727    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9vg5p for pod openshift-network-diagnostics/network-check-target-mhrmm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:18:22.824823 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:22.824755    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret podName:1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:23.824734788 +0000 UTC m=+4.103985039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret") pod "global-pull-secret-syncer-nd66m" (UID: "1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1") : object "kube-system"/"original-pull-secret" not registered
Oct 30 23:18:22.824823 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:22.824780    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p podName:11f70cd2-d0b3-4a44-b936-1659972c6605 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:23.824764131 +0000 UTC m=+4.104014380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9vg5p" (UniqueName: "kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p") pod "network-check-target-mhrmm" (UID: "11f70cd2-d0b3-4a44-b936-1659972c6605") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:18:23.156115 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:23.155788    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 23:13:22 +0000 UTC" deadline="2028-05-13 05:29:10.455134445 +0000 UTC"
Oct 30 23:18:23.156115 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:23.156066    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13446h10m47.29907262s"
Oct 30 23:18:23.178684 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:23.178642    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:23.178835 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:23.178765    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpxq" podUID="23c01b5c-af64-4567-9350-41572e762182"
Oct 30 23:18:23.197272 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:23.197213    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6kctl" event={"ID":"499f7257-2e41-413c-b6b7-12089b9514a7","Type":"ContainerStarted","Data":"7ed8ffb072f8f912613db8e51dca5fa6f57e4c121fdf050b852ce02c03c3248c"}
Oct 30 23:18:23.204968 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:23.204862    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw" event={"ID":"ff444d55-69cb-484d-a989-9dcd7b96524f","Type":"ContainerStarted","Data":"75743a85f02fdc5fac445ecc7a98dbca88d7047474d96dc08377e2ba8467cda9"}
Oct 30 23:18:23.215424 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:23.215345    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smpnh" event={"ID":"b1d1b3c8-a603-476b-b51d-8add45d50b13","Type":"ContainerStarted","Data":"0343f872b6a8a39ba35e68b6956ee5712ee6265093488876bc05232087a5ecab"}
Oct 30 23:18:23.225380 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:23.225344    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pnk7r" event={"ID":"9047f37e-2d3c-4978-a5c1-4078d505ab15","Type":"ContainerStarted","Data":"fb41cc09d0b7611a512e13fe4212b4ff8cd572d88c9002c98ce5c7d4383e1b81"}
Oct 30 23:18:23.239940 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:23.239910    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z" event={"ID":"66938436-5c78-44c3-93f6-f52272cc9a6a","Type":"ContainerStarted","Data":"a1cebb79bcf702596831550d1591c21eeba29e71ffc66e0af4d3b190c40a5b88"}
Oct 30 23:18:23.241484 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:23.241457    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l6h2l" event={"ID":"6d27d7b3-0f5f-4604-86b1-eeb9d380104f","Type":"ContainerStarted","Data":"5d2f44ce8f28e7c05dd734fd61b25bd1364701feb5f0152a4c6d73c62dc453a9"}
Oct 30 23:18:23.246124 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:23.246096    2577 generic.go:356] "Generic (PLEG): container finished" podID="72589e04a8c3b3f1c88140c7d0f5529b" containerID="c35a06bdddda30bde08beb785bc8dd52bc89b9216b39a2461a5ed2c0bec59438" exitCode=0
Oct 30 23:18:23.246207 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:23.246176    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal" event={"ID":"72589e04a8c3b3f1c88140c7d0f5529b","Type":"ContainerDied","Data":"c35a06bdddda30bde08beb785bc8dd52bc89b9216b39a2461a5ed2c0bec59438"}
Oct 30 23:18:23.249501 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:23.249448    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jr84v" event={"ID":"54c28267-55bc-4f8e-bb07-47e47951468d","Type":"ContainerStarted","Data":"2fff18e2c3dd870d20aaf9d2f9493ea6127941a9079b5705f503452f63a755e9"}
Oct 30 23:18:23.267246 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:23.267196    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jkxzf" event={"ID":"8e911a1c-c73e-40ed-ba22-74845a60e738","Type":"ContainerStarted","Data":"a41dc858c716f6d85d3949a8a43c2a7f72fc3c7c99f09dfce6d70f20862f2673"}
Oct 30 23:18:23.293982 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:23.293885    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xjtcb" event={"ID":"deb3bcf9-5f63-469d-b5d5-c5d62ffada99","Type":"ContainerStarted","Data":"2a581223b6a0bc240f6f015313ae331cb0eded56903e9e6747b69be989f868a7"}
Oct 30 23:18:23.732277 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:23.732192    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs\") pod \"network-metrics-daemon-bcpxq\" (UID: \"23c01b5c-af64-4567-9350-41572e762182\") " pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:23.732535 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:23.732394    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:18:23.732535 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:23.732457    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs podName:23c01b5c-af64-4567-9350-41572e762182 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:25.732439817 +0000 UTC m=+6.011690060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs") pod "network-metrics-daemon-bcpxq" (UID: "23c01b5c-af64-4567-9350-41572e762182") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:18:23.833010 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:23.832978    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:23.833194 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:23.833034    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vg5p\" (UniqueName: \"kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p\") pod \"network-check-target-mhrmm\" (UID: \"11f70cd2-d0b3-4a44-b936-1659972c6605\") " pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:23.833194 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:23.833130    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 23:18:23.833194 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:23.833142    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 23:18:23.833194 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:23.833153    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9vg5p for pod openshift-network-diagnostics/network-check-target-mhrmm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:18:23.833194 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:23.833194    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p podName:11f70cd2-d0b3-4a44-b936-1659972c6605 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:25.83318163 +0000 UTC m=+6.112431873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9vg5p" (UniqueName: "kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p") pod "network-check-target-mhrmm" (UID: "11f70cd2-d0b3-4a44-b936-1659972c6605") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:18:23.833457 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:23.833304    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 23:18:23.833457 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:23.833356    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret podName:1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:25.83334173 +0000 UTC m=+6.112591973 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret") pod "global-pull-secret-syncer-nd66m" (UID: "1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1") : object "kube-system"/"original-pull-secret" not registered
Oct 30 23:18:24.156393 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:24.156346    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 23:13:22 +0000 UTC" deadline="2028-07-05 05:47:12.945347884 +0000 UTC"
Oct 30 23:18:24.156393 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:24.156385    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14718h28m48.788967047s"
Oct 30 23:18:24.179836 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:24.179807    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:24.179989 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:24.179968    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd66m" podUID="1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1"
Oct 30 23:18:24.180062 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:24.179983    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:24.180162 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:24.180110    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhrmm" podUID="11f70cd2-d0b3-4a44-b936-1659972c6605"
Oct 30 23:18:24.305210 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:24.304452    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal" event={"ID":"72589e04a8c3b3f1c88140c7d0f5529b","Type":"ContainerStarted","Data":"204b3720d3374a431bc90f0f9e42d785114ccecdbc1b8adb29b5b7eaae8d47f6"}
Oct 30 23:18:25.179003 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:25.178980    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:25.179460 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:25.179093    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpxq" podUID="23c01b5c-af64-4567-9350-41572e762182"
Oct 30 23:18:25.317019 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:25.316969    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal" event={"ID":"2cfc9340daa6f45c0fb8540343ee68d0","Type":"ContainerStarted","Data":"09cd119e51317e7a5f7da033fff606a848b8e935d27378ef0426f4fa63f24470"}
Oct 30 23:18:25.332510 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:25.332448    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal" podStartSLOduration=4.332430824 podStartE2EDuration="4.332430824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:18:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:24.331112461 +0000 UTC m=+4.610362713" watchObservedRunningTime="2026-10-30 23:18:25.332430824 +0000 UTC m=+5.611681073"
Oct 30 23:18:25.753524 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:25.753440    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs\") pod \"network-metrics-daemon-bcpxq\" (UID: \"23c01b5c-af64-4567-9350-41572e762182\") " pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:25.753710 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:25.753664    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:18:25.753755 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:25.753733    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs podName:23c01b5c-af64-4567-9350-41572e762182 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:29.753714255 +0000 UTC m=+10.032964498 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs") pod "network-metrics-daemon-bcpxq" (UID: "23c01b5c-af64-4567-9350-41572e762182") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:18:25.854434 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:25.854394    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vg5p\" (UniqueName: \"kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p\") pod \"network-check-target-mhrmm\" (UID: \"11f70cd2-d0b3-4a44-b936-1659972c6605\") " pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:25.854640 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:25.854468    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:25.854640 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:25.854588    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 23:18:25.854773 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:25.854676    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret podName:1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:29.854655004 +0000 UTC m=+10.133905258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret") pod "global-pull-secret-syncer-nd66m" (UID: "1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1") : object "kube-system"/"original-pull-secret" not registered
Oct 30 23:18:25.855112 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:25.855091    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 23:18:25.855183 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:25.855119    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 23:18:25.855183 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:25.855132    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9vg5p for pod openshift-network-diagnostics/network-check-target-mhrmm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:18:25.855183 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:25.855175    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p podName:11f70cd2-d0b3-4a44-b936-1659972c6605 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:29.855160573 +0000 UTC m=+10.134410818 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9vg5p" (UniqueName: "kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p") pod "network-check-target-mhrmm" (UID: "11f70cd2-d0b3-4a44-b936-1659972c6605") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:18:26.181793 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:26.181141    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:26.181793 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:26.181256    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd66m" podUID="1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1"
Oct 30 23:18:26.181793 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:26.181646    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:26.181793 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:26.181715    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhrmm" podUID="11f70cd2-d0b3-4a44-b936-1659972c6605"
Oct 30 23:18:26.331642 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:26.331003    2577 generic.go:356] "Generic (PLEG): container finished" podID="b1d1b3c8-a603-476b-b51d-8add45d50b13" containerID="4c18adb264a07de33f40e38da7fdb82c69904dd978b982475a888b1c208d769c" exitCode=0
Oct 30 23:18:26.331642 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:26.331135    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smpnh" event={"ID":"b1d1b3c8-a603-476b-b51d-8add45d50b13","Type":"ContainerDied","Data":"4c18adb264a07de33f40e38da7fdb82c69904dd978b982475a888b1c208d769c"}
Oct 30 23:18:26.360419 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:26.360367    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal" podStartSLOduration=5.360349612 podStartE2EDuration="5.360349612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:18:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:25.333453163 +0000 UTC m=+5.612703415" watchObservedRunningTime="2026-10-30 23:18:26.360349612 +0000 UTC m=+6.639599866"
Oct 30 23:18:27.178524 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:27.178494    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:27.178798 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:27.178647    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpxq" podUID="23c01b5c-af64-4567-9350-41572e762182"
Oct 30 23:18:27.343164 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:27.342393    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6kctl" event={"ID":"499f7257-2e41-413c-b6b7-12089b9514a7","Type":"ContainerStarted","Data":"48ff10338014907421c5750302d589c0a0588f7878f0c76e30569cac18de090d"}
Oct 30 23:18:28.181020 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:28.180968    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:28.181199 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:28.181098    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd66m" podUID="1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1"
Oct 30 23:18:28.181199 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:28.181170    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:28.181270 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:28.181236    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhrmm" podUID="11f70cd2-d0b3-4a44-b936-1659972c6605"
Oct 30 23:18:28.351961 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:28.351928    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xjtcb" event={"ID":"deb3bcf9-5f63-469d-b5d5-c5d62ffada99","Type":"ContainerStarted","Data":"39d91cf808e0f060c814751cbae69793e1b3a0a3a8ce1019fba71c8cb28b63c4"}
Oct 30 23:18:28.370960 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:28.370913    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6kctl" podStartSLOduration=4.22295956 podStartE2EDuration="8.370900423s" totalImagesPullingTime="4.147940863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:27.360838659 +0000 UTC m=+7.640088910" watchObservedRunningTime="2026-10-30 23:18:28.370900423 +0000 UTC m=+8.650150673"
Oct 30 23:18:28.371376 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:28.371336    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xjtcb" podStartSLOduration=3.3665807389999998 podStartE2EDuration="8.371321909s" totalImagesPullingTime="5.00474117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:28.370636978 +0000 UTC m=+8.649887230" watchObservedRunningTime="2026-10-30 23:18:28.371321909 +0000 UTC m=+8.650572162"
Oct 30 23:18:29.178972 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:29.178899    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:29.179152 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:29.179026    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpxq" podUID="23c01b5c-af64-4567-9350-41572e762182"
Oct 30 23:18:29.356816 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:29.356781    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw" event={"ID":"ff444d55-69cb-484d-a989-9dcd7b96524f","Type":"ContainerStarted","Data":"aeb0f12a7fb1e537e116663b02508cb66acfda9bb95eaa24f961def0632c2e7c"}
Oct 30 23:18:29.793314 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:29.793275    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs\") pod \"network-metrics-daemon-bcpxq\" (UID: \"23c01b5c-af64-4567-9350-41572e762182\") " pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:29.793474 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:29.793429    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:18:29.793533 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:29.793511    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs podName:23c01b5c-af64-4567-9350-41572e762182 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:37.793492009 +0000 UTC m=+18.072742247 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs") pod "network-metrics-daemon-bcpxq" (UID: "23c01b5c-af64-4567-9350-41572e762182") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:18:29.894734 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:29.894696    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:29.894896 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:29.894810    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vg5p\" (UniqueName: \"kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p\") pod \"network-check-target-mhrmm\" (UID: \"11f70cd2-d0b3-4a44-b936-1659972c6605\") " pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:29.894969 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:29.894952    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 23:18:29.895023 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:29.894974    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 23:18:29.895023 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:29.894986    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9vg5p for pod openshift-network-diagnostics/network-check-target-mhrmm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:18:29.895125 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:29.895043    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p podName:11f70cd2-d0b3-4a44-b936-1659972c6605 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:37.895026462 +0000 UTC m=+18.174276705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9vg5p" (UniqueName: "kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p") pod "network-check-target-mhrmm" (UID: "11f70cd2-d0b3-4a44-b936-1659972c6605") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:18:29.895352 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:29.895337    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 23:18:29.895413 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:29.895377    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret podName:1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:37.895367735 +0000 UTC m=+18.174617976 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret") pod "global-pull-secret-syncer-nd66m" (UID: "1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1") : object "kube-system"/"original-pull-secret" not registered
Oct 30 23:18:30.178299 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:30.178267    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:30.178444 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:30.178405    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd66m" podUID="1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1"
Oct 30 23:18:30.178808 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:30.178789    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:30.178917 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:30.178894    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhrmm" podUID="11f70cd2-d0b3-4a44-b936-1659972c6605"
Oct 30 23:18:30.194731 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:30.193422    2577 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/systemd-update-utmp-runlevel.service\": RecentStats: unable to find data in memory cache]"
Oct 30 23:18:30.252399 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:30.252360    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6kctl"
Oct 30 23:18:30.253508 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:30.253317    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6kctl"
Oct 30 23:18:30.320443 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:30.320411    2577 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 23:18:30.360130 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:30.360104    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw" event={"ID":"ff444d55-69cb-484d-a989-9dcd7b96524f","Type":"ContainerStarted","Data":"6ff0b01b4f07be5ff92bd9d6f5efebcab85f58974d2c799024c5e868a9be05c4"}
Oct 30 23:18:30.367352 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:30.364174    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jr84v" event={"ID":"54c28267-55bc-4f8e-bb07-47e47951468d","Type":"ContainerStarted","Data":"d15c88b5678535f4781af03bebec59b1b668463a6e6e875eafe695ec9923d218"}
Oct 30 23:18:30.388279 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:30.388229    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-jr84v" podStartSLOduration=2.827991012 podStartE2EDuration="10.388211266s" totalImagesPullingTime="7.560220254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:30.387188013 +0000 UTC m=+10.666438268" watchObservedRunningTime="2026-10-30 23:18:30.388211266 +0000 UTC m=+10.667461520"
Oct 30 23:18:31.178872 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:31.178537    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:31.178984 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:31.178904    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpxq" podUID="23c01b5c-af64-4567-9350-41572e762182"
Oct 30 23:18:31.184687 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:31.184563    2577 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T23:18:30.320430557Z","UUID":"6dcbb3fe-85a4-4279-83e7-38cd1eb73a09","Handler":null,"Name":"","Endpoint":""}
Oct 30 23:18:31.186869 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:31.186404    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 23:18:31.186869 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:31.186433    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 23:18:31.368742 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:31.368706    2577 generic.go:356] "Generic (PLEG): container finished" podID="b1d1b3c8-a603-476b-b51d-8add45d50b13" containerID="f64522f887993421021c15d2e84937b5096aa16f6d7199a6249fcbc4082f9eb2" exitCode=0
Oct 30 23:18:31.369176 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:31.368941    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smpnh" event={"ID":"b1d1b3c8-a603-476b-b51d-8add45d50b13","Type":"ContainerDied","Data":"f64522f887993421021c15d2e84937b5096aa16f6d7199a6249fcbc4082f9eb2"}
Oct 30 23:18:31.371674 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:31.371620    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pnk7r" event={"ID":"9047f37e-2d3c-4978-a5c1-4078d505ab15","Type":"ContainerStarted","Data":"d83bcdd4ddf74bd44ecd3d02ebfb6c888ea68d0b49943e765f8e03ef5513bc4c"}
Oct 30 23:18:31.417088 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:31.416276    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-pnk7r" podStartSLOduration=3.520685607 podStartE2EDuration="11.416257676s" totalImagesPullingTime="7.895572069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:31.416114858 +0000 UTC m=+11.695365111" watchObservedRunningTime="2026-10-30 23:18:31.416257676 +0000 UTC m=+11.695507928"
Oct 30 23:18:32.180096 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:32.178520    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:32.180096 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:32.178669    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd66m" podUID="1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1"
Oct 30 23:18:32.180096 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:32.179118    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:32.180096 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:32.179216    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhrmm" podUID="11f70cd2-d0b3-4a44-b936-1659972c6605"
Oct 30 23:18:32.381170 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:32.381125    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw" event={"ID":"ff444d55-69cb-484d-a989-9dcd7b96524f","Type":"ContainerStarted","Data":"2ac485f1df3c2d36381589ace9e3b799b3d2c79b834b7e433a63306152756684"}
Oct 30 23:18:32.384041 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:32.384014    2577 generic.go:356] "Generic (PLEG): container finished" podID="b1d1b3c8-a603-476b-b51d-8add45d50b13" containerID="844e874fccf277d33efa9f9d59ab9b2fd5a71a1f1cc7ae4d5ed4518498061d2d" exitCode=0
Oct 30 23:18:32.384149 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:32.384102    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smpnh" event={"ID":"b1d1b3c8-a603-476b-b51d-8add45d50b13","Type":"ContainerDied","Data":"844e874fccf277d33efa9f9d59ab9b2fd5a71a1f1cc7ae4d5ed4518498061d2d"}
Oct 30 23:18:32.385928 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:32.385871    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l6h2l" event={"ID":"6d27d7b3-0f5f-4604-86b1-eeb9d380104f","Type":"ContainerStarted","Data":"cc32d2b098926540e3d49dcf64259c75a8916896668f094a1b0bc60aaf3d8b59"}
Oct 30 23:18:32.401133 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:32.401046    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw" podStartSLOduration=3.868342279 podStartE2EDuration="12.401032219s" totalImagesPullingTime="8.53268994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:18:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:32.400883611 +0000 UTC m=+12.680133863" watchObservedRunningTime="2026-10-30 23:18:32.401032219 +0000 UTC m=+12.680282471"
Oct 30 23:18:32.419041 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:32.419007    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l6h2l" podStartSLOduration=4.80492068 podStartE2EDuration="12.418996379s" totalImagesPullingTime="7.614075699s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:32.418803013 +0000 UTC m=+12.698053265" watchObservedRunningTime="2026-10-30 23:18:32.418996379 +0000 UTC m=+12.698246629"
Oct 30 23:18:33.178508 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:33.178481    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:33.178658 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:33.178587    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpxq" podUID="23c01b5c-af64-4567-9350-41572e762182"
Oct 30 23:18:33.389019 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:33.388985    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jkxzf" event={"ID":"8e911a1c-c73e-40ed-ba22-74845a60e738","Type":"ContainerStarted","Data":"93f1d3660cd7fe1b245a6ec4b6aa14ddcd0a04fd5ed99cfdaec6378ab001cf08"}
Oct 30 23:18:33.408178 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:33.408138    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jkxzf" podStartSLOduration=3.217719796 podStartE2EDuration="13.408127053s" totalImagesPullingTime="10.190407257s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:33.407679974 +0000 UTC m=+13.686930225" watchObservedRunningTime="2026-10-30 23:18:33.408127053 +0000 UTC m=+13.687377301"
Oct 30 23:18:34.179148 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:34.178925    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:34.179390 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:34.178975    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:34.179390 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:34.179248    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd66m" podUID="1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1"
Oct 30 23:18:34.179390 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:34.179344    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhrmm" podUID="11f70cd2-d0b3-4a44-b936-1659972c6605"
Oct 30 23:18:34.393525 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:34.393490    2577 generic.go:356] "Generic (PLEG): container finished" podID="b1d1b3c8-a603-476b-b51d-8add45d50b13" containerID="cd4c8059f67fd213b720355b6116782022fc967779111c033742d69214d6d916" exitCode=0
Oct 30 23:18:34.393990 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:34.393574    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smpnh" event={"ID":"b1d1b3c8-a603-476b-b51d-8add45d50b13","Type":"ContainerDied","Data":"cd4c8059f67fd213b720355b6116782022fc967779111c033742d69214d6d916"}
Oct 30 23:18:35.178433 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:35.178390    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:35.178618 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:35.178537    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpxq" podUID="23c01b5c-af64-4567-9350-41572e762182"
Oct 30 23:18:36.179197 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:36.179160    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:36.179710 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:36.179297    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd66m" podUID="1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1"
Oct 30 23:18:36.179710 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:36.179351    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:36.179710 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:36.179435    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhrmm" podUID="11f70cd2-d0b3-4a44-b936-1659972c6605"
Oct 30 23:18:37.178510 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:37.178479    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:37.178684 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:37.178634    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpxq" podUID="23c01b5c-af64-4567-9350-41572e762182"
Oct 30 23:18:37.402176 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:37.402141    2577 generic.go:356] "Generic (PLEG): container finished" podID="b1d1b3c8-a603-476b-b51d-8add45d50b13" containerID="658b4c4d93fb4b82d8dd3c27f2128b1641f5081cd0b418638398836f861399c8" exitCode=0
Oct 30 23:18:37.402543 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:37.402189    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smpnh" event={"ID":"b1d1b3c8-a603-476b-b51d-8add45d50b13","Type":"ContainerDied","Data":"658b4c4d93fb4b82d8dd3c27f2128b1641f5081cd0b418638398836f861399c8"}
Oct 30 23:18:37.858549 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:37.858522    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs\") pod \"network-metrics-daemon-bcpxq\" (UID: \"23c01b5c-af64-4567-9350-41572e762182\") " pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:37.858694 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:37.858677    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:18:37.858760 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:37.858735    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs podName:23c01b5c-af64-4567-9350-41572e762182 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:53.858720465 +0000 UTC m=+34.137970694 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs") pod "network-metrics-daemon-bcpxq" (UID: "23c01b5c-af64-4567-9350-41572e762182") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 23:18:37.959828 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:37.959803    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:37.959913 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:37.959858    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vg5p\" (UniqueName: \"kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p\") pod \"network-check-target-mhrmm\" (UID: \"11f70cd2-d0b3-4a44-b936-1659972c6605\") " pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:37.959956 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:37.959941    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 23:18:37.959956 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:37.959950    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 23:18:37.960027 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:37.959971    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 23:18:37.960027 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:37.959985    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9vg5p for pod openshift-network-diagnostics/network-check-target-mhrmm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:18:37.960027 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:37.959995    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret podName:1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:53.959980341 +0000 UTC m=+34.239230570 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret") pod "global-pull-secret-syncer-nd66m" (UID: "1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1") : object "kube-system"/"original-pull-secret" not registered
Oct 30 23:18:37.960027 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:37.960020    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p podName:11f70cd2-d0b3-4a44-b936-1659972c6605 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:53.960010222 +0000 UTC m=+34.239260452 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9vg5p" (UniqueName: "kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p") pod "network-check-target-mhrmm" (UID: "11f70cd2-d0b3-4a44-b936-1659972c6605") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 23:18:38.178435 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:38.178391    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:38.178435 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:38.178432    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:38.178681 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:38.178516    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhrmm" podUID="11f70cd2-d0b3-4a44-b936-1659972c6605"
Oct 30 23:18:38.178681 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:38.178550    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd66m" podUID="1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1"
Oct 30 23:18:38.406910 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:38.406817    2577 generic.go:356] "Generic (PLEG): container finished" podID="b1d1b3c8-a603-476b-b51d-8add45d50b13" containerID="139a4979493d2d6462061200a9174087d0ce21788760cea9b0c4fca6c95a9ae2" exitCode=0
Oct 30 23:18:38.407414 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:38.406905    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smpnh" event={"ID":"b1d1b3c8-a603-476b-b51d-8add45d50b13","Type":"ContainerDied","Data":"139a4979493d2d6462061200a9174087d0ce21788760cea9b0c4fca6c95a9ae2"}
Oct 30 23:18:38.411501 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:38.411466    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z" event={"ID":"66938436-5c78-44c3-93f6-f52272cc9a6a","Type":"ContainerStarted","Data":"7ba9863d6d8f17e4f6a81e5e2160b28e92fcc79893f336020168aa0b1ce72b82"}
Oct 30 23:18:38.411579 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:38.411559    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z" event={"ID":"66938436-5c78-44c3-93f6-f52272cc9a6a","Type":"ContainerStarted","Data":"46ab923e8a3bfddb965fc51890b13854b456bf7ca1414b5fcecbce0c29047b61"}
Oct 30 23:18:38.411651 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:38.411635    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z" event={"ID":"66938436-5c78-44c3-93f6-f52272cc9a6a","Type":"ContainerStarted","Data":"6cb55ad0846f0342568ce13ac4ff89178ec5a204897a8a0fe641f1b57a430c36"}
Oct 30 23:18:38.411708 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:38.411695    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z" event={"ID":"66938436-5c78-44c3-93f6-f52272cc9a6a","Type":"ContainerStarted","Data":"dcc6f13d91b16ccfc8aeb62f9ac05b5477add333b98b8f8cc5787509c986c707"}
Oct 30 23:18:38.411758 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:38.411745    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z" event={"ID":"66938436-5c78-44c3-93f6-f52272cc9a6a","Type":"ContainerStarted","Data":"1cdbfdebca1d4c4013fbd62d6e758d8ef9f9b712268c7cf4178d6f9d206fde5f"}
Oct 30 23:18:38.411806 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:38.411792    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z" event={"ID":"66938436-5c78-44c3-93f6-f52272cc9a6a","Type":"ContainerStarted","Data":"794f91ec163af47dc3b1a69e0f3723d69dc27f993d0e7088f4a2d3931568f2a5"}
Oct 30 23:18:39.178889 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:39.178849    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:39.179066 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:39.178962    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpxq" podUID="23c01b5c-af64-4567-9350-41572e762182"
Oct 30 23:18:39.416566 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:39.416535    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smpnh" event={"ID":"b1d1b3c8-a603-476b-b51d-8add45d50b13","Type":"ContainerStarted","Data":"f9e1deff5c19f4ce61c26b86f2ca142738829e5f68c1c03253bb0351fe2d18f2"}
Oct 30 23:18:39.442086 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:39.442003    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-smpnh" podStartSLOduration=8.524494067 podStartE2EDuration="19.441990991s" totalImagesPullingTime="10.917496924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:18:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:39.44172015 +0000 UTC m=+19.720970403" watchObservedRunningTime="2026-10-30 23:18:39.441990991 +0000 UTC m=+19.721241242"
Oct 30 23:18:40.179080 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:40.179058    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:40.179161 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:40.179143    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd66m" podUID="1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1"
Oct 30 23:18:40.179249 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:40.179230    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:40.179353 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:40.179335    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhrmm" podUID="11f70cd2-d0b3-4a44-b936-1659972c6605"
Oct 30 23:18:40.209930 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:40.209906    2577 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/systemd-update-utmp-runlevel.service\": RecentStats: unable to find data in memory cache]"
Oct 30 23:18:40.421419 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:40.421340    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z" event={"ID":"66938436-5c78-44c3-93f6-f52272cc9a6a","Type":"ContainerStarted","Data":"593131ee5455b4e257bc1247e483b9f551ad541f43e807fe5ab02c98a5febcc0"}
Oct 30 23:18:41.179118 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:41.179087    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:41.179291 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:41.179185    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpxq" podUID="23c01b5c-af64-4567-9350-41572e762182"
Oct 30 23:18:42.176913 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:42.176884    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6kctl"
Oct 30 23:18:42.177469 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:42.177003    2577 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 23:18:42.177541 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:42.177496    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6kctl"
Oct 30 23:18:42.178931 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:42.178916    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:42.179026 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:42.179008    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhrmm" podUID="11f70cd2-d0b3-4a44-b936-1659972c6605"
Oct 30 23:18:42.179088 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:42.179075    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:42.179188 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:42.179171    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd66m" podUID="1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1"
Oct 30 23:18:42.431645 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:42.431561    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z" event={"ID":"66938436-5c78-44c3-93f6-f52272cc9a6a","Type":"ContainerStarted","Data":"033efd46ef903b0f2d8e5561d68138cb878c692097c164563918e0f70539de64"}
Oct 30 23:18:42.431836 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:42.431813    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:42.432621 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:42.432277    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:42.451723 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:42.451639    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:42.466291 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:42.466236    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z" podStartSLOduration=7.117723745 podStartE2EDuration="22.466217639s" totalImagesPullingTime="15.348493894s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:42.465654867 +0000 UTC m=+22.744905118" watchObservedRunningTime="2026-10-30 23:18:42.466217639 +0000 UTC m=+22.745467892"
Oct 30 23:18:43.178817 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:43.178787    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:43.179418 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:43.178883    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpxq" podUID="23c01b5c-af64-4567-9350-41572e762182"
Oct 30 23:18:43.433785 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:43.433716    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:43.449901 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:43.449879    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:18:44.179106 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:44.178886    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:44.179548 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:44.178947    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:44.179548 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:44.179207    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd66m" podUID="1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1"
Oct 30 23:18:44.179548 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:44.179257    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhrmm" podUID="11f70cd2-d0b3-4a44-b936-1659972c6605"
Oct 30 23:18:44.311209 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:44.311095    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bcpxq"]
Oct 30 23:18:44.311342 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:44.311229    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:44.311342 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:44.311330    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpxq" podUID="23c01b5c-af64-4567-9350-41572e762182"
Oct 30 23:18:44.313492 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:44.313463    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nd66m"]
Oct 30 23:18:44.314487 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:44.314464    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mhrmm"]
Oct 30 23:18:44.436069 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:44.436047    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:44.436355 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:44.436340    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:44.436452 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:44.436433    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd66m" podUID="1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1"
Oct 30 23:18:44.436541 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:44.436519    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhrmm" podUID="11f70cd2-d0b3-4a44-b936-1659972c6605"
Oct 30 23:18:46.179157 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:46.179119    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:46.179157 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:46.179153    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:46.179706 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:46.179238    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhrmm" podUID="11f70cd2-d0b3-4a44-b936-1659972c6605"
Oct 30 23:18:46.179706 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:46.179283    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:46.179706 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:46.179363    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpxq" podUID="23c01b5c-af64-4567-9350-41572e762182"
Oct 30 23:18:46.179706 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:46.179412    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd66m" podUID="1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1"
Oct 30 23:18:48.178609 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:48.178572    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:48.178989 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:48.178578    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:48.178989 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:48.178719    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:48.178989 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:48.178697    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd66m" podUID="1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1"
Oct 30 23:18:48.178989 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:48.178802    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhrmm" podUID="11f70cd2-d0b3-4a44-b936-1659972c6605"
Oct 30 23:18:48.178989 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:48.178933    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpxq" podUID="23c01b5c-af64-4567-9350-41572e762182"
Oct 30 23:18:49.537451 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.537399    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeReady"
Oct 30 23:18:49.537937 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.537536    2577 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 23:18:49.580311 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.580269    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-gpk5m"]
Oct 30 23:18:49.583551 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.583528    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-gpk5m"
Oct 30 23:18:49.584190 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.584167    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-hlltf"]
Oct 30 23:18:49.591897 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.589547    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 23:18:49.591897 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.589734    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 23:18:49.591897 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.590632    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-z84cb"]
Oct 30 23:18:49.591897 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.591494    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-hlltf"
Oct 30 23:18:49.593650 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.593633    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"]
Oct 30 23:18:49.593767 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.593749    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:18:49.596999 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.596981    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-zlgnn"]
Oct 30 23:18:49.597103 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.597088    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:18:49.600508 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.600490    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-h4zqg\""
Oct 30 23:18:49.600738 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.600720    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"]
Oct 30 23:18:49.600839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.600824    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-zlgnn"
Oct 30 23:18:49.602904 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.602888    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 23:18:49.607964 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.607944    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-54c94948b5-5fm4s"]
Oct 30 23:18:49.608160 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.608124    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"
Oct 30 23:18:49.614772 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.614748    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-qdr5f"]
Oct 30 23:18:49.615505 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.615490    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:49.617745 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.617727    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qhkwj"]
Oct 30 23:18:49.617856 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.617835    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.623216 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.623195    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cf56b4bd9-285cx"]
Oct 30 23:18:49.623308 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.623291    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qhkwj"
Oct 30 23:18:49.628831 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.628810    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-qs244"]
Oct 30 23:18:49.632636 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.632582    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.642137 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.642116    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"]
Oct 30 23:18:49.642543 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.642261    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:18:49.645367 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.645349    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"]
Oct 30 23:18:49.645491 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.645475    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"
Oct 30 23:18:49.648874 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.648851    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6888fc6c96-6gdwr"]
Oct 30 23:18:49.649312 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.649293    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:18:49.651846 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.651829    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-flrmm"]
Oct 30 23:18:49.651936 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.651918    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.654850 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.654832    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-gpk5m"]
Oct 30 23:18:49.654942 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.654866    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-hlltf"]
Oct 30 23:18:49.654942 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.654889    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-295nz"]
Oct 30 23:18:49.655045 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.654961    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-flrmm"
Oct 30 23:18:49.657866 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.657851    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-zlgnn"]
Oct 30 23:18:49.657955 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.657882    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"]
Oct 30 23:18:49.657955 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.657904    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-qdr5f"]
Oct 30 23:18:49.657955 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.657925    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fsbsg"]
Oct 30 23:18:49.657955 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.657945    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-295nz"
Oct 30 23:18:49.661084 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.661067    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-flrmm"]
Oct 30 23:18:49.661164 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.661096    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-qs244"]
Oct 30 23:18:49.661164 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.661113    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"]
Oct 30 23:18:49.661164 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.661126    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54c94948b5-5fm4s"]
Oct 30 23:18:49.661164 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.661140    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6888fc6c96-6gdwr"]
Oct 30 23:18:49.661164 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.661156    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-z84cb"]
Oct 30 23:18:49.661456 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.661170    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cf56b4bd9-285cx"]
Oct 30 23:18:49.661456 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.661173    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fsbsg"
Oct 30 23:18:49.661456 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.661186    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"]
Oct 30 23:18:49.661456 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.661198    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-295nz"]
Oct 30 23:18:49.661456 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.661215    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qhkwj"]
Oct 30 23:18:49.661456 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.661233    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"]
Oct 30 23:18:49.661456 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.661255    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fsbsg"]
Oct 30 23:18:49.689877 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.689858    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 23:18:49.689979 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.689965    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 23:18:49.690040 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.690004    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 23:18:49.690096 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.690090    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 23:18:49.690142 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.690097    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 23:18:49.690142 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.690098    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 23:18:49.690236 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.690193    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 23:18:49.690236 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.690207    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 23:18:49.690314 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.690244    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 23:18:49.690314 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.690270    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 23:18:49.690400 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.690325    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 23:18:49.690400 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.690325    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 23:18:49.690400 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.690357    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 23:18:49.690499 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.690415    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 23:18:49.690696 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.690680    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 23:18:49.690764 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.690699    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 23:18:49.690764 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.690708    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 23:18:49.690764 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.690710    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 23:18:49.690764 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.690711    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 23:18:49.690764 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.690733    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 23:18:49.690986 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.690967    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 23:18:49.691384 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.691365    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 23:18:49.691464 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.691372    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 23:18:49.691464 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.691373    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 23:18:49.691793 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.691778    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 23:18:49.692010 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.691951    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 23:18:49.692103 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.692032    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 23:18:49.692676 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.692659    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 23:18:49.695356 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.695341    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 23:18:49.701692 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.701673    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 23:18:49.702261 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.702236    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-gskv9\""
Oct 30 23:18:49.702737 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.702716    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gddrl\""
Oct 30 23:18:49.703120 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.703098    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 23:18:49.703210 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.703186    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 23:18:49.703268 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.703253    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 23:18:49.703400 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.703308    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 23:18:49.703400 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.703370    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 23:18:49.703500 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.703485    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 23:18:49.703564 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.703504    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 23:18:49.703697 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.703675    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 23:18:49.703804 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.703790    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 23:18:49.703924 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.703907    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 23:18:49.704004 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.703908    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 23:18:49.704418 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.704399    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 23:18:49.704499 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.704493    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 23:18:49.705340 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.705323    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 23:18:49.705461 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.705339    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 23:18:49.705461 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.705371    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 23:18:49.706518 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.706503    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zcrv2\""
Oct 30 23:18:49.752844 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.752818    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-certificates\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.752961 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.752862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9a4c974-1f79-40b2-9f49-427170c8764b-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.752961 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.752880    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.752961 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.752933    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dc691df1-3f27-4829-955d-99b66893279d-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:18:49.753141 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.752987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ba7c1ba-4162-430e-b267-ebf3f9844750-tmp-dir\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:18:49.753141 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753028    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-trusted-ca\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:18:49.753141 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753050    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb5e9511-9532-4de4-9f4c-5e034cca2773-serving-cert\") pod \"service-ca-operator-544d749c8c-7m2nz\" (UID: \"bb5e9511-9532-4de4-9f4c-5e034cca2773\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"
Oct 30 23:18:49.753141 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753067    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxnxf\" (UniqueName: \"kubernetes.io/projected/bb5e9511-9532-4de4-9f4c-5e034cca2773-kube-api-access-kxnxf\") pod \"service-ca-operator-544d749c8c-7m2nz\" (UID: \"bb5e9511-9532-4de4-9f4c-5e034cca2773\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"
Oct 30 23:18:49.753141 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753088    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-default-certificate\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:49.753141 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753103    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9\" (UID: \"ef3b49c5-63b0-4be5-8198-589cc7bc1ce6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"
Oct 30 23:18:49.753437 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753164    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.753437 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753197    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:18:49.753437 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753216    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1846d39-a52a-442d-8216-10f0798dbc36-cert\") pod \"ingress-canary-fsbsg\" (UID: \"b1846d39-a52a-442d-8216-10f0798dbc36\") " pod="openshift-ingress-canary/ingress-canary-fsbsg"
Oct 30 23:18:49.753437 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753243    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:49.753437 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753299    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-trusted-ca\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.753437 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753348    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-certificates\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.753437 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753378    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-bound-sa-token\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.753437 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753399    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzfpp\" (UniqueName: \"kubernetes.io/projected/5ba7c1ba-4162-430e-b267-ebf3f9844750-kube-api-access-tzfpp\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:18:49.753437 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753413    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g47ks\" (UniqueName: \"kubernetes.io/projected/d3c8853f-5927-4411-b293-0030e7f43312-kube-api-access-g47ks\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:18:49.753718 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753461    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-trusted-ca\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.753718 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753488    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmdlw\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-kube-api-access-hmdlw\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.753718 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753510    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm2kg\" (UniqueName: \"kubernetes.io/projected/1cfc2d59-558a-4f8a-8f23-59fe4b78dd17-kube-api-access-gm2kg\") pod \"network-check-source-6f78d59f99-flrmm\" (UID: \"1cfc2d59-558a-4f8a-8f23-59fe4b78dd17\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-flrmm"
Oct 30 23:18:49.753718 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753536    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9rvq\" (UniqueName: \"kubernetes.io/projected/b1846d39-a52a-442d-8216-10f0798dbc36-kube-api-access-g9rvq\") pod \"ingress-canary-fsbsg\" (UID: \"b1846d39-a52a-442d-8216-10f0798dbc36\") " pod="openshift-ingress-canary/ingress-canary-fsbsg"
Oct 30 23:18:49.753718 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753570    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:18:49.753718 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753622    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p56mc\" (UniqueName: \"kubernetes.io/projected/67fa89c3-92f0-4ead-871a-45446e25aad5-kube-api-access-p56mc\") pod \"kas-connection-checker-685895c7c9-gpk5m\" (UID: \"67fa89c3-92f0-4ead-871a-45446e25aad5\") " pod="kube-system/kas-connection-checker-685895c7c9-gpk5m"
Oct 30 23:18:49.753718 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753654    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5qdd\" (UniqueName: \"kubernetes.io/projected/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6-kube-api-access-j5qdd\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9\" (UID: \"ef3b49c5-63b0-4be5-8198-589cc7bc1ce6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"
Oct 30 23:18:49.753718 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753677    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-serving-cert\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:18:49.753718 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753707    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-image-registry-private-configuration\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.753985 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753741    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz5d8\" (UniqueName: \"kubernetes.io/projected/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-kube-api-access-cz5d8\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:18:49.753985 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753774    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9\" (UID: \"ef3b49c5-63b0-4be5-8198-589cc7bc1ce6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"
Oct 30 23:18:49.753985 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753832    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb5e9511-9532-4de4-9f4c-5e034cca2773-config\") pod \"service-ca-operator-544d749c8c-7m2nz\" (UID: \"bb5e9511-9532-4de4-9f4c-5e034cca2773\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"
Oct 30 23:18:49.753985 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753863    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mrrm\" (UniqueName: \"kubernetes.io/projected/b3d1c4c4-03be-43ef-a2e4-bfc406dc7aca-kube-api-access-9mrrm\") pod \"volume-data-source-validator-58c9f5f46d-qhkwj\" (UID: \"b3d1c4c4-03be-43ef-a2e4-bfc406dc7aca\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qhkwj"
Oct 30 23:18:49.754110 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.753985    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7szx\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-kube-api-access-v7szx\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.754110 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754015    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9a4c974-1f79-40b2-9f49-427170c8764b-serving-cert\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.754110 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754075    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p2kb\" (UniqueName: \"kubernetes.io/projected/2074c06c-0759-4701-9a2d-48f024879fb2-kube-api-access-7p2kb\") pod \"kas-connection-checker-685895c7c9-hlltf\" (UID: \"2074c06c-0759-4701-9a2d-48f024879fb2\") " pod="kube-system/kas-connection-checker-685895c7c9-hlltf"
Oct 30 23:18:49.754110 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754092    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/84480344-bd78-4528-bfe4-29b67541a818-nginx-conf\") pod \"networking-console-plugin-86c478bb88-z84cb\" (UID: \"84480344-bd78-4528-bfe4-29b67541a818\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:18:49.754110 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754108    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:18:49.754266 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754140    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f9a4c974-1f79-40b2-9f49-427170c8764b-snapshots\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.754266 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754162    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9a4c974-1f79-40b2-9f49-427170c8764b-tmp\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.754266 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754219    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:18:49.754266 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754254    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b710ad88-e867-4ea3-a13b-394eb3d34c89-ca-trust-extracted\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.754422 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754290    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhcnh\" (UniqueName: \"kubernetes.io/projected/aa5373ec-3489-4bd2-80e0-ad75abead9e6-kube-api-access-hhcnh\") pod \"kas-connection-checker-685895c7c9-zlgnn\" (UID: \"aa5373ec-3489-4bd2-80e0-ad75abead9e6\") " pod="kube-system/kas-connection-checker-685895c7c9-zlgnn"
Oct 30 23:18:49.754422 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:49.754422 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754329    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2v4q\" (UniqueName: \"kubernetes.io/projected/dc691df1-3f27-4829-955d-99b66893279d-kube-api-access-t2v4q\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:18:49.754422 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754363    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-stats-auth\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:49.754422 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754383    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a73f11a7-b4de-43b4-83de-cc7a630d25c3-ca-trust-extracted\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.754574 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754443    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-config\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:18:49.754574 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq7m6\" (UniqueName: \"kubernetes.io/projected/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-kube-api-access-bq7m6\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:49.754574 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754498    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-installation-pull-secrets\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.754574 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754523    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-z84cb\" (UID: \"84480344-bd78-4528-bfe4-29b67541a818\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:18:49.754574 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754544    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9a4c974-1f79-40b2-9f49-427170c8764b-service-ca-bundle\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.754743 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754580    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-installation-pull-secrets\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.754743 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754623    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzp75\" (UniqueName: \"kubernetes.io/projected/f9a4c974-1f79-40b2-9f49-427170c8764b-kube-api-access-qzp75\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.754743 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754643    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-image-registry-private-configuration\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.754743 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754659    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-bound-sa-token\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.754743 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.754674    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ba7c1ba-4162-430e-b267-ebf3f9844750-config-volume\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:18:49.842041 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.842008    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:18:49.855538 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.855505    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb5e9511-9532-4de4-9f4c-5e034cca2773-config\") pod \"service-ca-operator-544d749c8c-7m2nz\" (UID: \"bb5e9511-9532-4de4-9f4c-5e034cca2773\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"
Oct 30 23:18:49.855675 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.855543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mrrm\" (UniqueName: \"kubernetes.io/projected/b3d1c4c4-03be-43ef-a2e4-bfc406dc7aca-kube-api-access-9mrrm\") pod \"volume-data-source-validator-58c9f5f46d-qhkwj\" (UID: \"b3d1c4c4-03be-43ef-a2e4-bfc406dc7aca\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qhkwj"
Oct 30 23:18:49.855675 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.855571    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7szx\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-kube-api-access-v7szx\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.855867 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.855844    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9a4c974-1f79-40b2-9f49-427170c8764b-serving-cert\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.855921 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.855899    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2kb\" (UniqueName: \"kubernetes.io/projected/2074c06c-0759-4701-9a2d-48f024879fb2-kube-api-access-7p2kb\") pod \"kas-connection-checker-685895c7c9-hlltf\" (UID: \"2074c06c-0759-4701-9a2d-48f024879fb2\") " pod="kube-system/kas-connection-checker-685895c7c9-hlltf"
Oct 30 23:18:49.855961 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.855930    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/84480344-bd78-4528-bfe4-29b67541a818-nginx-conf\") pod \"networking-console-plugin-86c478bb88-z84cb\" (UID: \"84480344-bd78-4528-bfe4-29b67541a818\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:18:49.855961 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.855952    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:18:49.856036 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.855966    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f9a4c974-1f79-40b2-9f49-427170c8764b-snapshots\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.856036 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.855980    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9a4c974-1f79-40b2-9f49-427170c8764b-tmp\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.856036 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856005    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:18:49.856036 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856032    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b710ad88-e867-4ea3-a13b-394eb3d34c89-ca-trust-extracted\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.856226 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856057    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhcnh\" (UniqueName: \"kubernetes.io/projected/aa5373ec-3489-4bd2-80e0-ad75abead9e6-kube-api-access-hhcnh\") pod \"kas-connection-checker-685895c7c9-zlgnn\" (UID: \"aa5373ec-3489-4bd2-80e0-ad75abead9e6\") " pod="kube-system/kas-connection-checker-685895c7c9-zlgnn"
Oct 30 23:18:49.856226 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:49.856075    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 23:18:49.856226 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856079    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:49.856226 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856103    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2v4q\" (UniqueName: \"kubernetes.io/projected/dc691df1-3f27-4829-955d-99b66893279d-kube-api-access-t2v4q\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:18:49.856226 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:49.856134    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls podName:d3c8853f-5927-4411-b293-0030e7f43312 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:50.356113965 +0000 UTC m=+30.635364211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-rrnzh" (UID: "d3c8853f-5927-4411-b293-0030e7f43312") : secret "samples-operator-tls" not found
Oct 30 23:18:49.856226 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856154    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-stats-auth\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:49.856226 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856185    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a73f11a7-b4de-43b4-83de-cc7a630d25c3-ca-trust-extracted\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.856226 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856210    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-config\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:18:49.856498 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856235    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq7m6\" (UniqueName: \"kubernetes.io/projected/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-kube-api-access-bq7m6\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:49.856498 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856265    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-installation-pull-secrets\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.856498 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:49.856280    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 23:18:49.856498 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856306    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-z84cb\" (UID: \"84480344-bd78-4528-bfe4-29b67541a818\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:18:49.856498 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:49.856336    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls podName:dc691df1-3f27-4829-955d-99b66893279d nodeName:}" failed. No retries permitted until 2026-10-30 23:18:50.356319141 +0000 UTC m=+30.635569387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-2w6gp" (UID: "dc691df1-3f27-4829-955d-99b66893279d") : secret "cluster-monitoring-operator-tls" not found
Oct 30 23:18:49.856498 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856359    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9a4c974-1f79-40b2-9f49-427170c8764b-service-ca-bundle\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.856498 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:49.856382    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 23:18:49.856498 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856391    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-installation-pull-secrets\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.856498 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856400    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb5e9511-9532-4de4-9f4c-5e034cca2773-config\") pod \"service-ca-operator-544d749c8c-7m2nz\" (UID: \"bb5e9511-9532-4de4-9f4c-5e034cca2773\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"
Oct 30 23:18:49.856498 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:49.856422    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert podName:84480344-bd78-4528-bfe4-29b67541a818 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:50.356409039 +0000 UTC m=+30.635659287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-z84cb" (UID: "84480344-bd78-4528-bfe4-29b67541a818") : secret "networking-console-plugin-cert" not found
Oct 30 23:18:49.856498 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856440    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzp75\" (UniqueName: \"kubernetes.io/projected/f9a4c974-1f79-40b2-9f49-427170c8764b-kube-api-access-qzp75\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.856498 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:49.856460    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 23:18:49.856498 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-image-registry-private-configuration\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.856498 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:49.856504    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs podName:f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b nodeName:}" failed. No retries permitted until 2026-10-30 23:18:50.356493856 +0000 UTC m=+30.635744102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs") pod "router-default-54c94948b5-5fm4s" (UID: "f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b") : secret "router-metrics-certs-default" not found
Oct 30 23:18:49.857126 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856521    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-bound-sa-token\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.857126 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ba7c1ba-4162-430e-b267-ebf3f9844750-config-volume\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:18:49.857126 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856578    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-certificates\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.857126 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856645    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9a4c974-1f79-40b2-9f49-427170c8764b-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.857126 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856665    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b710ad88-e867-4ea3-a13b-394eb3d34c89-ca-trust-extracted\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.857126 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856671    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.857126 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856695    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dc691df1-3f27-4829-955d-99b66893279d-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:18:49.857126 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856722    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ba7c1ba-4162-430e-b267-ebf3f9844750-tmp-dir\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:18:49.857126 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856748    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-trusted-ca\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:18:49.857126 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856773    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb5e9511-9532-4de4-9f4c-5e034cca2773-serving-cert\") pod \"service-ca-operator-544d749c8c-7m2nz\" (UID: \"bb5e9511-9532-4de4-9f4c-5e034cca2773\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"
Oct 30 23:18:49.857126 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856801    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxnxf\" (UniqueName: \"kubernetes.io/projected/bb5e9511-9532-4de4-9f4c-5e034cca2773-kube-api-access-kxnxf\") pod \"service-ca-operator-544d749c8c-7m2nz\" (UID: \"bb5e9511-9532-4de4-9f4c-5e034cca2773\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"
Oct 30 23:18:49.857126 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856827    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-default-certificate\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:49.857126 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856851    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9\" (UID: \"ef3b49c5-63b0-4be5-8198-589cc7bc1ce6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"
Oct 30 23:18:49.857126 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856900    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.857126 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856923    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:18:49.857126 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856945    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1846d39-a52a-442d-8216-10f0798dbc36-cert\") pod \"ingress-canary-fsbsg\" (UID: \"b1846d39-a52a-442d-8216-10f0798dbc36\") " pod="openshift-ingress-canary/ingress-canary-fsbsg"
Oct 30 23:18:49.857884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856969    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:49.857884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.856995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-trusted-ca\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.857884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.857031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-certificates\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.857884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.857054    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-bound-sa-token\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.857884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.857083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzfpp\" (UniqueName: \"kubernetes.io/projected/5ba7c1ba-4162-430e-b267-ebf3f9844750-kube-api-access-tzfpp\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:18:49.857884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.857106    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g47ks\" (UniqueName: \"kubernetes.io/projected/d3c8853f-5927-4411-b293-0030e7f43312-kube-api-access-g47ks\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:18:49.857884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.857143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-trusted-ca\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.857884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.857166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmdlw\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-kube-api-access-hmdlw\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.857884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.857187    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm2kg\" (UniqueName: \"kubernetes.io/projected/1cfc2d59-558a-4f8a-8f23-59fe4b78dd17-kube-api-access-gm2kg\") pod \"network-check-source-6f78d59f99-flrmm\" (UID: \"1cfc2d59-558a-4f8a-8f23-59fe4b78dd17\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-flrmm"
Oct 30 23:18:49.857884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.857223    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9rvq\" (UniqueName: \"kubernetes.io/projected/b1846d39-a52a-442d-8216-10f0798dbc36-kube-api-access-g9rvq\") pod \"ingress-canary-fsbsg\" (UID: \"b1846d39-a52a-442d-8216-10f0798dbc36\") " pod="openshift-ingress-canary/ingress-canary-fsbsg"
Oct 30 23:18:49.857884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.857246    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:18:49.857884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.857261    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/84480344-bd78-4528-bfe4-29b67541a818-nginx-conf\") pod \"networking-console-plugin-86c478bb88-z84cb\" (UID: \"84480344-bd78-4528-bfe4-29b67541a818\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:18:49.857884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.857270    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p56mc\" (UniqueName: \"kubernetes.io/projected/67fa89c3-92f0-4ead-871a-45446e25aad5-kube-api-access-p56mc\") pod \"kas-connection-checker-685895c7c9-gpk5m\" (UID: \"67fa89c3-92f0-4ead-871a-45446e25aad5\") " pod="kube-system/kas-connection-checker-685895c7c9-gpk5m"
Oct 30 23:18:49.857884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.857310    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9a4c974-1f79-40b2-9f49-427170c8764b-service-ca-bundle\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.857884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.857324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5qdd\" (UniqueName: \"kubernetes.io/projected/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6-kube-api-access-j5qdd\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9\" (UID: \"ef3b49c5-63b0-4be5-8198-589cc7bc1ce6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"
Oct 30 23:18:49.857884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.857363    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-serving-cert\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:18:49.858633 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.857390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-image-registry-private-configuration\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.858633 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.857418    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz5d8\" (UniqueName: \"kubernetes.io/projected/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-kube-api-access-cz5d8\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:18:49.858633 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.857458    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9\" (UID: \"ef3b49c5-63b0-4be5-8198-589cc7bc1ce6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"
Oct 30 23:18:49.858633 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.857519    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9a4c974-1f79-40b2-9f49-427170c8764b-tmp\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.858633 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.857286    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-config\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:18:49.858633 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.858063    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-certificates\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.858633 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:49.858179    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle podName:f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b nodeName:}" failed. No retries permitted until 2026-10-30 23:18:50.358165126 +0000 UTC m=+30.637415388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle") pod "router-default-54c94948b5-5fm4s" (UID: "f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b") : configmap references non-existent config key: service-ca.crt
Oct 30 23:18:49.858633 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.858633    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f9a4c974-1f79-40b2-9f49-427170c8764b-snapshots\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.859191 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.858959    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dc691df1-3f27-4829-955d-99b66893279d-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:18:49.860931 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.859253    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ba7c1ba-4162-430e-b267-ebf3f9844750-tmp-dir\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:18:49.860931 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.859312    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a73f11a7-b4de-43b4-83de-cc7a630d25c3-ca-trust-extracted\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.860931 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.859382    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ba7c1ba-4162-430e-b267-ebf3f9844750-config-volume\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:18:49.860931 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.860016    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-trusted-ca\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:18:49.860931 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:49.860031    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 23:18:49.860931 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:49.860044    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6888fc6c96-6gdwr: secret "image-registry-tls" not found
Oct 30 23:18:49.860931 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:49.860094    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls podName:a73f11a7-b4de-43b4-83de-cc7a630d25c3 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:50.360079651 +0000 UTC m=+30.639329899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls") pod "image-registry-6888fc6c96-6gdwr" (UID: "a73f11a7-b4de-43b4-83de-cc7a630d25c3") : secret "image-registry-tls" not found
Oct 30 23:18:49.860931 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.860276    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-trusted-ca\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.860931 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.860303    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9a4c974-1f79-40b2-9f49-427170c8764b-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.861391 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.861314    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-certificates\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.862380 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.861554    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-trusted-ca\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.862380 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.861941    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9a4c974-1f79-40b2-9f49-427170c8764b-serving-cert\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.862380 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.862073    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb5e9511-9532-4de4-9f4c-5e034cca2773-serving-cert\") pod \"service-ca-operator-544d749c8c-7m2nz\" (UID: \"bb5e9511-9532-4de4-9f4c-5e034cca2773\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"
Oct 30 23:18:49.862380 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.862118    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-image-registry-private-configuration\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.862380 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:49.862149    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 23:18:49.862380 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:49.862223    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls podName:5ba7c1ba-4162-430e-b267-ebf3f9844750 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:50.362208842 +0000 UTC m=+30.641459089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls") pod "dns-default-295nz" (UID: "5ba7c1ba-4162-430e-b267-ebf3f9844750") : secret "dns-default-metrics-tls" not found
Oct 30 23:18:49.862380 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.862073    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-installation-pull-secrets\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.862380 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:49.862153    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 23:18:49.862380 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:49.862260    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cf56b4bd9-285cx: secret "image-registry-tls" not found
Oct 30 23:18:49.862380 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.862286    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-stats-auth\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:49.862380 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:49.862293    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls podName:b710ad88-e867-4ea3-a13b-394eb3d34c89 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:50.362282133 +0000 UTC m=+30.641532401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls") pod "image-registry-7cf56b4bd9-285cx" (UID: "b710ad88-e867-4ea3-a13b-394eb3d34c89") : secret "image-registry-tls" not found
Oct 30 23:18:49.862981 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.862705    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:18:49.863429 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.863408    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-serving-cert\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:18:49.863830 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.863807    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1846d39-a52a-442d-8216-10f0798dbc36-cert\") pod \"ingress-canary-fsbsg\" (UID: \"b1846d39-a52a-442d-8216-10f0798dbc36\") " pod="openshift-ingress-canary/ingress-canary-fsbsg"
Oct 30 23:18:49.865062 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.865019    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9\" (UID: \"ef3b49c5-63b0-4be5-8198-589cc7bc1ce6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"
Oct 30 23:18:49.865191 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.865133    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-installation-pull-secrets\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.865191 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.865158    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9\" (UID: \"ef3b49c5-63b0-4be5-8198-589cc7bc1ce6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"
Oct 30 23:18:49.865305 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.865273    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-image-registry-private-configuration\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.865305 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.865273    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-default-certificate\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:49.870044 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.869705    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2v4q\" (UniqueName: \"kubernetes.io/projected/dc691df1-3f27-4829-955d-99b66893279d-kube-api-access-t2v4q\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:18:49.870044 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.869941    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhcnh\" (UniqueName: \"kubernetes.io/projected/aa5373ec-3489-4bd2-80e0-ad75abead9e6-kube-api-access-hhcnh\") pod \"kas-connection-checker-685895c7c9-zlgnn\" (UID: \"aa5373ec-3489-4bd2-80e0-ad75abead9e6\") " pod="kube-system/kas-connection-checker-685895c7c9-zlgnn"
Oct 30 23:18:49.870044 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.869960    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mrrm\" (UniqueName: \"kubernetes.io/projected/b3d1c4c4-03be-43ef-a2e4-bfc406dc7aca-kube-api-access-9mrrm\") pod \"volume-data-source-validator-58c9f5f46d-qhkwj\" (UID: \"b3d1c4c4-03be-43ef-a2e4-bfc406dc7aca\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qhkwj"
Oct 30 23:18:49.870427 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.870052    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p2kb\" (UniqueName: \"kubernetes.io/projected/2074c06c-0759-4701-9a2d-48f024879fb2-kube-api-access-7p2kb\") pod \"kas-connection-checker-685895c7c9-hlltf\" (UID: \"2074c06c-0759-4701-9a2d-48f024879fb2\") " pod="kube-system/kas-connection-checker-685895c7c9-hlltf"
Oct 30 23:18:49.870427 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.870062    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7szx\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-kube-api-access-v7szx\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.871275 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.871253    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-bound-sa-token\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:49.872418 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.872395    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzp75\" (UniqueName: \"kubernetes.io/projected/f9a4c974-1f79-40b2-9f49-427170c8764b-kube-api-access-qzp75\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.873043 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.873023    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p56mc\" (UniqueName: \"kubernetes.io/projected/67fa89c3-92f0-4ead-871a-45446e25aad5-kube-api-access-p56mc\") pod \"kas-connection-checker-685895c7c9-gpk5m\" (UID: \"67fa89c3-92f0-4ead-871a-45446e25aad5\") " pod="kube-system/kas-connection-checker-685895c7c9-gpk5m"
Oct 30 23:18:49.878564 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.878544    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmdlw\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-kube-api-access-hmdlw\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.878788 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.878766    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz5d8\" (UniqueName: \"kubernetes.io/projected/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-kube-api-access-cz5d8\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:18:49.879042 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.879027    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-bound-sa-token\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:49.882454 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.882430    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxnxf\" (UniqueName: \"kubernetes.io/projected/bb5e9511-9532-4de4-9f4c-5e034cca2773-kube-api-access-kxnxf\") pod \"service-ca-operator-544d749c8c-7m2nz\" (UID: \"bb5e9511-9532-4de4-9f4c-5e034cca2773\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"
Oct 30 23:18:49.882546 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.882530    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g47ks\" (UniqueName: \"kubernetes.io/projected/d3c8853f-5927-4411-b293-0030e7f43312-kube-api-access-g47ks\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:18:49.883033 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.883012    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzfpp\" (UniqueName: \"kubernetes.io/projected/5ba7c1ba-4162-430e-b267-ebf3f9844750-kube-api-access-tzfpp\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:18:49.883130 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.883116    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9rvq\" (UniqueName: \"kubernetes.io/projected/b1846d39-a52a-442d-8216-10f0798dbc36-kube-api-access-g9rvq\") pod \"ingress-canary-fsbsg\" (UID: \"b1846d39-a52a-442d-8216-10f0798dbc36\") " pod="openshift-ingress-canary/ingress-canary-fsbsg"
Oct 30 23:18:49.883172 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.883143    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm2kg\" (UniqueName: \"kubernetes.io/projected/1cfc2d59-558a-4f8a-8f23-59fe4b78dd17-kube-api-access-gm2kg\") pod \"network-check-source-6f78d59f99-flrmm\" (UID: \"1cfc2d59-558a-4f8a-8f23-59fe4b78dd17\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-flrmm"
Oct 30 23:18:49.883172 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.883146    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq7m6\" (UniqueName: \"kubernetes.io/projected/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-kube-api-access-bq7m6\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:49.883446 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.883424    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5qdd\" (UniqueName: \"kubernetes.io/projected/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6-kube-api-access-j5qdd\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9\" (UID: \"ef3b49c5-63b0-4be5-8198-589cc7bc1ce6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"
Oct 30 23:18:49.900038 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.900022    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-gpk5m"
Oct 30 23:18:49.908999 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.908981    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-hlltf"
Oct 30 23:18:49.946980 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.946887    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-zlgnn"
Oct 30 23:18:49.956890 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.956698    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"
Oct 30 23:18:49.960306 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.960288    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"
Oct 30 23:18:49.983571 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.982732    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qhkwj"
Oct 30 23:18:49.986736 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.985246    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:18:49.995713 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:49.992850    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:18:50.015722 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.015694    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-flrmm"
Oct 30 23:18:50.031082 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.030736    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fsbsg"
Oct 30 23:18:50.039007 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.038910    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:18:50.175470 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.175446    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:18:50.180766 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.180742    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:50.181941 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.181180    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:50.181941 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.181488    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:50.192535 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.192521    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 23:18:50.192731 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.192711    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-2nz9z\""
Oct 30 23:18:50.192808 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.192767    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-9tmfn\""
Oct 30 23:18:50.192856 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.192847    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 23:18:50.192933 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.192916    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-djdr2\""
Oct 30 23:18:50.216045 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.215989    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-hlltf"]
Oct 30 23:18:50.219275 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:50.219253    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2074c06c_0759_4701_9a2d_48f024879fb2.slice/crio-265726a449123c1007f6111f0187069ff4ba5e419c3797f1230931a64c1f483f WatchSource:0}: Error finding container 265726a449123c1007f6111f0187069ff4ba5e419c3797f1230931a64c1f483f: Status 404 returned error can't find the container with id 265726a449123c1007f6111f0187069ff4ba5e419c3797f1230931a64c1f483f
Oct 30 23:18:50.224329 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.224308    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-gpk5m"]
Oct 30 23:18:50.227420 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:50.227400    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67fa89c3_92f0_4ead_871a_45446e25aad5.slice/crio-46a3ab18ff88bca35356591220f065d38e9fc5c3db97add10d8979cf199da26e WatchSource:0}: Error finding container 46a3ab18ff88bca35356591220f065d38e9fc5c3db97add10d8979cf199da26e: Status 404 returned error can't find the container with id 46a3ab18ff88bca35356591220f065d38e9fc5c3db97add10d8979cf199da26e
Oct 30 23:18:50.231977 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:50.231961    2577 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/systemd-update-utmp-runlevel.service\": RecentStats: unable to find data in memory cache]"
Oct 30 23:18:50.261430 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.261413    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-zlgnn"]
Oct 30 23:18:50.265575 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.265555    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"]
Oct 30 23:18:50.266023 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:50.265998    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa5373ec_3489_4bd2_80e0_ad75abead9e6.slice/crio-465a8aaae3501fb41ec0b94440bd0cca1036817707c4468cc45cfd97f0d3e60e WatchSource:0}: Error finding container 465a8aaae3501fb41ec0b94440bd0cca1036817707c4468cc45cfd97f0d3e60e: Status 404 returned error can't find the container with id 465a8aaae3501fb41ec0b94440bd0cca1036817707c4468cc45cfd97f0d3e60e
Oct 30 23:18:50.268197 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:50.268177    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef3b49c5_63b0_4be5_8198_589cc7bc1ce6.slice/crio-2f98509d2c5ffce944506e79c6084c198cc9914cbcfd7f12cf2eaf7d758d7c41 WatchSource:0}: Error finding container 2f98509d2c5ffce944506e79c6084c198cc9914cbcfd7f12cf2eaf7d758d7c41: Status 404 returned error can't find the container with id 2f98509d2c5ffce944506e79c6084c198cc9914cbcfd7f12cf2eaf7d758d7c41
Oct 30 23:18:50.298811 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.298786    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"]
Oct 30 23:18:50.301199 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:50.301170    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5e9511_9532_4de4_9f4c_5e034cca2773.slice/crio-438e2fc7da1da7391df2574b5d6dfa2a435cf526c1d2ef9788929819760863d4 WatchSource:0}: Error finding container 438e2fc7da1da7391df2574b5d6dfa2a435cf526c1d2ef9788929819760863d4: Status 404 returned error can't find the container with id 438e2fc7da1da7391df2574b5d6dfa2a435cf526c1d2ef9788929819760863d4
Oct 30 23:18:50.304510 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.304490    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qhkwj"]
Oct 30 23:18:50.308222 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.308200    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:18:50.309211 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:50.309189    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3d1c4c4_03be_43ef_a2e4_bfc406dc7aca.slice/crio-77e593a89bbeb1013ba6739b91b273c7ca92065617d266d9dd794631c40eb116 WatchSource:0}: Error finding container 77e593a89bbeb1013ba6739b91b273c7ca92065617d266d9dd794631c40eb116: Status 404 returned error can't find the container with id 77e593a89bbeb1013ba6739b91b273c7ca92065617d266d9dd794631c40eb116
Oct 30 23:18:50.348667 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.347530    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-qs244"]
Oct 30 23:18:50.352438 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:50.352399    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3536b8b5_e6a8_48c5_8319_8d75a7f4abd8.slice/crio-d9775b0ac6cce8d3f0355b410044de28020bc4780b4c13536a36ed4d913ea581 WatchSource:0}: Error finding container d9775b0ac6cce8d3f0355b410044de28020bc4780b4c13536a36ed4d913ea581: Status 404 returned error can't find the container with id d9775b0ac6cce8d3f0355b410044de28020bc4780b4c13536a36ed4d913ea581
Oct 30 23:18:50.361061 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.361029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:50.361190 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.361168    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:18:50.361261 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.361210    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:18:50.361261 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.361239    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:50.361367 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.361280    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-z84cb\" (UID: \"84480344-bd78-4528-bfe4-29b67541a818\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:18:50.361367 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.361340    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:50.361487 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:50.361472    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 23:18:50.361540 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:50.361491    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6888fc6c96-6gdwr: secret "image-registry-tls" not found
Oct 30 23:18:50.361669 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:50.361540    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls podName:a73f11a7-b4de-43b4-83de-cc7a630d25c3 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:51.361523711 +0000 UTC m=+31.640773957 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls") pod "image-registry-6888fc6c96-6gdwr" (UID: "a73f11a7-b4de-43b4-83de-cc7a630d25c3") : secret "image-registry-tls" not found
Oct 30 23:18:50.361669 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:50.361659    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle podName:f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b nodeName:}" failed. No retries permitted until 2026-10-30 23:18:51.361647985 +0000 UTC m=+31.640898228 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle") pod "router-default-54c94948b5-5fm4s" (UID: "f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b") : configmap references non-existent config key: service-ca.crt
Oct 30 23:18:50.362049 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:50.362024    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 23:18:50.362118 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:50.362093    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert podName:84480344-bd78-4528-bfe4-29b67541a818 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:51.362077121 +0000 UTC m=+31.641327350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-z84cb" (UID: "84480344-bd78-4528-bfe4-29b67541a818") : secret "networking-console-plugin-cert" not found
Oct 30 23:18:50.362207 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:50.362184    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 23:18:50.362406 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:50.362245    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 23:18:50.362456 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:50.362268    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 23:18:50.362499 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:50.362484    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls podName:dc691df1-3f27-4829-955d-99b66893279d nodeName:}" failed. No retries permitted until 2026-10-30 23:18:51.362348703 +0000 UTC m=+31.641598944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-2w6gp" (UID: "dc691df1-3f27-4829-955d-99b66893279d") : secret "cluster-monitoring-operator-tls" not found
Oct 30 23:18:50.362550 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:50.362507    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls podName:d3c8853f-5927-4411-b293-0030e7f43312 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:51.362493399 +0000 UTC m=+31.641743646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-rrnzh" (UID: "d3c8853f-5927-4411-b293-0030e7f43312") : secret "samples-operator-tls" not found
Oct 30 23:18:50.362631 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:50.362522    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs podName:f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b nodeName:}" failed. No retries permitted until 2026-10-30 23:18:51.362512784 +0000 UTC m=+31.641763013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs") pod "router-default-54c94948b5-5fm4s" (UID: "f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b") : secret "router-metrics-certs-default" not found
Oct 30 23:18:50.393284 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.388708    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-qdr5f"]
Oct 30 23:18:50.401738 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.401330    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-flrmm"]
Oct 30 23:18:50.403926 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.403542    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fsbsg"]
Oct 30 23:18:50.409934 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:50.409758    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cfc2d59_558a_4f8a_8f23_59fe4b78dd17.slice/crio-54a2f1eeec5a024e21ab7d75b23f95d8bf050669fbf984aeca448dd7385434c5 WatchSource:0}: Error finding container 54a2f1eeec5a024e21ab7d75b23f95d8bf050669fbf984aeca448dd7385434c5: Status 404 returned error can't find the container with id 54a2f1eeec5a024e21ab7d75b23f95d8bf050669fbf984aeca448dd7385434c5
Oct 30 23:18:50.410106 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:50.410083    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1846d39_a52a_442d_8216_10f0798dbc36.slice/crio-75f808bfea551f6dba711257acdfb614cbcb3d476ffb07a72e35555a7a6a35df WatchSource:0}: Error finding container 75f808bfea551f6dba711257acdfb614cbcb3d476ffb07a72e35555a7a6a35df: Status 404 returned error can't find the container with id 75f808bfea551f6dba711257acdfb614cbcb3d476ffb07a72e35555a7a6a35df
Oct 30 23:18:50.437378 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.437351    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:18:50.452332 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.451910    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9" event={"ID":"ef3b49c5-63b0-4be5-8198-589cc7bc1ce6","Type":"ContainerStarted","Data":"2f98509d2c5ffce944506e79c6084c198cc9914cbcfd7f12cf2eaf7d758d7c41"}
Oct 30 23:18:50.454137 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.453968    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fsbsg" event={"ID":"b1846d39-a52a-442d-8216-10f0798dbc36","Type":"ContainerStarted","Data":"75f808bfea551f6dba711257acdfb614cbcb3d476ffb07a72e35555a7a6a35df"}
Oct 30 23:18:50.455238 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.455182    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-qdr5f" event={"ID":"f9a4c974-1f79-40b2-9f49-427170c8764b","Type":"ContainerStarted","Data":"11f4b7233fc31d031b117f6d34fde2707abff54bc266540ef6b6204aab996ca7"}
Oct 30 23:18:50.456373 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.456322    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-zlgnn" event={"ID":"aa5373ec-3489-4bd2-80e0-ad75abead9e6","Type":"ContainerStarted","Data":"465a8aaae3501fb41ec0b94440bd0cca1036817707c4468cc45cfd97f0d3e60e"}
Oct 30 23:18:50.457753 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.457715    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz" event={"ID":"bb5e9511-9532-4de4-9f4c-5e034cca2773","Type":"ContainerStarted","Data":"438e2fc7da1da7391df2574b5d6dfa2a435cf526c1d2ef9788929819760863d4"}
Oct 30 23:18:50.458830 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.458635    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-hlltf" event={"ID":"2074c06c-0759-4701-9a2d-48f024879fb2","Type":"ContainerStarted","Data":"265726a449123c1007f6111f0187069ff4ba5e419c3797f1230931a64c1f483f"}
Oct 30 23:18:50.459482 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.459465    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-gpk5m" event={"ID":"67fa89c3-92f0-4ead-871a-45446e25aad5","Type":"ContainerStarted","Data":"46a3ab18ff88bca35356591220f065d38e9fc5c3db97add10d8979cf199da26e"}
Oct 30 23:18:50.460517 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.460498    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-flrmm" event={"ID":"1cfc2d59-558a-4f8a-8f23-59fe4b78dd17","Type":"ContainerStarted","Data":"54a2f1eeec5a024e21ab7d75b23f95d8bf050669fbf984aeca448dd7385434c5"}
Oct 30 23:18:50.461920 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.461900    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:50.461983 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.461928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:18:50.462055 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:50.462044    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 23:18:50.462094 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:50.462085    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls podName:5ba7c1ba-4162-430e-b267-ebf3f9844750 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:51.462074222 +0000 UTC m=+31.741324465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls") pod "dns-default-295nz" (UID: "5ba7c1ba-4162-430e-b267-ebf3f9844750") : secret "dns-default-metrics-tls" not found
Oct 30 23:18:50.462346 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:50.462334    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 23:18:50.462389 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:50.462349    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cf56b4bd9-285cx: secret "image-registry-tls" not found
Oct 30 23:18:50.462389 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:50.462378    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls podName:b710ad88-e867-4ea3-a13b-394eb3d34c89 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:51.462368976 +0000 UTC m=+31.741619217 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls") pod "image-registry-7cf56b4bd9-285cx" (UID: "b710ad88-e867-4ea3-a13b-394eb3d34c89") : secret "image-registry-tls" not found
Oct 30 23:18:50.462751 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.462734    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244" event={"ID":"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8","Type":"ContainerStarted","Data":"d9775b0ac6cce8d3f0355b410044de28020bc4780b4c13536a36ed4d913ea581"}
Oct 30 23:18:50.463786 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.463770    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qhkwj" event={"ID":"b3d1c4c4-03be-43ef-a2e4-bfc406dc7aca","Type":"ContainerStarted","Data":"77e593a89bbeb1013ba6739b91b273c7ca92065617d266d9dd794631c40eb116"}
Oct 30 23:18:50.832958 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.832870    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:18:50.963711 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:50.963678    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:18:51.372691 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:51.372654    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:18:51.372884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:51.372702    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:18:51.372884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:51.372726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:51.372884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:51.372754    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-z84cb\" (UID: \"84480344-bd78-4528-bfe4-29b67541a818\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:18:51.372884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:51.372814    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:51.372884 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:51.372871    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:51.373151 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:51.373141    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle podName:f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b nodeName:}" failed. No retries permitted until 2026-10-30 23:18:53.373125515 +0000 UTC m=+33.652375757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle") pod "router-default-54c94948b5-5fm4s" (UID: "f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b") : configmap references non-existent config key: service-ca.crt
Oct 30 23:18:51.374119 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:51.373580    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 23:18:51.374119 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:51.373649    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls podName:d3c8853f-5927-4411-b293-0030e7f43312 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:53.373634546 +0000 UTC m=+33.652884790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-rrnzh" (UID: "d3c8853f-5927-4411-b293-0030e7f43312") : secret "samples-operator-tls" not found
Oct 30 23:18:51.374119 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:51.373735    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 23:18:51.374119 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:51.373764    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls podName:dc691df1-3f27-4829-955d-99b66893279d nodeName:}" failed. No retries permitted until 2026-10-30 23:18:53.373755231 +0000 UTC m=+33.653005473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-2w6gp" (UID: "dc691df1-3f27-4829-955d-99b66893279d") : secret "cluster-monitoring-operator-tls" not found
Oct 30 23:18:51.374119 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:51.373845    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 23:18:51.374119 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:51.373872    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs podName:f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b nodeName:}" failed. No retries permitted until 2026-10-30 23:18:53.373862848 +0000 UTC m=+33.653113089 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs") pod "router-default-54c94948b5-5fm4s" (UID: "f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b") : secret "router-metrics-certs-default" not found
Oct 30 23:18:51.374119 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:51.373927    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 23:18:51.374119 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:51.373951    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert podName:84480344-bd78-4528-bfe4-29b67541a818 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:53.373944084 +0000 UTC m=+33.653194326 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-z84cb" (UID: "84480344-bd78-4528-bfe4-29b67541a818") : secret "networking-console-plugin-cert" not found
Oct 30 23:18:51.374119 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:51.373996    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 23:18:51.374119 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:51.374004    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6888fc6c96-6gdwr: secret "image-registry-tls" not found
Oct 30 23:18:51.374119 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:51.374022    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls podName:a73f11a7-b4de-43b4-83de-cc7a630d25c3 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:53.374017137 +0000 UTC m=+33.653267379 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls") pod "image-registry-6888fc6c96-6gdwr" (UID: "a73f11a7-b4de-43b4-83de-cc7a630d25c3") : secret "image-registry-tls" not found
Oct 30 23:18:51.474876 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:51.473739    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:51.474876 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:51.473778    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:18:51.474876 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:51.473985    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 23:18:51.474876 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:51.474143    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls podName:5ba7c1ba-4162-430e-b267-ebf3f9844750 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:53.474123906 +0000 UTC m=+33.753374152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls") pod "dns-default-295nz" (UID: "5ba7c1ba-4162-430e-b267-ebf3f9844750") : secret "dns-default-metrics-tls" not found
Oct 30 23:18:51.474876 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:51.474335    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 23:18:51.474876 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:51.474348    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cf56b4bd9-285cx: secret "image-registry-tls" not found
Oct 30 23:18:51.474876 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:51.474385    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls podName:b710ad88-e867-4ea3-a13b-394eb3d34c89 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:53.474373752 +0000 UTC m=+33.753623995 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls") pod "image-registry-7cf56b4bd9-285cx" (UID: "b710ad88-e867-4ea3-a13b-394eb3d34c89") : secret "image-registry-tls" not found
Oct 30 23:18:51.477917 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:51.477068    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-zlgnn" event={"ID":"aa5373ec-3489-4bd2-80e0-ad75abead9e6","Type":"ContainerStarted","Data":"e6c271a965809183429381d6bad5cd9a0e25ea885ff61d449574e0bf58379307"}
Oct 30 23:18:51.486399 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:51.486376    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-hlltf" event={"ID":"2074c06c-0759-4701-9a2d-48f024879fb2","Type":"ContainerStarted","Data":"56da97d49909b562c471303e1071c37a60ce77058858f2e82905caae9a2ab519"}
Oct 30 23:18:51.492577 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:51.492550    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-gpk5m" event={"ID":"67fa89c3-92f0-4ead-871a-45446e25aad5","Type":"ContainerStarted","Data":"a98abcee22d40290d57f6ab79c2645694a095a7a6d2cecdd4db5b7a8989310a3"}
Oct 30 23:18:51.515264 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:51.514338    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-zlgnn" podStartSLOduration=422.514321137 podStartE2EDuration="7m2.514321137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:11:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:51.496939579 +0000 UTC m=+31.776189830" watchObservedRunningTime="2026-10-30 23:18:51.514321137 +0000 UTC m=+31.793571391"
Oct 30 23:18:51.536293 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:51.536239    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-gpk5m" podStartSLOduration=422.536222119 podStartE2EDuration="7m2.536222119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:11:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:51.515484703 +0000 UTC m=+31.794734957" watchObservedRunningTime="2026-10-30 23:18:51.536222119 +0000 UTC m=+31.815472372"
Oct 30 23:18:53.403198 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:53.403155    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:53.403814 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:53.403259    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:53.403814 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:53.403356    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:18:53.403814 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:53.403376    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 23:18:53.403814 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:53.403391    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:18:53.403814 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:53.403400    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6888fc6c96-6gdwr: secret "image-registry-tls" not found
Oct 30 23:18:53.403814 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:53.403418    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:53.403814 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:53.403469    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls podName:a73f11a7-b4de-43b4-83de-cc7a630d25c3 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:57.403446989 +0000 UTC m=+37.682697235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls") pod "image-registry-6888fc6c96-6gdwr" (UID: "a73f11a7-b4de-43b4-83de-cc7a630d25c3") : secret "image-registry-tls" not found
Oct 30 23:18:53.403814 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:53.403498    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-z84cb\" (UID: \"84480344-bd78-4528-bfe4-29b67541a818\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:18:53.403814 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:53.403544    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 23:18:53.403814 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:53.403613    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs podName:f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b nodeName:}" failed. No retries permitted until 2026-10-30 23:18:57.403580282 +0000 UTC m=+37.682830525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs") pod "router-default-54c94948b5-5fm4s" (UID: "f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b") : secret "router-metrics-certs-default" not found
Oct 30 23:18:53.403814 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:53.403668    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 23:18:53.403814 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:53.403692    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls podName:d3c8853f-5927-4411-b293-0030e7f43312 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:57.40368574 +0000 UTC m=+37.682935993 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-rrnzh" (UID: "d3c8853f-5927-4411-b293-0030e7f43312") : secret "samples-operator-tls" not found
Oct 30 23:18:53.403814 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:53.403695    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 23:18:53.403814 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:53.403727    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 23:18:53.403814 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:53.403741    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert podName:84480344-bd78-4528-bfe4-29b67541a818 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:57.403727636 +0000 UTC m=+37.682977890 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-z84cb" (UID: "84480344-bd78-4528-bfe4-29b67541a818") : secret "networking-console-plugin-cert" not found
Oct 30 23:18:53.404573 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:53.403753    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls podName:dc691df1-3f27-4829-955d-99b66893279d nodeName:}" failed. No retries permitted until 2026-10-30 23:18:57.40374737 +0000 UTC m=+37.682997640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-2w6gp" (UID: "dc691df1-3f27-4829-955d-99b66893279d") : secret "cluster-monitoring-operator-tls" not found
Oct 30 23:18:53.404573 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:53.403799    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle podName:f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b nodeName:}" failed. No retries permitted until 2026-10-30 23:18:57.403789907 +0000 UTC m=+37.683040176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle") pod "router-default-54c94948b5-5fm4s" (UID: "f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b") : configmap references non-existent config key: service-ca.crt
Oct 30 23:18:53.502990 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:53.502138    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qhkwj" event={"ID":"b3d1c4c4-03be-43ef-a2e4-bfc406dc7aca","Type":"ContainerStarted","Data":"ac44a7221de7b7144bf9ab3eb3b22211fd20f2cec5b86badd9b6529c3f046213"}
Oct 30 23:18:53.505669 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:53.504797    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:18:53.505669 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:53.505007    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:53.505669 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:53.505124    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 23:18:53.505669 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:53.505138    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cf56b4bd9-285cx: secret "image-registry-tls" not found
Oct 30 23:18:53.505669 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:53.505192    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls podName:b710ad88-e867-4ea3-a13b-394eb3d34c89 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:57.505174468 +0000 UTC m=+37.784424712 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls") pod "image-registry-7cf56b4bd9-285cx" (UID: "b710ad88-e867-4ea3-a13b-394eb3d34c89") : secret "image-registry-tls" not found
Oct 30 23:18:53.505669 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:53.505528    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 23:18:53.505669 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:53.505582    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls podName:5ba7c1ba-4162-430e-b267-ebf3f9844750 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:57.505557374 +0000 UTC m=+37.784807617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls") pod "dns-default-295nz" (UID: "5ba7c1ba-4162-430e-b267-ebf3f9844750") : secret "dns-default-metrics-tls" not found
Oct 30 23:18:53.521365 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:53.521312    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qhkwj" podStartSLOduration=395.055320102 podStartE2EDuration="6m37.521296347s" totalImagesPullingTime="2.465976245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:12:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:53.519584302 +0000 UTC m=+33.798834554" watchObservedRunningTime="2026-10-30 23:18:53.521296347 +0000 UTC m=+33.800546599"
Oct 30 23:18:53.521720 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:53.521686    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-hlltf" podStartSLOduration=424.52167489 podStartE2EDuration="7m4.52167489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:11:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:51.536625826 +0000 UTC m=+31.815876074" watchObservedRunningTime="2026-10-30 23:18:53.52167489 +0000 UTC m=+33.800925144"
Oct 30 23:18:53.676812 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:53.676726    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:18:53.809744 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:53.809705    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:18:53.909730 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:53.909699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs\") pod \"network-metrics-daemon-bcpxq\" (UID: \"23c01b5c-af64-4567-9350-41572e762182\") " pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:18:53.909909 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:53.909864    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 23:18:53.909957 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:53.909926    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs podName:23c01b5c-af64-4567-9350-41572e762182 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:25.909911384 +0000 UTC m=+66.189161627 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs") pod "network-metrics-daemon-bcpxq" (UID: "23c01b5c-af64-4567-9350-41572e762182") : secret "metrics-daemon-secret" not found
Oct 30 23:18:54.011126 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:54.011081    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:54.011296 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:54.011210    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vg5p\" (UniqueName: \"kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p\") pod \"network-check-target-mhrmm\" (UID: \"11f70cd2-d0b3-4a44-b936-1659972c6605\") " pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:54.018330 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:54.018299    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:54.028910 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:54.028882    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vg5p\" (UniqueName: \"kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p\") pod \"network-check-target-mhrmm\" (UID: \"11f70cd2-d0b3-4a44-b936-1659972c6605\") " pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:54.169553 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:54.169516    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:18:54.199375 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:54.199181    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:54.510003 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:54.509974    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/0.log"
Oct 30 23:18:54.510437 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:54.510096    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244" event={"ID":"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8","Type":"ContainerStarted","Data":"dbab56baa430ecb712c8e42f80c375fa2927c44ccc35dd75354f63e19f7b577c"}
Oct 30 23:18:54.510437 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:54.510374    2577 scope.go:122] "RemoveContainer" containerID="dbab56baa430ecb712c8e42f80c375fa2927c44ccc35dd75354f63e19f7b577c"
Oct 30 23:18:54.559296 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:54.559162    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nd66m"]
Oct 30 23:18:54.561902 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:54.561882    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mhrmm"]
Oct 30 23:18:54.576081 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:54.576054    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bef686e_e4b6_44c2_b2c5_1cde73ddb2b1.slice/crio-26f68d670e44867d09a6870a368be80cefd7bf4c4da0c7c5d01810915fbc2eba WatchSource:0}: Error finding container 26f68d670e44867d09a6870a368be80cefd7bf4c4da0c7c5d01810915fbc2eba: Status 404 returned error can't find the container with id 26f68d670e44867d09a6870a368be80cefd7bf4c4da0c7c5d01810915fbc2eba
Oct 30 23:18:54.576751 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:54.576726    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f70cd2_d0b3_4a44_b936_1659972c6605.slice/crio-b0bf97023590b3ba24ea658a863f88f97597de22055799aec6b1eccf63774fd5 WatchSource:0}: Error finding container b0bf97023590b3ba24ea658a863f88f97597de22055799aec6b1eccf63774fd5: Status 404 returned error can't find the container with id b0bf97023590b3ba24ea658a863f88f97597de22055799aec6b1eccf63774fd5
Oct 30 23:18:55.125719 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.125687    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:18:55.260114 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.260091    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:18:55.516710 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.516631    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/1.log"
Oct 30 23:18:55.517315 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.517297    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/0.log"
Oct 30 23:18:55.517377 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.517340    2577 generic.go:356] "Generic (PLEG): container finished" podID="3536b8b5-e6a8-48c5-8319-8d75a7f4abd8" containerID="dbab56baa430ecb712c8e42f80c375fa2927c44ccc35dd75354f63e19f7b577c" exitCode=255
Oct 30 23:18:55.517377 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.517360    2577 generic.go:356] "Generic (PLEG): container finished" podID="3536b8b5-e6a8-48c5-8319-8d75a7f4abd8" containerID="918efe4dcf661e709732583ce65b6af619d2f844c36a25e81025229a5b0a857a" exitCode=255
Oct 30 23:18:55.517479 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.517433    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244" event={"ID":"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8","Type":"ContainerDied","Data":"dbab56baa430ecb712c8e42f80c375fa2927c44ccc35dd75354f63e19f7b577c"}
Oct 30 23:18:55.517479 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.517475    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244" event={"ID":"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8","Type":"ContainerDied","Data":"918efe4dcf661e709732583ce65b6af619d2f844c36a25e81025229a5b0a857a"}
Oct 30 23:18:55.517569 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.517528    2577 scope.go:122] "RemoveContainer" containerID="dbab56baa430ecb712c8e42f80c375fa2927c44ccc35dd75354f63e19f7b577c"
Oct 30 23:18:55.518081 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.517850    2577 scope.go:122] "RemoveContainer" containerID="918efe4dcf661e709732583ce65b6af619d2f844c36a25e81025229a5b0a857a"
Oct 30 23:18:55.518081 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:55.518070    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-qs244_openshift-console-operator(3536b8b5-e6a8-48c5-8319-8d75a7f4abd8)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244" podUID="3536b8b5-e6a8-48c5-8319-8d75a7f4abd8"
Oct 30 23:18:55.519141 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.519114    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nd66m" event={"ID":"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1","Type":"ContainerStarted","Data":"26f68d670e44867d09a6870a368be80cefd7bf4c4da0c7c5d01810915fbc2eba"}
Oct 30 23:18:55.521143 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.520788    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-qdr5f" event={"ID":"f9a4c974-1f79-40b2-9f49-427170c8764b","Type":"ContainerStarted","Data":"40f29213d66008beba5fe8d5da672d3abd69a56f29a0bf793cf91b590c3fc050"}
Oct 30 23:18:55.527233 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.527205    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz" event={"ID":"bb5e9511-9532-4de4-9f4c-5e034cca2773","Type":"ContainerStarted","Data":"ff49d3903f680bbff89f7aff07d9ca9acb90fa9491b391cc60e22d97a90414d5"}
Oct 30 23:18:55.528805 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.528774    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mhrmm" event={"ID":"11f70cd2-d0b3-4a44-b936-1659972c6605","Type":"ContainerStarted","Data":"b0bf97023590b3ba24ea658a863f88f97597de22055799aec6b1eccf63774fd5"}
Oct 30 23:18:55.558075 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.558025    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz" podStartSLOduration=394.669071342 podStartE2EDuration="6m39.558007871s" totalImagesPullingTime="4.888936529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:12:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:55.556806969 +0000 UTC m=+35.836057221" watchObservedRunningTime="2026-10-30 23:18:55.558007871 +0000 UTC m=+35.837258123"
Oct 30 23:18:55.562580 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.562555    2577 scope.go:122] "RemoveContainer" containerID="dbab56baa430ecb712c8e42f80c375fa2927c44ccc35dd75354f63e19f7b577c"
Oct 30 23:18:55.564147 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:55.563175    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbab56baa430ecb712c8e42f80c375fa2927c44ccc35dd75354f63e19f7b577c\": container with ID starting with dbab56baa430ecb712c8e42f80c375fa2927c44ccc35dd75354f63e19f7b577c not found: ID does not exist" containerID="dbab56baa430ecb712c8e42f80c375fa2927c44ccc35dd75354f63e19f7b577c"
Oct 30 23:18:55.564266 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.563217    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbab56baa430ecb712c8e42f80c375fa2927c44ccc35dd75354f63e19f7b577c"} err="failed to get container status \"dbab56baa430ecb712c8e42f80c375fa2927c44ccc35dd75354f63e19f7b577c\": rpc error: code = NotFound desc = could not find container \"dbab56baa430ecb712c8e42f80c375fa2927c44ccc35dd75354f63e19f7b577c\": container with ID starting with dbab56baa430ecb712c8e42f80c375fa2927c44ccc35dd75354f63e19f7b577c not found: ID does not exist"
Oct 30 23:18:55.579763 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.579692    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-qdr5f" podStartSLOduration=394.804942629 podStartE2EDuration="6m39.579675588s" totalImagesPullingTime="4.774732959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:12:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:55.578338563 +0000 UTC m=+35.857588818" watchObservedRunningTime="2026-10-30 23:18:55.579675588 +0000 UTC m=+35.858925841"
Oct 30 23:18:55.721085 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.720044    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-894kd"]
Oct 30 23:18:55.743730 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.743696    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-894kd"]
Oct 30 23:18:55.743894 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.743822    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:55.758805 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.758777    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 23:18:55.758805 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.758796    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 23:18:55.758990 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.758827    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z9rpn\""
Oct 30 23:18:55.792926 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.792855    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:18:55.832520 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.832485    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:55.832700 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.832532    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/53725f0f-4d8e-4270-b319-3943c040f794-crio-socket\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:55.832761 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.832704    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xxsh\" (UniqueName: \"kubernetes.io/projected/53725f0f-4d8e-4270-b319-3943c040f794-kube-api-access-2xxsh\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:55.832823 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.832755    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53725f0f-4d8e-4270-b319-3943c040f794-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:55.832823 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.832802    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/53725f0f-4d8e-4270-b319-3943c040f794-data-volume\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:55.910969 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.910895    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:18:55.934378 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.934329    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/53725f0f-4d8e-4270-b319-3943c040f794-data-volume\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:55.934515 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.934457    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:55.934515 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.934478    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/53725f0f-4d8e-4270-b319-3943c040f794-crio-socket\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:55.934727 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.934565    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xxsh\" (UniqueName: \"kubernetes.io/projected/53725f0f-4d8e-4270-b319-3943c040f794-kube-api-access-2xxsh\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:55.934727 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.934620    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53725f0f-4d8e-4270-b319-3943c040f794-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:55.934727 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:55.934699    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 23:18:55.934871 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:55.934760    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53725f0f-4d8e-4270-b319-3943c040f794-kube-rbac-proxy-cm podName:53725f0f-4d8e-4270-b319-3943c040f794 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:56.434741423 +0000 UTC m=+36.713991666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/53725f0f-4d8e-4270-b319-3943c040f794-kube-rbac-proxy-cm") pod "insights-runtime-extractor-894kd" (UID: "53725f0f-4d8e-4270-b319-3943c040f794") : configmap "kube-rbac-proxy" not found
Oct 30 23:18:55.935228 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.935187    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/53725f0f-4d8e-4270-b319-3943c040f794-data-volume\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:55.935313 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:55.935298    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 23:18:55.935402 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:55.935335    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls podName:53725f0f-4d8e-4270-b319-3943c040f794 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:56.435322968 +0000 UTC m=+36.714573211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls") pod "insights-runtime-extractor-894kd" (UID: "53725f0f-4d8e-4270-b319-3943c040f794") : secret "insights-runtime-extractor-tls" not found
Oct 30 23:18:55.935469 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.935447    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/53725f0f-4d8e-4270-b319-3943c040f794-crio-socket\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:55.951502 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:55.951462    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xxsh\" (UniqueName: \"kubernetes.io/projected/53725f0f-4d8e-4270-b319-3943c040f794-kube-api-access-2xxsh\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:56.440242 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:56.440166    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:18:56.442954 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:56.442923    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:56.443094 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:56.443038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53725f0f-4d8e-4270-b319-3943c040f794-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:56.443192 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:56.443176    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 23:18:56.443252 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:56.443237    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53725f0f-4d8e-4270-b319-3943c040f794-kube-rbac-proxy-cm podName:53725f0f-4d8e-4270-b319-3943c040f794 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:57.443221295 +0000 UTC m=+37.722471538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/53725f0f-4d8e-4270-b319-3943c040f794-kube-rbac-proxy-cm") pod "insights-runtime-extractor-894kd" (UID: "53725f0f-4d8e-4270-b319-3943c040f794") : configmap "kube-rbac-proxy" not found
Oct 30 23:18:56.443671 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:56.443653    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 23:18:56.443768 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:56.443706    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls podName:53725f0f-4d8e-4270-b319-3943c040f794 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:57.443690589 +0000 UTC m=+37.722940834 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls") pod "insights-runtime-extractor-894kd" (UID: "53725f0f-4d8e-4270-b319-3943c040f794") : secret "insights-runtime-extractor-tls" not found
Oct 30 23:18:56.534739 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:56.534699    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fsbsg" event={"ID":"b1846d39-a52a-442d-8216-10f0798dbc36","Type":"ContainerStarted","Data":"fd280d95954b70459b504b55ac5aeefb7ce8ec4aa03bb92145f8d6c45a68c0b3"}
Oct 30 23:18:56.537410 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:56.537387    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/1.log"
Oct 30 23:18:56.537844 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:56.537734    2577 scope.go:122] "RemoveContainer" containerID="918efe4dcf661e709732583ce65b6af619d2f844c36a25e81025229a5b0a857a"
Oct 30 23:18:56.537943 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:56.537915    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-qs244_openshift-console-operator(3536b8b5-e6a8-48c5-8319-8d75a7f4abd8)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244" podUID="3536b8b5-e6a8-48c5-8319-8d75a7f4abd8"
Oct 30 23:18:56.539841 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:56.539815    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9" event={"ID":"ef3b49c5-63b0-4be5-8198-589cc7bc1ce6","Type":"ContainerStarted","Data":"0084b034fe7fb71d84cc8f774b821c53291e3b62602e4d5f1ab62a994fe33aca"}
Oct 30 23:18:56.554089 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:56.554045    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fsbsg" podStartSLOduration=2.39071925 podStartE2EDuration="7.554033586s" totalImagesPullingTime="5.163314336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:56.552276387 +0000 UTC m=+36.831526681" watchObservedRunningTime="2026-10-30 23:18:56.554033586 +0000 UTC m=+36.833283836"
Oct 30 23:18:56.560986 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:56.560938    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:18:56.574189 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:56.573409    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9" podStartSLOduration=394.947901574 podStartE2EDuration="6m40.573391917s" totalImagesPullingTime="5.625490343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:12:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:56.571939966 +0000 UTC m=+36.851190218" watchObservedRunningTime="2026-10-30 23:18:56.573391917 +0000 UTC m=+36.852642171"
Oct 30 23:18:56.868709 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:56.868355    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-cj25s"]
Oct 30 23:18:56.887564 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:56.887044    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cj25s"
Oct 30 23:18:56.887768 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:56.887620    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-cj25s"]
Oct 30 23:18:56.889782 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:56.889727    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:18:56.953564 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:56.953497    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9lbz\" (UniqueName: \"kubernetes.io/projected/bdb399c5-bad6-4310-9542-509884ea425a-kube-api-access-r9lbz\") pod \"migrator-66df5d496b-cj25s\" (UID: \"bdb399c5-bad6-4310-9542-509884ea425a\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cj25s"
Oct 30 23:18:56.988481 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:56.988451    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qrvbx\""
Oct 30 23:18:56.988683 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:56.988538    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 23:18:56.988683 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:56.988578    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 23:18:57.019702 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:57.019667    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:18:57.054583 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:57.054550    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9lbz\" (UniqueName: \"kubernetes.io/projected/bdb399c5-bad6-4310-9542-509884ea425a-kube-api-access-r9lbz\") pod \"migrator-66df5d496b-cj25s\" (UID: \"bdb399c5-bad6-4310-9542-509884ea425a\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cj25s"
Oct 30 23:18:57.067293 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:57.067266    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9lbz\" (UniqueName: \"kubernetes.io/projected/bdb399c5-bad6-4310-9542-509884ea425a-kube-api-access-r9lbz\") pod \"migrator-66df5d496b-cj25s\" (UID: \"bdb399c5-bad6-4310-9542-509884ea425a\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cj25s"
Oct 30 23:18:57.157134 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:57.157104    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:18:57.234653 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:57.234398    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cj25s"
Oct 30 23:18:57.458384 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:57.458297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53725f0f-4d8e-4270-b319-3943c040f794-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:57.458384 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:57.458357    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:18:57.458641 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:57.458391    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:18:57.458641 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:57.458418    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:57.458641 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:57.458454    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-z84cb\" (UID: \"84480344-bd78-4528-bfe4-29b67541a818\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:18:57.458641 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:57.458494    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:18:57.458641 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:57.458529    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:57.458641 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:57.458578    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:18:57.458965 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.458779    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle podName:f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b nodeName:}" failed. No retries permitted until 2026-10-30 23:19:05.458759942 +0000 UTC m=+45.738010189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle") pod "router-default-54c94948b5-5fm4s" (UID: "f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b") : configmap references non-existent config key: service-ca.crt
Oct 30 23:18:57.459654 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.459193    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 23:18:57.459654 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.459244    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53725f0f-4d8e-4270-b319-3943c040f794-kube-rbac-proxy-cm podName:53725f0f-4d8e-4270-b319-3943c040f794 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:59.459232469 +0000 UTC m=+39.738482712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/53725f0f-4d8e-4270-b319-3943c040f794-kube-rbac-proxy-cm") pod "insights-runtime-extractor-894kd" (UID: "53725f0f-4d8e-4270-b319-3943c040f794") : configmap "kube-rbac-proxy" not found
Oct 30 23:18:57.459654 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.459317    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 23:18:57.459654 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.459349    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls podName:d3c8853f-5927-4411-b293-0030e7f43312 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:05.459338673 +0000 UTC m=+45.738588917 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-rrnzh" (UID: "d3c8853f-5927-4411-b293-0030e7f43312") : secret "samples-operator-tls" not found
Oct 30 23:18:57.459654 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.459386    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 23:18:57.459654 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.459415    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls podName:dc691df1-3f27-4829-955d-99b66893279d nodeName:}" failed. No retries permitted until 2026-10-30 23:19:05.459406312 +0000 UTC m=+45.738656556 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-2w6gp" (UID: "dc691df1-3f27-4829-955d-99b66893279d") : secret "cluster-monitoring-operator-tls" not found
Oct 30 23:18:57.459654 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.459445    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 23:18:57.459654 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.459461    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs podName:f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b nodeName:}" failed. No retries permitted until 2026-10-30 23:19:05.459456698 +0000 UTC m=+45.738706941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs") pod "router-default-54c94948b5-5fm4s" (UID: "f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b") : secret "router-metrics-certs-default" not found
Oct 30 23:18:57.459654 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.459495    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 23:18:57.459654 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.459513    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert podName:84480344-bd78-4528-bfe4-29b67541a818 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:05.45950767 +0000 UTC m=+45.738757913 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-z84cb" (UID: "84480344-bd78-4528-bfe4-29b67541a818") : secret "networking-console-plugin-cert" not found
Oct 30 23:18:57.459654 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.459566    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 23:18:57.459654 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.459577    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6888fc6c96-6gdwr: secret "image-registry-tls" not found
Oct 30 23:18:57.459654 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.459620    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls podName:a73f11a7-b4de-43b4-83de-cc7a630d25c3 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:05.459611231 +0000 UTC m=+45.738861473 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls") pod "image-registry-6888fc6c96-6gdwr" (UID: "a73f11a7-b4de-43b4-83de-cc7a630d25c3") : secret "image-registry-tls" not found
Oct 30 23:18:57.460379 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.459683    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 23:18:57.460379 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.459725    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls podName:53725f0f-4d8e-4270-b319-3943c040f794 nodeName:}" failed. No retries permitted until 2026-10-30 23:18:59.459713176 +0000 UTC m=+39.738963405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls") pod "insights-runtime-extractor-894kd" (UID: "53725f0f-4d8e-4270-b319-3943c040f794") : secret "insights-runtime-extractor-tls" not found
Oct 30 23:18:57.554516 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:57.554421    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-cj25s"]
Oct 30 23:18:57.558853 ip-10-0-142-208 kubenswrapper[2577]: W1030 23:18:57.558806    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdb399c5_bad6_4310_9542_509884ea425a.slice/crio-b0dfc5540bd89514967418b9d9b5315404edfce6ca3850573d37a645cabb72fc WatchSource:0}: Error finding container b0dfc5540bd89514967418b9d9b5315404edfce6ca3850573d37a645cabb72fc: Status 404 returned error can't find the container with id b0dfc5540bd89514967418b9d9b5315404edfce6ca3850573d37a645cabb72fc
Oct 30 23:18:57.559246 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:57.559225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:18:57.559246 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:57.559255    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:18:57.559406 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.559355    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 23:18:57.559406 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.559372    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 23:18:57.559406 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.559388    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cf56b4bd9-285cx: secret "image-registry-tls" not found
Oct 30 23:18:57.559406 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.559405    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls podName:5ba7c1ba-4162-430e-b267-ebf3f9844750 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:05.559392269 +0000 UTC m=+45.838642501 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls") pod "dns-default-295nz" (UID: "5ba7c1ba-4162-430e-b267-ebf3f9844750") : secret "dns-default-metrics-tls" not found
Oct 30 23:18:57.559633 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:57.559437    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls podName:b710ad88-e867-4ea3-a13b-394eb3d34c89 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:05.559420646 +0000 UTC m=+45.838670892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls") pod "image-registry-7cf56b4bd9-285cx" (UID: "b710ad88-e867-4ea3-a13b-394eb3d34c89") : secret "image-registry-tls" not found
Oct 30 23:18:57.780706 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:57.780618    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:18:58.552573 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:58.551768    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mhrmm" event={"ID":"11f70cd2-d0b3-4a44-b936-1659972c6605","Type":"ContainerStarted","Data":"50fc2df66cd89249f97e67fc55d34f9ae9a3c336d17b504be83db7b5440dcf63"}
Oct 30 23:18:58.552573 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:58.552520    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:18:58.555393 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:58.555359    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-flrmm" event={"ID":"1cfc2d59-558a-4f8a-8f23-59fe4b78dd17","Type":"ContainerStarted","Data":"c3e9dde3bfe2b7a553810c4b2e0c7e3440adfbe0c92b8f6b5fafb1b0d68e0a1f"}
Oct 30 23:18:58.557035 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:58.556974    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cj25s" event={"ID":"bdb399c5-bad6-4310-9542-509884ea425a","Type":"ContainerStarted","Data":"b0dfc5540bd89514967418b9d9b5315404edfce6ca3850573d37a645cabb72fc"}
Oct 30 23:18:58.589986 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:58.588182    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-flrmm" podStartSLOduration=387.96986716 podStartE2EDuration="6m35.588166657s" totalImagesPullingTime="7.618299497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:58.587803591 +0000 UTC m=+38.867053836" watchObservedRunningTime="2026-10-30 23:18:58.588166657 +0000 UTC m=+38.867416910"
Oct 30 23:18:58.589986 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:58.589269    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mhrmm" podStartSLOduration=34.902124029 podStartE2EDuration="38.589255833s" totalImagesPullingTime="3.687131804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:18:58.570533322 +0000 UTC m=+38.849783572" watchObservedRunningTime="2026-10-30 23:18:58.589255833 +0000 UTC m=+38.868506092"
Oct 30 23:18:59.481348 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:59.481313    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53725f0f-4d8e-4270-b319-3943c040f794-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:59.481544 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:59.481449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:18:59.481544 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:59.481458    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 23:18:59.481544 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:59.481536    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53725f0f-4d8e-4270-b319-3943c040f794-kube-rbac-proxy-cm podName:53725f0f-4d8e-4270-b319-3943c040f794 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:03.481517845 +0000 UTC m=+43.760768089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/53725f0f-4d8e-4270-b319-3943c040f794-kube-rbac-proxy-cm") pod "insights-runtime-extractor-894kd" (UID: "53725f0f-4d8e-4270-b319-3943c040f794") : configmap "kube-rbac-proxy" not found
Oct 30 23:18:59.481746 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:59.481553    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 23:18:59.481746 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:59.481624    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls podName:53725f0f-4d8e-4270-b319-3943c040f794 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:03.481607116 +0000 UTC m=+43.760857363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls") pod "insights-runtime-extractor-894kd" (UID: "53725f0f-4d8e-4270-b319-3943c040f794") : secret "insights-runtime-extractor-tls" not found
Oct 30 23:18:59.993286 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:59.993250    2577 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:18:59.993681 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:59.993318    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:18:59.993681 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:18:59.993652    2577 scope.go:122] "RemoveContainer" containerID="918efe4dcf661e709732583ce65b6af619d2f844c36a25e81025229a5b0a857a"
Oct 30 23:18:59.993845 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:18:59.993827    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-qs244_openshift-console-operator(3536b8b5-e6a8-48c5-8319-8d75a7f4abd8)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244" podUID="3536b8b5-e6a8-48c5-8319-8d75a7f4abd8"
Oct 30 23:19:00.255069 ip-10-0-142-208 kubenswrapper[2577]: E1030 23:19:00.255004    2577 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/systemd-update-utmp-runlevel.service\": RecentStats: unable to find data in memory cache]"
Oct 30 23:19:00.387979 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:19:00.387904    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:00.567315 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:19:00.567221    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nd66m" event={"ID":"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1","Type":"ContainerStarted","Data":"3b3b72b86e7e9e1566978fb9961c810c16874e3cd00c25f4f22396f86da5de1e"}
Oct 30 23:19:00.568839 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:19:00.568812    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cj25s" event={"ID":"bdb399c5-bad6-4310-9542-509884ea425a","Type":"ContainerStarted","Data":"bbbff1a393912f4c4179302f26c5a94457c96a315460e2121b3a18ca3520bb80"}
Oct 30 23:19:00.585140 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:19:00.585095    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nd66m" podStartSLOduration=34.762383846 podStartE2EDuration="40.585081937s" totalImagesPullingTime="5.822698091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:19:00.584318131 +0000 UTC m=+40.863568383" watchObservedRunningTime="2026-10-30 23:19:00.585081937 +0000 UTC m=+40.864332188"
Oct 30 23:19:00.604386 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:19:00.604332    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cj25s" podStartSLOduration=2.54618162 podStartE2EDuration="4.604313518s" totalImagesPullingTime="2.058131898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:18:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:19:00.602833139 +0000 UTC m=+40.882083388" watchObservedRunningTime="2026-10-30 23:19:00.604313518 +0000 UTC m=+40.883563771"
Oct 30 23:19:00.696001 ip-10-0-142-208 kubenswrapper[2577]: I1030 23:19:00.695972    2577 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 23:19:00.696130 ip-10-0-142-208 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 23:19:00.711993 ip-10-0-142-208 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 23:19:00.712179 ip-10-0-142-208 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 23:19:00.712230 ip-10-0-142-208 systemd[1]: kubelet.service: Consumed 3.013s CPU time.
Oct 30 23:19:00.724044 ip-10-0-142-208 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 23:19:00.796689 ip-10-0-142-208 kubenswrapper[4921]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 23:19:00.796689 ip-10-0-142-208 kubenswrapper[4921]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 23:19:00.796689 ip-10-0-142-208 kubenswrapper[4921]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 23:19:00.796689 ip-10-0-142-208 kubenswrapper[4921]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 23:19:00.798806 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798724    4921 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:19:00.798806 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798805    4921 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:19:00.798806 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798809    4921 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798813    4921 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798816    4921 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798819    4921 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798822    4921 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798824    4921 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798828    4921 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798831    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798834    4921 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798836    4921 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798839    4921 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798841    4921 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798843    4921 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798846    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798848    4921 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798872    4921 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798876    4921 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798880    4921 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798882    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798885    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:19:00.798904 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798888    4921 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798890    4921 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798893    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798896    4921 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798899    4921 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798902    4921 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798904    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798907    4921 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798910    4921 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798913    4921 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798915    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798918    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798920    4921 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798923    4921 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798925    4921 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798928    4921 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798930    4921 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798933    4921 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798935    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798938    4921 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:19:00.799390 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798941    4921 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:19:00.799901 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798943    4921 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:19:00.799901 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798946    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:19:00.799901 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798948    4921 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:19:00.799901 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798950    4921 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:19:00.799901 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798953    4921 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:19:00.799901 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798955    4921 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:19:00.799901 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798957    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:19:00.799901 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798960    4921 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:19:00.799901 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798963    4921 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:19:00.799901 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798965    4921 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:19:00.799901 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798968    4921 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:19:00.799901 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798970    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:19:00.799901 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798973    4921 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:19:00.799901 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798979    4921 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:19:00.799901 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798982    4921 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:19:00.799901 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798985    4921 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:19:00.799901 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798987    4921 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:19:00.799901 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798990    4921 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:19:00.799901 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798992    4921 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:19:00.800370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.798997    4921 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:19:00.800370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799001    4921 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:19:00.800370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799004    4921 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:19:00.800370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799007    4921 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:19:00.800370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799010    4921 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:19:00.800370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799012    4921 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:19:00.800370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799015    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:19:00.800370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799018    4921 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:19:00.800370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799020    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:19:00.800370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799023    4921 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:19:00.800370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799027    4921 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:19:00.800370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799031    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:19:00.800370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799034    4921 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:19:00.800370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799036    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:19:00.800370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799039    4921 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:19:00.800370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799041    4921 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:19:00.800370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799044    4921 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:19:00.800370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799046    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:19:00.800370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799049    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799051    4921 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799053    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799056    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799059    4921 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799061    4921 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799063    4921 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799066    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799070    4921 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799073    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799076    4921 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799079    4921 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799081    4921 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799084    4921 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799086    4921 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799089    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799091    4921 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799094    4921 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799096    4921 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799099    4921 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:19:00.800849 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799102    4921 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799104    4921 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799106    4921 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799109    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799111    4921 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799114    4921 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799956    4921 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799965    4921 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799968    4921 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799971    4921 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799974    4921 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799977    4921 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799979    4921 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799982    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799985    4921 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799988    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799990    4921 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799993    4921 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799995    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.799998    4921 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:19:00.801334 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800004    4921 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:19:00.801894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800009    4921 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:19:00.801894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800013    4921 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:19:00.801894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800018    4921 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:19:00.801894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800022    4921 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:19:00.801894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800025    4921 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:19:00.801894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800028    4921 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:19:00.801894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800030    4921 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:19:00.801894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800033    4921 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:19:00.801894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800036    4921 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:19:00.801894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800039    4921 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:19:00.801894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800041    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:19:00.801894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800044    4921 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:19:00.801894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800046    4921 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:19:00.801894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800048    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:19:00.801894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800053    4921 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:19:00.801894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800057    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:19:00.801894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800060    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:19:00.801894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800063    4921 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:19:00.801894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800065    4921 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:19:00.802367 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800068    4921 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:19:00.802367 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800071    4921 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:19:00.802367 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800074    4921 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:19:00.802367 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800076    4921 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:19:00.802367 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800079    4921 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:19:00.802367 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800081    4921 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:19:00.802367 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800084    4921 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:19:00.802367 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800088    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:19:00.802367 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800091    4921 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:19:00.802367 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800093    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:19:00.802367 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800096    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:19:00.802367 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800098    4921 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:19:00.802367 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800102    4921 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:19:00.802367 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800105    4921 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:19:00.802367 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800107    4921 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:19:00.802367 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800109    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:19:00.802367 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800113    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:19:00.802367 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800115    4921 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:19:00.802367 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800118    4921 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800120    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800123    4921 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800126    4921 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800128    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800130    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800133    4921 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800136    4921 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800138    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800140    4921 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800143    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800145    4921 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800148    4921 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800150    4921 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800152    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800155    4921 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800157    4921 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800159    4921 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800162    4921 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800165    4921 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:19:00.802858 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800167    4921 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800171    4921 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800173    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800176    4921 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800179    4921 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800181    4921 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800186    4921 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800188    4921 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800191    4921 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800193    4921 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800196    4921 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800198    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800201    4921 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800204    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800206    4921 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800209    4921 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800211    4921 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800213    4921 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800216    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800218    4921 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:19:00.803381 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800221    4921 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:19:00.803899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800223    4921 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:19:00.803899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800227    4921 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:19:00.803899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800230    4921 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:19:00.803899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800233    4921 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:19:00.803899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800236    4921 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:19:00.803899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800238    4921 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:19:00.803899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800241    4921 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:19:00.803899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800243    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:19:00.803899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800245    4921 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:19:00.803899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800248    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:19:00.803899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800250    4921 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:19:00.803899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800253    4921 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:19:00.803899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800259    4921 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:19:00.803899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800766    4921 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:19:00.803899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800773    4921 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:19:00.803899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800777    4921 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:19:00.803899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800780    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:19:00.803899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800785    4921 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:19:00.803899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800787    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800790    4921 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800792    4921 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800795    4921 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800798    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800801    4921 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800803    4921 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800806    4921 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800808    4921 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800811    4921 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800813    4921 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800816    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800819    4921 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800821    4921 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800824    4921 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800826    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800829    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800831    4921 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800833    4921 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800836    4921 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:19:00.804370 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800838    4921 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:19:00.804902 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800841    4921 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:19:00.804902 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800843    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:19:00.804902 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800845    4921 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:19:00.804902 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800848    4921 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:19:00.804902 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800851    4921 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:19:00.804902 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800855    4921 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:19:00.804902 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800858    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:19:00.804902 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800861    4921 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:19:00.804902 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800863    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:19:00.804902 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800866    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:19:00.804902 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800870    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:19:00.804902 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800872    4921 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:19:00.804902 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800874    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:19:00.804902 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800877    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:19:00.804902 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800879    4921 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:19:00.804902 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800882    4921 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:19:00.804902 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800885    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:19:00.804902 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800889    4921 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:19:00.805394 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800893    4921 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:19:00.805394 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800896    4921 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:19:00.805394 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800899    4921 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:19:00.805394 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800902    4921 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:19:00.805394 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800904    4921 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:19:00.805394 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800907    4921 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:19:00.805394 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800910    4921 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:19:00.805394 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800912    4921 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:19:00.805394 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800915    4921 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:19:00.805394 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800917    4921 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:19:00.805394 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800920    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:19:00.805394 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800922    4921 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:19:00.805394 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800925    4921 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:19:00.805394 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800927    4921 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:19:00.805394 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800930    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:19:00.805394 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800932    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:19:00.805394 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800935    4921 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:19:00.805394 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800937    4921 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:19:00.805394 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800940    4921 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800944    4921 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800947    4921 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800949    4921 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800951    4921 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800954    4921 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800959    4921 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800961    4921 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800963    4921 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800966    4921 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800968    4921 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800971    4921 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800973    4921 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800976    4921 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800979    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800981    4921 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800983    4921 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800986    4921 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800988    4921 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800991    4921 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:19:00.805878 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800994    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800996    4921 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.800999    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801001    4921 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801003    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801006    4921 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801008    4921 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801011    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801013    4921 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801016    4921 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801018    4921 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801020    4921 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801023    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801026    4921 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801029    4921 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801031    4921 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801034    4921 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801036    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801040    4921 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801042    4921 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:19:00.806523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801045    4921 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801047    4921 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801050    4921 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801052    4921 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801152    4921 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801162    4921 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801173    4921 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801181    4921 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801186    4921 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801189    4921 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801193    4921 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801197    4921 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801200    4921 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801203    4921 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801207    4921 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801210    4921 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801213    4921 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801216    4921 flags.go:64] FLAG: --cgroup-root=""
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801219    4921 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801222    4921 flags.go:64] FLAG: --client-ca-file=""
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801224    4921 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801227    4921 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801231    4921 flags.go:64] FLAG: --cluster-domain=""
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801234    4921 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 23:19:00.807357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801237    4921 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801241    4921 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801245    4921 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801248    4921 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801251    4921 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801254    4921 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801259    4921 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801262    4921 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801264    4921 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801267    4921 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801270    4921 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801273    4921 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801277    4921 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801280    4921 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801283    4921 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801287    4921 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801290    4921 flags.go:64] FLAG: --enable-server="true"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801293    4921 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801297    4921 flags.go:64] FLAG: --event-burst="100"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801300    4921 flags.go:64] FLAG: --event-qps="50"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801303    4921 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801306    4921 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801309    4921 flags.go:64] FLAG: --eviction-hard=""
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801313    4921 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 23:19:00.808072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801316    4921 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801319    4921 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801322    4921 flags.go:64] FLAG: --eviction-soft=""
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801325    4921 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801328    4921 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801330    4921 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801333    4921 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801336    4921 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801339    4921 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801344    4921 flags.go:64] FLAG: --feature-gates=""
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801348    4921 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801351    4921 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801354    4921 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801357    4921 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801361    4921 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801364    4921 flags.go:64] FLAG: --help="false"
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801367    4921 flags.go:64] FLAG: --hostname-override="ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801371    4921 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801374    4921 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801377    4921 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801380    4921 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801383    4921 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801386    4921 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 23:19:00.808729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801389    4921 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801392    4921 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801395    4921 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801398    4921 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801401    4921 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801404    4921 flags.go:64] FLAG: --kube-reserved=""
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801407    4921 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801409    4921 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801412    4921 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801415    4921 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801417    4921 flags.go:64] FLAG: --lock-file=""
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801420    4921 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801423    4921 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801426    4921 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801431    4921 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801434    4921 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801437    4921 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801440    4921 flags.go:64] FLAG: --logging-format="text"
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801443    4921 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801446    4921 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801449    4921 flags.go:64] FLAG: --manifest-url=""
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801452    4921 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801457    4921 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801460    4921 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801463    4921 flags.go:64] FLAG: --max-pods="110"
Oct 30 23:19:00.809291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801466    4921 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801469    4921 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801472    4921 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801475    4921 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801478    4921 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801481    4921 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801484    4921 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801491    4921 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801494    4921 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801497    4921 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801500    4921 flags.go:64] FLAG: --pod-cidr=""
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801504    4921 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801506    4921 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801509    4921 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801512    4921 flags.go:64] FLAG: --port="10250"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801515    4921 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801518    4921 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-061e8cecd64aa092c"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801521    4921 flags.go:64] FLAG: --qos-reserved=""
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801523    4921 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801526    4921 flags.go:64] FLAG: --register-node="true"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801529    4921 flags.go:64] FLAG: --register-with-taints=""
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801536    4921 flags.go:64] FLAG: --registry-burst="10"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801538    4921 flags.go:64] FLAG: --registry-qps="5"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801541    4921 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801544    4921 flags.go:64] FLAG: --reserved-memory=""
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801549    4921 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 23:19:00.809908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801552    4921 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801555    4921 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801558    4921 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801561    4921 flags.go:64] FLAG: --runonce="false"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801563    4921 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801566    4921 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801569    4921 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801572    4921 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801575    4921 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801578    4921 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801581    4921 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801584    4921 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801587    4921 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801605    4921 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801608    4921 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801610    4921 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801614    4921 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801617    4921 flags.go:64] FLAG: --system-cgroups=""
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801620    4921 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801625    4921 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801628    4921 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801631    4921 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801635    4921 flags.go:64] FLAG: --tls-min-version=""
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801638    4921 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801640    4921 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 23:19:00.810562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801643    4921 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801646    4921 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801649    4921 flags.go:64] FLAG: --v="2"
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801653    4921 flags.go:64] FLAG: --version="false"
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801657    4921 flags.go:64] FLAG: --vmodule=""
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801661    4921 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.801665    4921 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801823    4921 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801827    4921 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801831    4921 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801834    4921 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801836    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801839    4921 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801842    4921 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801844    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801848    4921 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801851    4921 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801855    4921 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801858    4921 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801860    4921 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801864    4921 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:19:00.811205 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801866    4921 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801869    4921 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801871    4921 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801876    4921 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801879    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801881    4921 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801884    4921 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801886    4921 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801889    4921 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801891    4921 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801894    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801897    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801899    4921 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801902    4921 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801905    4921 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801907    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801910    4921 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801913    4921 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801915    4921 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801918    4921 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:19:00.811757 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801920    4921 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:19:00.812297 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801923    4921 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:19:00.812297 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801925    4921 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:19:00.812297 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801928    4921 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:19:00.812297 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801931    4921 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:19:00.812297 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801933    4921 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:19:00.812297 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801936    4921 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:19:00.812297 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801938    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:19:00.812297 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801941    4921 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:19:00.812297 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801943    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:19:00.812297 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801946    4921 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:19:00.812297 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801948    4921 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:19:00.812297 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801951    4921 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:19:00.812297 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801953    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:19:00.812297 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801956    4921 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:19:00.812297 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801960    4921 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:19:00.812297 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801963    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:19:00.812297 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801966    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:19:00.812297 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801968    4921 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:19:00.812297 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801971    4921 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801974    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801976    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801979    4921 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801981    4921 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801985    4921 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801988    4921 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801990    4921 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801993    4921 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801995    4921 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.801997    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802000    4921 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802003    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802005    4921 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802008    4921 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802010    4921 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802012    4921 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802015    4921 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802017    4921 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802020    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:19:00.813027 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802022    4921 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:19:00.813703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802026    4921 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:19:00.813703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802029    4921 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:19:00.813703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802032    4921 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:19:00.813703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802034    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:19:00.813703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802037    4921 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:19:00.813703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802039    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:19:00.813703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802042    4921 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:19:00.813703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802046    4921 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:19:00.813703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802048    4921 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:19:00.813703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802052    4921 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:19:00.813703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802055    4921 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:19:00.813703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802057    4921 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:19:00.813703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802059    4921 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:19:00.813703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802062    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:19:00.813703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802064    4921 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:19:00.813703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802067    4921 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:19:00.813703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802072    4921 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:19:00.813703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802075    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:19:00.813703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802077    4921 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:19:00.814198 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802080    4921 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:19:00.814198 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802083    4921 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:19:00.814198 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802085    4921 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:19:00.814198 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802088    4921 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:19:00.814198 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802090    4921 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:19:00.814198 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802093    4921 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:19:00.814198 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802095    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:19:00.814198 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802098    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:19:00.814198 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802100    4921 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:19:00.814198 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802103    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:19:00.814198 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802106    4921 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:19:00.814198 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802108    4921 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:19:00.814198 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802110    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:19:00.814198 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.802137    4921 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 23:19:00.814198 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802173    4921 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:19:00.814198 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802178    4921 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802181    4921 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802184    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802186    4921 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802189    4921 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802191    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802195    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802198    4921 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802201    4921 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802203    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802206    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802209    4921 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802212    4921 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802214    4921 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802218    4921 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802220    4921 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802222    4921 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802225    4921 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802227    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802230    4921 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:19:00.814703 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802233    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:19:00.815419 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802235    4921 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:19:00.815419 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802237    4921 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:19:00.815419 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802240    4921 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:19:00.815419 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802242    4921 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:19:00.815419 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802245    4921 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:19:00.815419 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802247    4921 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:19:00.815419 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802250    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:19:00.815419 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802252    4921 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:19:00.815419 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802255    4921 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:19:00.815419 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802259    4921 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:19:00.815419 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802261    4921 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:19:00.815419 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802263    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:19:00.815419 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802266    4921 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:19:00.815419 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802268    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:19:00.815419 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802271    4921 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:19:00.815419 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802273    4921 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:19:00.815419 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802276    4921 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:19:00.815419 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802280    4921 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:19:00.815419 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802282    4921 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802285    4921 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802288    4921 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802291    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802293    4921 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802296    4921 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802299    4921 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802302    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802304    4921 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802307    4921 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802309    4921 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802312    4921 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802315    4921 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802317    4921 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802320    4921 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802322    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802325    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802327    4921 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802330    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802332    4921 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:19:00.816014 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802335    4921 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:19:00.816512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802337    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:19:00.816512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802340    4921 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:19:00.816512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802342    4921 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:19:00.816512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802345    4921 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:19:00.816512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802347    4921 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:19:00.816512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802350    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:19:00.816512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802352    4921 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:19:00.816512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802355    4921 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:19:00.816512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802357    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:19:00.816512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802361    4921 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:19:00.816512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802366    4921 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:19:00.816512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802369    4921 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:19:00.816512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802372    4921 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:19:00.816512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802375    4921 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:19:00.816512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802378    4921 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:19:00.816512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802381    4921 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:19:00.816512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802383    4921 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:19:00.816512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802386    4921 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:19:00.816512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802390    4921 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802392    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802394    4921 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802397    4921 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802399    4921 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802402    4921 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802404    4921 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802407    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802410    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802412    4921 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802414    4921 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802417    4921 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802419    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802422    4921 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802425    4921 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802427    4921 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802429    4921 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802433    4921 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802435    4921 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802438    4921 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:19:00.816991 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802440    4921 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:19:00.817504 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802442    4921 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:19:00.817504 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802445    4921 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:19:00.817504 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802447    4921 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:19:00.817504 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802451    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:19:00.817504 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802453    4921 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:19:00.817504 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.802456    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:19:00.817504 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.807454    4921 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 23:19:00.817504 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.807504    4921 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 23:19:00.817504 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.807539    4921 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 23:19:00.817504 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.807698    4921 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 23:19:00.817504 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807766    4921 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:19:00.817504 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807773    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:19:00.817504 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807777    4921 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:19:00.817504 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807782    4921 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:19:00.817504 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807785    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:19:00.817504 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807789    4921 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:19:00.817504 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807792    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:19:00.817504 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807795    4921 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:19:00.817504 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807797    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:19:00.818031 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807800    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:19:00.818031 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807803    4921 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:19:00.818031 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807805    4921 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:19:00.818031 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807808    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:19:00.818031 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807811    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:19:00.818031 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807813    4921 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:19:00.818031 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807816    4921 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:19:00.818031 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807819    4921 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:19:00.818031 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807822    4921 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:19:00.818031 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807824    4921 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:19:00.818031 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807827    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:19:00.818031 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807830    4921 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:19:00.818031 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807832    4921 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:19:00.818031 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807835    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:19:00.818031 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807838    4921 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:19:00.818031 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807840    4921 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:19:00.818031 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807843    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:19:00.818031 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807846    4921 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:19:00.818031 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807849    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807852    4921 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807855    4921 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807857    4921 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807861    4921 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807864    4921 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807867    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807870    4921 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807873    4921 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807876    4921 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807878    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807881    4921 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807883    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807886    4921 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807888    4921 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807891    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807893    4921 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807896    4921 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807898    4921 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807901    4921 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:19:00.818537 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807903    4921 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:19:00.819038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807906    4921 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:19:00.819038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807909    4921 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:19:00.819038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807911    4921 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:19:00.819038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807914    4921 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:19:00.819038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807917    4921 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:19:00.819038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807920    4921 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:19:00.819038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807922    4921 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:19:00.819038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807924    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:19:00.819038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807927    4921 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:19:00.819038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807929    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:19:00.819038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807932    4921 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:19:00.819038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807935    4921 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:19:00.819038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807938    4921 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:19:00.819038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807941    4921 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:19:00.819038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807945    4921 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:19:00.819038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807948    4921 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:19:00.819038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807951    4921 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:19:00.819038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807954    4921 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:19:00.819038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807956    4921 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807959    4921 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807962    4921 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807964    4921 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807967    4921 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807969    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807972    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807974    4921 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807977    4921 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807979    4921 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807982    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807984    4921 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807987    4921 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807990    4921 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807992    4921 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807995    4921 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.807997    4921 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808000    4921 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808002    4921 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808005    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:19:00.819497 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808007    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:19:00.819997 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808010    4921 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:19:00.819997 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808012    4921 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:19:00.819997 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808015    4921 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:19:00.819997 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808018    4921 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:19:00.819997 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808020    4921 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:19:00.819997 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808023    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:19:00.819997 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808025    4921 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:19:00.819997 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808028    4921 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:19:00.819997 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808030    4921 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:19:00.819997 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808033    4921 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:19:00.819997 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808035    4921 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:19:00.819997 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808038    4921 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:19:00.819997 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808041    4921 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:19:00.819997 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808043    4921 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:19:00.819997 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808046    4921 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:19:00.819997 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808048    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:19:00.819997 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808051    4921 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:19:00.819997 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808053    4921 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:19:00.819997 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808056    4921 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:19:00.820451 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.808086    4921 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 23:19:00.820451 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808245    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:19:00.820451 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808251    4921 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:19:00.820451 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808254    4921 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:19:00.820451 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808256    4921 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:19:00.820451 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808259    4921 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:19:00.820451 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808262    4921 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:19:00.820451 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808265    4921 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:19:00.820451 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808268    4921 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:19:00.820451 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808270    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:19:00.820451 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808272    4921 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:19:00.820451 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808275    4921 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:19:00.820451 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808278    4921 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:19:00.820451 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808280    4921 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:19:00.820451 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808283    4921 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:19:00.820451 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808285    4921 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808288    4921 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808290    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808293    4921 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808295    4921 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808298    4921 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808300    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808303    4921 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808305    4921 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808312    4921 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808314    4921 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808317    4921 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808319    4921 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808322    4921 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808325    4921 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808327    4921 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808329    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808332    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808334    4921 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808337    4921 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:19:00.820917 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808340    4921 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:19:00.821523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808342    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:19:00.821523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808344    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:19:00.821523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808347    4921 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:19:00.821523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808350    4921 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:19:00.821523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808353    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:19:00.821523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808355    4921 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:19:00.821523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808358    4921 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:19:00.821523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808360    4921 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:19:00.821523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808363    4921 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:19:00.821523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808365    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:19:00.821523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808368    4921 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:19:00.821523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808370    4921 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:19:00.821523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808373    4921 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:19:00.821523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808379    4921 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:19:00.821523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808382    4921 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:19:00.821523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808384    4921 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:19:00.821523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808387    4921 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:19:00.821523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808389    4921 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:19:00.821523 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808394    4921 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808398    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808402    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808405    4921 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808408    4921 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808410    4921 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808413    4921 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808415    4921 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808418    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808420    4921 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808423    4921 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808425    4921 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808428    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808430    4921 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808432    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808435    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808437    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808440    4921 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808443    4921 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808445    4921 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:19:00.822135 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808448    4921 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:19:00.822820 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808450    4921 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:19:00.822820 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808452    4921 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:19:00.822820 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808455    4921 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:19:00.822820 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808457    4921 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:19:00.822820 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808460    4921 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:19:00.822820 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808462    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:19:00.822820 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808466    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:19:00.822820 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808469    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:19:00.822820 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808472    4921 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:19:00.822820 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808475    4921 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:19:00.822820 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808479    4921 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:19:00.822820 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808481    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:19:00.822820 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808484    4921 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:19:00.822820 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808488    4921 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:19:00.822820 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808491    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:19:00.822820 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808493    4921 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:19:00.822820 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808496    4921 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:19:00.822820 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808498    4921 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:19:00.822820 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808501    4921 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:19:00.823472 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808503    4921 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:19:00.823472 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808506    4921 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:19:00.823472 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808509    4921 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:19:00.823472 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808511    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:19:00.823472 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808514    4921 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:19:00.823472 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808516    4921 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:19:00.823472 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808518    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:19:00.823472 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808521    4921 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:19:00.823472 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808523    4921 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:19:00.823472 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808525    4921 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:19:00.823472 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808528    4921 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:19:00.823472 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808531    4921 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:19:00.823472 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808534    4921 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:19:00.823472 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.808557    4921 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 23:19:00.823472 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808609    4921 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 23:19:00.824092 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808614    4921 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 23:19:00.824092 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808617    4921 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 23:19:00.824092 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808620    4921 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 23:19:00.824092 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808622    4921 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 23:19:00.824092 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808625    4921 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 23:19:00.824092 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808629    4921 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 23:19:00.824092 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808632    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 23:19:00.824092 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808634    4921 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 23:19:00.824092 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808637    4921 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 23:19:00.824092 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808640    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 23:19:00.824092 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808642    4921 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 23:19:00.824092 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808646    4921 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 23:19:00.824092 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808649    4921 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 23:19:00.824092 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808651    4921 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 23:19:00.824092 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808654    4921 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 23:19:00.824092 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808657    4921 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 23:19:00.824092 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808659    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 23:19:00.824092 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808662    4921 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 23:19:00.824092 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808664    4921 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808667    4921 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808669    4921 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808671    4921 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808674    4921 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808676    4921 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808679    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808681    4921 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808683    4921 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808686    4921 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808688    4921 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808691    4921 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808694    4921 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808696    4921 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808699    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808701    4921 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808704    4921 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808706    4921 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808709    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808713    4921 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 23:19:00.824978 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808716    4921 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808718    4921 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808721    4921 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808723    4921 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808726    4921 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808730    4921 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808732    4921 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808735    4921 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808738    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808741    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808743    4921 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808746    4921 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808748    4921 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808751    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808753    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808756    4921 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808758    4921 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808761    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808763    4921 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808765    4921 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 23:19:00.825621 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808768    4921 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 23:19:00.826190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808770    4921 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 23:19:00.826190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808773    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 23:19:00.826190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808775    4921 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 23:19:00.826190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808778    4921 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 23:19:00.826190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808781    4921 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 23:19:00.826190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808784    4921 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 23:19:00.826190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808786    4921 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 23:19:00.826190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808789    4921 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 23:19:00.826190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808791    4921 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 23:19:00.826190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808794    4921 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 23:19:00.826190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808798    4921 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 23:19:00.826190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808803    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 23:19:00.826190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808806    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 23:19:00.826190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808809    4921 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 23:19:00.826190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808812    4921 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 23:19:00.826190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808814    4921 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 23:19:00.826190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808817    4921 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 23:19:00.826190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808820    4921 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 23:19:00.826190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808822    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808825    4921 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808827    4921 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808829    4921 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808832    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808834    4921 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808837    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808839    4921 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808841    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808844    4921 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808846    4921 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808849    4921 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808851    4921 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808853    4921 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808856    4921 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808859    4921 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808861    4921 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808863    4921 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808867    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808870    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 23:19:00.826804 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808872    4921 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 23:19:00.827356 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808875    4921 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 23:19:00.827356 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808880    4921 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 23:19:00.827356 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808883    4921 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 23:19:00.827356 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808886    4921 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 23:19:00.827356 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808889    4921 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 23:19:00.827356 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808892    4921 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 23:19:00.827356 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:00.808895    4921 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 23:19:00.827356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.808958    4921 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 23:19:00.827356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.809966    4921 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 23:19:00.827356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.810023    4921 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 23:19:00.827356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.810201    4921 server.go:1014] "Starting client certificate rotation"
Oct 30 23:19:00.827356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.810340    4921 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 23:19:00.827356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.810392    4921 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 23:13:20 +0000 UTC" deadline="2028-05-30 02:30:20.168600789 +0000 UTC"
Oct 30 23:19:00.827356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.810420    4921 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13851h11m19.358182675s"
Oct 30 23:19:00.827356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.810671    4921 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 23:19:00.827962 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.811787    4921 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 23:19:00.827962 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.813209    4921 log.go:25] "Validated CRI v1 runtime API"
Oct 30 23:19:00.827962 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.814841    4921 log.go:25] "Validated CRI v1 image API"
Oct 30 23:19:00.827962 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.815533    4921 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 23:19:00.827962 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.817370    4921 fs.go:135] Filesystem UUIDs: map[44f0ccee-8286-4022-9b7e-b88c2a50ea91:/dev/nvme0n1p4 7814ac1c-2b8b-4c77-ad9c-bec2aac44828:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Oct 30 23:19:00.828145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.817390    4921 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0343f872b6a8a39ba35e68b6956ee5712ee6265093488876bc05232087a5ecab/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0343f872b6a8a39ba35e68b6956ee5712ee6265093488876bc05232087a5ecab/userdata/shm major:0 minor:89 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/11f4b7233fc31d031b117f6d34fde2707abff54bc266540ef6b6204aab996ca7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/11f4b7233fc31d031b117f6d34fde2707abff54bc266540ef6b6204aab996ca7/userdata/shm major:0 minor:239 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/265726a449123c1007f6111f0187069ff4ba5e419c3797f1230931a64c1f483f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/265726a449123c1007f6111f0187069ff4ba5e419c3797f1230931a64c1f483f/userdata/shm major:0 minor:230 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/26f68d670e44867d09a6870a368be80cefd7bf4c4da0c7c5d01810915fbc2eba/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/26f68d670e44867d09a6870a368be80cefd7bf4c4da0c7c5d01810915fbc2eba/userdata/shm major:0 minor:294 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2a581223b6a0bc240f6f015313ae331cb0eded56903e9e6747b69be989f868a7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2a581223b6a0bc240f6f015313ae331cb0eded56903e9e6747b69be989f868a7/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2f98509d2c5ffce944506e79c6084c198cc9914cbcfd7f12cf2eaf7d758d7c41/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2f98509d2c5ffce944506e79c6084c198cc9914cbcfd7f12cf2eaf7d758d7c41/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2fff18e2c3dd870d20aaf9d2f9493ea6127941a9079b5705f503452f63a755e9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2fff18e2c3dd870d20aaf9d2f9493ea6127941a9079b5705f503452f63a755e9/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/438e2fc7da1da7391df2574b5d6dfa2a435cf526c1d2ef9788929819760863d4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/438e2fc7da1da7391df2574b5d6dfa2a435cf526c1d2ef9788929819760863d4/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/465a8aaae3501fb41ec0b94440bd0cca1036817707c4468cc45cfd97f0d3e60e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/465a8aaae3501fb41ec0b94440bd0cca1036817707c4468cc45cfd97f0d3e60e/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/46a3ab18ff88bca35356591220f065d38e9fc5c3db97add10d8979cf199da26e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/46a3ab18ff88bca35356591220f065d38e9fc5c3db97add10d8979cf199da26e/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/54a2f1eeec5a024e21ab7d75b23f95d8bf050669fbf984aeca448dd7385434c5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/54a2f1eeec5a024e21ab7d75b23f95d8bf050669fbf984aeca448dd7385434c5/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5d2f44ce8f28e7c05dd734fd61b25bd1364701feb5f0152a4c6d73c62dc453a9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5d2f44ce8f28e7c05dd734fd61b25bd1364701feb5f0152a4c6d73c62dc453a9/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/75743a85f02fdc5fac445ecc7a98dbca88d7047474d96dc08377e2ba8467cda9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/75743a85f02fdc5fac445ecc7a98dbca88d7047474d96dc08377e2ba8467cda9/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/75f808bfea551f6dba711257acdfb614cbcb3d476ffb07a72e35555a7a6a35df/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/75f808bfea551f6dba711257acdfb614cbcb3d476ffb07a72e35555a7a6a35df/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/77e593a89bbeb1013ba6739b91b273c7ca92065617d266d9dd794631c40eb116/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/77e593a89bbeb1013ba6739b91b273c7ca92065617d266d9dd794631c40eb116/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7ed8ffb072f8f912613db8e51dca5fa6f57e4c121fdf050b852ce02c03c3248c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7ed8ffb072f8f912613db8e51dca5fa6f57e4c121fdf050b852ce02c03c3248c/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9721ca05ece86f1ab8994e2ff5dcffb9f38efab1f240cda7154bb2af27c56aef/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9721ca05ece86f1ab8994e2ff5dcffb9f38efab1f240cda7154bb2af27c56aef/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9dbf9d7ad4443212e8208f0481360d30dbba209b7ad5ec315257f930efc9dd6f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9dbf9d7ad4443212e8208f0481360d30dbba209b7ad5ec315257f930efc9dd6f/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a1cebb79bcf702596831550d1591c21eeba29e71ffc66e0af4d3b190c40a5b88/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a1cebb79bcf702596831550d1591c21eeba29e71ffc66e0af4d3b190c40a5b88/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b0bf97023590b3ba24ea658a863f88f97597de22055799aec6b1eccf63774fd5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b0bf97023590b3ba24ea658a863f88f97597de22055799aec6b1eccf63774fd5/userdata/shm major:0 minor:295 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b0dfc5540bd89514967418b9d9b5315404edfce6ca3850573d37a645cabb72fc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b0dfc5540bd89514967418b9d9b5315404edfce6ca3850573d37a645cabb72fc/userdata/shm major:0 minor:328 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d9775b0ac6cce8d3f0355b410044de28020bc4780b4c13536a36ed4d913ea581/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d9775b0ac6cce8d3f0355b410044de28020bc4780b4c13536a36ed4d913ea581/userdata/shm major:0 minor:241 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fb41cc09d0b7611a512e13fe4212b4ff8cd572d88c9002c98ce5c7d4383e1b81/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fb41cc09d0b7611a512e13fe4212b4ff8cd572d88c9002c98ce5c7d4383e1b81/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/11f70cd2-d0b3-4a44-b936-1659972c6605/volumes/kubernetes.io~projected/kube-api-access-9vg5p:{mountpoint:/var/lib/kubelet/pods/11f70cd2-d0b3-4a44-b936-1659972c6605/volumes/kubernetes.io~projected/kube-api-access-9vg5p major:0 minor:276 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1cfc2d59-558a-4f8a-8f23-59fe4b78dd17/volumes/kubernetes.io~projected/kube-api-access-gm2kg:{mountpoint:/var/lib/kubelet/pods/1cfc2d59-558a-4f8a-8f23-59fe4b78dd17/volumes/kubernetes.io~projected/kube-api-access-gm2kg major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2074c06c-0759-4701-9a2d-48f024879fb2/volumes/kubernetes.io~projected/kube-api-access-7p2kb:{mountpoint:/var/lib/kubelet/pods/2074c06c-0759-4701-9a2d-48f024879fb2/volumes/kubernetes.io~projected/kube-api-access-7p2kb major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/23c01b5c-af64-4567-9350-41572e762182/volumes/kubernetes.io~projected/kube-api-access-pl7lx:{mountpoint:/var/lib/kubelet/pods/23c01b5c-af64-4567-9350-41572e762182/volumes/kubernetes.io~projected/kube-api-access-pl7lx major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/volumes/kubernetes.io~projected/kube-api-access-cz5d8:{mountpoint:/var/lib/kubelet/pods/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/volumes/kubernetes.io~projected/kube-api-access-cz5d8 major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/volumes/kubernetes.io~secret/serving-cert major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/499f7257-2e41-413c-b6b7-12089b9514a7/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/499f7257-2e41-413c-b6b7-12089b9514a7/volumes/kubernetes.io~secret/agent-certs major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/53725f0f-4d8e-4270-b319-3943c040f794/volumes/kubernetes.io~projected/kube-api-access-2xxsh:{mountpoint:/var/lib/kubelet/pods/53725f0f-4d8e-4270-b319-3943c040f794/volumes/kubernetes.io~projected/kube-api-access-2xxsh major:0 minor:323 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/54c28267-55bc-4f8e-bb07-47e47951468d/volumes/kubernetes.io~projected/kube-api-access-pbp7k:{mountpoint:/var/lib/kubelet/pods/54c28267-55bc-4f8e-bb07-47e47951468d/volumes/kubernetes.io~projected/kube-api-access-pbp7k major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ba7c1ba-4162-430e-b267-ebf3f9844750/volumes/kubernetes.io~projected/kube-api-access-tzfpp:{mountpoint:/var/lib/kubelet/pods/5ba7c1ba-4162-430e-b267-ebf3f9844750/volumes/kubernetes.io~projected/kube-api-access-tzfpp major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/66938436-5c78-44c3-93f6-f52272cc9a6a/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/66938436-5c78-44c3-93f6-f52272cc9a6a/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/66938436-5c78-44c3-93f6-f52272cc9a6a/volumes/kubernetes.io~projected/kube-api-access-vkt4n:{mountpoint:/var/lib/kubelet/pods/66938436-5c78-44c3-93f6-f52272cc9a6a/volumes/kubernetes.io~projected/kube-api-access-vkt4n major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/66938436-5c78-44c3-93f6-f52272cc9a6a/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/66938436-5c78-44c3-93f6-f52272cc9a6a/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/67fa89c3-92f0-4ead-871a-45446e25aad5/volumes/kubernetes.io~projected/kube-api-access-p56mc:{mountpoint:/var/lib/kubelet/pods/67fa89c3-92f0-4ead-871a-45446e25aad5/volumes/kubernetes.io~projected/kube-api-access-p56mc major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d27d7b3-0f5f-4604-86b1-eeb9d380104f/volumes/kubernetes.io~projected/kube-api-access-csc8h:{mountpoint:/var/lib/kubelet/pods/6d27d7b3-0f5f-4604-86b1-eeb9d380104f/volumes/kubernetes.io~projected/kube-api-access-csc8h major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8e911a1c-c73e-40ed-ba22-74845a60e738/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/8e911a1c-c73e-40ed-ba22-74845a60e738/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8e911a1c-c73e-40ed-ba22-74845a60e738/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/8e911a1c-c73e-40ed-ba22-74845a60e738/volumes/kubernetes.io~empty-dir/tmp major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8e911a1c-c73e-40ed-ba22-74845a60e738/volumes/kubernetes.io~projected/kube-api-access-x6flp:{mountpoint:/var/lib/kubelet/pods/8e911a1c-c73e-40ed-ba22-74845a60e738/volumes/kubernetes.io~projected/kube-api-access-x6flp major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9047f37e-2d3c-4978-a5c1-4078d505ab15/volumes/kubernetes.io~projected/kube-api-access-698bb:{mountpoint:/var/lib/kubelet/pods/9047f37e-2d3c-4978-a5c1-4078d505ab15/volumes/kubernetes.io~projected/kube-api-access-698bb major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a73f11a7-b4de-43b4-83de-cc7a630d25c3/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/a73f11a7-b4de-43b4-83de-cc7a630d25c3/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a73f11a7-b4de-43b4-83de-cc7a630d25c3/volumes/kubernetes.io~projected/kube-api-access-hmdlw:{mountpoint:/var/lib/kubelet/pods/a73f11a7-b4de-43b4-83de-cc7a630d25c3/volumes/kubernetes.io~projected/kube-api-access-hmdlw major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a73f11a7-b4de-43b4-83de-cc7a630d25c3/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/a73f11a7-b4de-43b4-83de-cc7a630d25c3/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a73f11a7-b4de-43b4-83de-cc7a630d25c3/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/a73f11a7-b4de-43b4-83de-cc7a630d25c3/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aa5373ec-3489-4bd2-80e0-ad75abead9e6/volumes/kubernetes.io~projected/kube-api-access-hhcnh:{mountpoint:/var/lib/kubelet/pods/aa5373ec-3489-4bd2-80e0-ad75abead9e6/volumes/kubernetes.io~projected/kube-api-access-hhcnh major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b1846d39-a52a-442d-8216-10f0798dbc36/volumes/kubernetes.io~projected/kube-api-access-g9rvq:{mountpoint:/var/lib/kubelet/pods/b1846d39-a52a-442d-8216-10f0798dbc36/volumes/kubernetes.io~projected/kube-api-access-g9rvq major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b1846d39-a52a-442d-8216-10f0798dbc36/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/b1846d39-a52a-442d-8216-10f0798dbc36/volumes/kubernetes.io~secret/cert major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b1d1b3c8-a603-476b-b51d-8add45d50b13/volumes/kubernetes.io~projected/kube-api-access-l9pl4:{mountpoint:/var/lib/kubelet/pods/b1d1b3c8-a603-476b-b51d-8add45d50b13/volumes/kubernetes.io~projected/kube-api-access-l9pl4 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3d1c4c4-03be-43ef-a2e4-bfc406dc7aca/volumes/kubernetes.io~projected/kube-api-access-9mrrm:{mountpoint:/var/lib/kubelet/pods/b3d1c4c4-03be-43ef-a2e4-bfc406dc7aca/volumes/kubernetes.io~projected/kube-api-access-9mrrm major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b710ad88-e867-4ea3-a13b-394eb3d34c89/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/b710ad88-e867-4ea3-a13b-394eb3d34c89/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b710ad88-e867-4ea3-a13b-394eb3d34c89/volumes/kubernetes.io~projected/kube-api-access-v7szx:{mountpoint:/var/lib/kubelet/pods/b710ad88-e867-4ea3-a13b-394eb3d34c89/volumes/kubernetes.io~projected/kube-api-access-v7szx major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b710ad88-e867-4ea3-a13b-394eb3d34c89/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/b710ad88-e867-4ea3-a13b-394eb3d34c89/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b710ad88-e867-4ea3-a13b-394eb3d34c89/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/b710ad88-e867-4ea3-a13b-394eb3d34c89/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bb5e9511-9532-4de4-9f4c-5e034cca2773/volumes/kubernetes.io~projected/kube-api-access-kxnxf:{mountpoint:/var/lib/kubelet/pods/bb5e9511-9532-4de4-9f4c-5e034cca2773/volumes/kubernetes.io~projected/kube-api-access-kxnxf major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bb5e9511-9532-4de4-9f4c-5e034cca2773/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/bb5e9511-9532-4de4-9f4c-5e034cca2773/volumes/kubernetes.io~secret/serving-cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bdb399c5-bad6-4310-9542-509884ea425a/volumes/kubernetes.io~projected/kube-api-access-r9lbz:{mountpoint:/var/lib/kubelet/pods/bdb399c5-bad6-4310-9542-509884ea425a/volumes/kubernetes.io~projected/kube-api-access-r9lbz major:0 minor:322 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d3c8853f-5927-4411-b293-0030e7f43312/volumes/kubernetes.io~projected/kube-api-access-g47ks:{mountpoint:/var/lib/kubelet/pods/d3c8853f-5927-4411-b293-0030e7f43312/volumes/kubernetes.io~projected/kube-api-access-g47ks major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dc691df1-3f27-4829-955d-99b66893279d/volumes/kubernetes.io~projected/kube-api-access-t2v4q:{mountpoint:/var/lib/kubelet/pods/dc691df1-3f27-4829-955d-99b66893279d/volumes/kubernetes.io~projected/kube-api-access-t2v4q major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/deb3bcf9-5f63-469d-b5d5-c5d62ffada99/volumes/kubernetes.io~projected/kube-api-access-cbxgf:{mountpoint:/var/lib/kubelet/pods/deb3bcf9-5f63-469d-b5d5-c5d62ffada99/volumes/kubernetes.io~projected/kube-api-access-cbxgf major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6/volumes/kubernetes.io~projected/kube-api-access-j5qdd:{mountpoint:/var/lib/kubelet/pods/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6/volumes/kubernetes.io~projected/kube-api-access-j5qdd major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6/volumes/kubernetes.io~secret/serving-cert major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b/volumes/kubernetes.io~projected/kube-api-access-bq7m6:{mountpoint:/var/lib/kubelet/pods/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b/volumes/kubernetes.io~projected/kube-api-access-bq7m6 major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b/volumes/kubernetes.io~secret/default-certificate major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b/volumes/kubernetes.io~secret/stats-auth major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f9a4c974-1f79-40b2-9f49-427170c8764b/volumes/kubernetes.io~projected/kube-api-access-qzp75:{mountpoint:/var/lib/kubelet/pods/f9a4c974-1f79-40b2-9f49-427170c8764b/volumes/kubernetes.io~projected/kube-api-access-qzp75 major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f9a4c974-1f79-40b2-9f49-427170c8764b/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/f9a4c974-1f79-40b2-9f49-427170c8764b/volumes/kubernetes.io~secret/serving-cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ff444d55-69cb-484d-a989-9dcd7b96524f/volumes/kubernetes.io~projected/kube-api-access-mjqgs:{mountpoint:/var/lib/kubelet/pods/ff444d55-69cb-484d-a989-9dcd7b96524f/volumes/kubernetes.io~projected/kube-api-access-mjqgs major:0 minor:67 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/4c14498761dfde3a2a4b682514032c4ddef5a70d2911babc30fe4228300fc9d0/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/14e28f2aaddada1af47114ab058c88bfcc5744068f10a4defd0bceb6b1bcc023/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/5ff0de3ecf98c41dc0f82bdba56bc70ee293d0968c893aa45ca88081968dd376/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/5ac11339072e99e58e20f9cbb970fd5c8cfabf413a02d4d7f3ed90ac20196152/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/782c9ad4a028a1eb3883fac05d6152faa0be75517a879ab87df62dcba8c00352/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/9f5bcd6e790022412e17eac6cfd86d6ae171ce8491b3e3862ffab45f12a7e211/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/6f1529d595bb079bcde65c1b0df31711d33eaab4b2b7368101d8ff1ca93fbc6a/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/60547ac0c2dc8937aa70d9bb08a43c54a4eb99c21e59cfa50e3c53aa55a343d2/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-129:{mountpoint:/var/lib/containers/storage/overlay/5e3defe5fb5d49785ce2d7e5db0ec4d4671941a68aedcc82d7a68649eff188e2/merged major:0 minor:129 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/a2b398053ff4dd4d4a9e924faf592ddf14b8d0cb939355d87db4510bf3266071/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/cbe4ceb2c7a7866d1527f9ac144bb7560a039808e7c1e59c4bcc51a5d952a59b/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-146:{mountpoint:/var/lib/containers/storage/overlay/37e9a9478fcfc3f2f9c7c36e1e3e4a65dc79035b652c19b6fbf75486be0d781a/merged major:0 minor:146 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/279bde5002c9c28c5ac78d231aec24edb2c8de4f10b863f8c2aa96f0178d9d89/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/eee595e4ed8bbe6c14d0f48ad33071e9cd0ab828a1dc6aec19db32d7be19e6ca/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/d1cac14f10c18a3b5edd3f379f6626b3bbf5332dd59a8c4f4fc7aff675e7533c/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/965bca6179dcd1d5d34c6f73a39c0ef7ec1be8c1165e65ba9fee51885463fa04/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/ef690ed96bdf6164511e89aaea58e123d32eff4503557e123ff4bd9d75d85156/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/61df2f7d8514bd1310bee88db52c9cefb624b8cd6f53079fa08177a7aaea699d/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/c1e70296ad589460a8bc2455422e73a6c359e252478523cba0e5afc2324fcd3c/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/e5b6bbcb5649985fa81a75114e4c61a1a81eaec0f5719d3831ec5ba256fff2fb/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/9fbe1c5dcafdba70e7e8db04de6e2bf884bac0ab7d7bb28b9058aac2a7f14f54/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/994ecf0851870eddfe1b2d1fea243f54197d9a46296b70d54e20cce1348126a4/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/c5e0e42726247197f08c63d8faefbc262291010128721bae510e1654afdf1455/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/5552a88c7dd1e37a134fdfca39d5a07860cf60f74d60b2b60fdd9ae9ff54adef/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/26e22ffcb6bd34ef4ba4e558c83c92095bdd505849cfee51c09ec5add7526d9e/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/c1e26049087fc907e37b9e351f95d48b4402dbcd9216dd26da7dfd513df5f137/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/5a3d01f9c27a85fa061a9a525cc0a22e2ee2a80148b8be8c8ae6671802ee0a41/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/ec6997d350d30332f825dcf8d1395ca2c9e9aaa08a542bdf62f2b4d2d17df367/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/65d0df56cefd3ba393ce954b1564635345d42ab7d5457c1c89c81b4cb5a76eb0/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/290b1ad6141f6c921e457bb4b0497f3f55a87e30ee53e690524c0a9fa0da7093/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/d4c012017c7066689e3e30fcfdd7a26fe9ecb15b4c147243311a894dfa31f77d/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/68c1be782c2ae0c669e0c1a7ae85beabdb529369830bf38ad52ad0c53b559761/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-270:{mountpoint:/var/lib/containers/storage/overlay/8dbc30520ef4fb8b9138f6fceb54277da2245f0a009413e96b1a7f3a683bee73/merged major:0 minor:270 fsType:overlay blockSize:0} overlay_0-272:{mountpoint:/var/lib/containers/storage/overlay/453383bc277ba71bb28d9c91e3ae3fe500e8d60cad81507208bdbaaab3d2ef59/merged major:0 minor:272 fsType:overlay blockSize:0} overlay_0-274:{mountpoint:/var/lib/containers/storage/overlay/207bdae038995293dca2eebe8154de5d0c32ea4eb369678ea90a199a9e443623/merged major:0 minor:274 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/c0f30729677759f823f4904e258771d24291baabfa6e8df66fe6169b497bed54/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/4d362ec0430423ec15180000e72409baaac77df61c6822899b9257f9fc98b22f/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/32ac0cbd82adf0845d2912f653c7023103a842e9215c88383a8bb3d2ce72c30c/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/89285d9ddd6311bd13babbbc25842cd38a579207cd7e9294c2c7df6197896c36/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-306:{mountpoint:/var/lib/containers/storage/overlay/1786f6b104f672fc408d63253145d6e7bd4018c3570f83c95ecd914abec0e967/merged major:0 minor:306 fsType:overlay blockSize:0} overlay_0-316:{mountpoint:/var/lib/containers/storage/overlay/15e4cbf9549c84982cd552e57a44442332a6ce7d69dc043be8df392d7c4deabe/merged major:0 minor:316 fsType:overlay blockSize:0} overlay_0-330:{mountpoint:/var/lib/containers/storage/overlay/550713281e25aa26f1f02f4cb1c39228296964095fd013d53e6e93f1ef815ded/merged major:0 minor:330 fsType:overlay blockSize:0} overlay_0-332:{mountpoint:/var/lib/containers/storage/overlay/49f87be7cbd17804582b9bdab0ccf38a74dc1bf81181b3690f97447452cf3595/merged major:0 minor:332 fsType:overlay blockSize:0} overlay_0-334:{mountpoint:/var/lib/containers/storage/overlay/738097155b368a8be1550254a219eeb2ccef23b1383a4dc9005bfc8f6bf01454/merged major:0 minor:334 fsType:overlay blockSize:0} overlay_0-340:{mountpoint:/var/lib/containers/storage/overlay/0bc949208e6c8dcc7d01f9f1f1f0bd609a3efae078758299e18cde192c2e44b4/merged major:0 minor:340 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/8ab1ee16ad4af09b5370b4985beee1bb89742af519194043451c123d0c810639/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-49:{mountpoint:/var/lib/containers/storage/overlay/8e37beacf4dd14b374317a56e64c7cd64b7c04c7f6edc511c2d07fef9c41a61c/merged major:0 minor:49 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/b962676c276bd3cdd641145b55e9afa1f5571a9c0e4ea4418712576bd91a50c2/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/4e62f6030d201cb8045e89969e3b29b96dd9f6252dab76cdbea18475f6a4f34f/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/1f1734044e4477d6f79e88bb4bf47dd55a7d3a526d0520930128e20d497c9059/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/1ca74e10c1c427d05701c16b5ed240fef493fb22dedce6a6b1a7eec92db065fe/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-81:{mountpoint:/var/lib/containers/storage/overlay/7c0530234cc86d6a372e9ee23379c84845958e4d1e5038164a270231ea2abb4b/merged major:0 minor:81 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/ecfa59ef2804213da9b59573cebd23b0f0716973101a897bdbd0d38a890f747b/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/0bcc3dd2ab6dc18403ea2abad20161e408effbacc368ec6bd448599b3934433a/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/8795ad26efb7c8ec7e543d7f4d6a9e119571ff83ed35f262ec17bf1841524283/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/84986026ceee6c3eb6e1feb7d2574472c00300dd1ba50af2ff787a1a0be94a82/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 23:19:00.828519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.826452    4921 manager.go:217] Machine: {Timestamp:2026-10-30 23:19:00.825949365 +0000 UTC m=+0.070805123 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099605 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b1defd723cf0874fc4a86446bec91 SystemUUID:ec2b1def-d723-cf08-74fc-4a86446bec91 BootID:e1f92c97-a55a-4be2-8e79-6815f9394da5 Filesystems:[{Device:/var/lib/kubelet/pods/6d27d7b3-0f5f-4604-86b1-eeb9d380104f/volumes/kubernetes.io~projected/kube-api-access-csc8h DeviceMajor:0 DeviceMinor:58 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/23c01b5c-af64-4567-9350-41572e762182/volumes/kubernetes.io~projected/kube-api-access-pl7lx DeviceMajor:0 DeviceMinor:63 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b1d1b3c8-a603-476b-b51d-8add45d50b13/volumes/kubernetes.io~projected/kube-api-access-l9pl4 DeviceMajor:0 DeviceMinor:59 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:207 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2f98509d2c5ffce944506e79c6084c198cc9914cbcfd7f12cf2eaf7d758d7c41/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-330 DeviceMajor:0 DeviceMinor:330 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/465a8aaae3501fb41ec0b94440bd0cca1036817707c4468cc45cfd97f0d3e60e/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fb41cc09d0b7611a512e13fe4212b4ff8cd572d88c9002c98ce5c7d4383e1b81/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-81 DeviceMajor:0 DeviceMinor:81 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7ed8ffb072f8f912613db8e51dca5fa6f57e4c121fdf050b852ce02c03c3248c/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b/volumes/kubernetes.io~projected/kube-api-access-bq7m6 DeviceMajor:0 DeviceMinor:224 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b1846d39-a52a-442d-8216-10f0798dbc36/volumes/kubernetes.io~projected/kube-api-access-g9rvq DeviceMajor:0 DeviceMinor:225 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-340 DeviceMajor:0 DeviceMinor:340 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5d2f44ce8f28e7c05dd734fd61b25bd1364701feb5f0152a4c6d73c62dc453a9/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/75743a85f02fdc5fac445ecc7a98dbca88d7047474d96dc08377e2ba8467cda9/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f9a4c974-1f79-40b2-9f49-427170c8764b/volumes/kubernetes.io~projected/kube-api-access-qzp75 DeviceMajor:0 DeviceMinor:216 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bdb399c5-bad6-4310-9542-509884ea425a/volumes/kubernetes.io~projected/kube-api-access-r9lbz DeviceMajor:0 DeviceMinor:322 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b0bf97023590b3ba24ea658a863f88f97597de22055799aec6b1eccf63774fd5/userdata/shm DeviceMajor:0 DeviceMinor:295 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/8e911a1c-c73e-40ed-ba22-74845a60e738/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:55 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ff444d55-69cb-484d-a989-9dcd7b96524f/volumes/kubernetes.io~projected/kube-api-access-mjqgs DeviceMajor:0 DeviceMinor:67 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-129 DeviceMajor:0 DeviceMinor:129 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a73f11a7-b4de-43b4-83de-cc7a630d25c3/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:204 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a73f11a7-b4de-43b4-83de-cc7a630d25c3/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:206 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/bb5e9511-9532-4de4-9f4c-5e034cca2773/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:201 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2074c06c-0759-4701-9a2d-48f024879fb2/volumes/kubernetes.io~projected/kube-api-access-7p2kb DeviceMajor:0 DeviceMinor:211 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d9775b0ac6cce8d3f0355b410044de28020bc4780b4c13536a36ed4d913ea581/userdata/shm DeviceMajor:0 DeviceMinor:241 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-270 DeviceMajor:0 DeviceMinor:270 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:293 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9721ca05ece86f1ab8994e2ff5dcffb9f38efab1f240cda7154bb2af27c56aef/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a73f11a7-b4de-43b4-83de-cc7a630d25c3/volumes/kubernetes.io~projected/kube-api-access-hmdlw DeviceMajor:0 DeviceMinor:218 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-334 DeviceMajor:0 DeviceMinor:334 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9dbf9d7ad4443212e8208f0481360d30dbba209b7ad5ec315257f930efc9dd6f/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2a581223b6a0bc240f6f015313ae331cb0eded56903e9e6747b69be989f868a7/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/66938436-5c78-44c3-93f6-f52272cc9a6a/volumes/kubernetes.io~projected/kube-api-access-vkt4n DeviceMajor:0 DeviceMinor:60 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-146 DeviceMajor:0 DeviceMinor:146 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d3c8853f-5927-4411-b293-0030e7f43312/volumes/kubernetes.io~projected/kube-api-access-g47ks DeviceMajor:0 DeviceMinor:221 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:208 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5ba7c1ba-4162-430e-b267-ebf3f9844750/volumes/kubernetes.io~projected/kube-api-access-tzfpp DeviceMajor:0 DeviceMinor:223 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-316 DeviceMajor:0 DeviceMinor:316 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6/volumes/kubernetes.io~projected/kube-api-access-j5qdd DeviceMajor:0 DeviceMinor:227 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b0dfc5540bd89514967418b9d9b5315404edfce6ca3850573d37a645cabb72fc/userdata/shm DeviceMajor:0 DeviceMinor:328 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/9047f37e-2d3c-4978-a5c1-4078d505ab15/volumes/kubernetes.io~projected/kube-api-access-698bb DeviceMajor:0 DeviceMinor:65 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/499f7257-2e41-413c-b6b7-12089b9514a7/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:66 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/deb3bcf9-5f63-469d-b5d5-c5d62ffada99/volumes/kubernetes.io~projected/kube-api-access-cbxgf DeviceMajor:0 DeviceMinor:61 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b3d1c4c4-03be-43ef-a2e4-bfc406dc7aca/volumes/kubernetes.io~projected/kube-api-access-9mrrm DeviceMajor:0 DeviceMinor:212 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a73f11a7-b4de-43b4-83de-cc7a630d25c3/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:220 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/265726a449123c1007f6111f0187069ff4ba5e419c3797f1230931a64c1f483f/userdata/shm DeviceMajor:0 DeviceMinor:230 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/438e2fc7da1da7391df2574b5d6dfa2a435cf526c1d2ef9788929819760863d4/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0343f872b6a8a39ba35e68b6956ee5712ee6265093488876bc05232087a5ecab/userdata/shm DeviceMajor:0 DeviceMinor:89 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:202 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/aa5373ec-3489-4bd2-80e0-ad75abead9e6/volumes/kubernetes.io~projected/kube-api-access-hhcnh DeviceMajor:0 DeviceMinor:213 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-274 DeviceMajor:0 DeviceMinor:274 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/66938436-5c78-44c3-93f6-f52272cc9a6a/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/b710ad88-e867-4ea3-a13b-394eb3d34c89/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:209 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b710ad88-e867-4ea3-a13b-394eb3d34c89/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:215 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/bb5e9511-9532-4de4-9f4c-5e034cca2773/volumes/kubernetes.io~projected/kube-api-access-kxnxf DeviceMajor:0 DeviceMinor:222 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/46a3ab18ff88bca35356591220f065d38e9fc5c3db97add10d8979cf199da26e/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-332 DeviceMajor:0 DeviceMinor:332 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8e911a1c-c73e-40ed-ba22-74845a60e738/volumes/kubernetes.io~projected/kube-api-access-x6flp DeviceMajor:0 DeviceMinor:62 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b710ad88-e867-4ea3-a13b-394eb3d34c89/volumes/kubernetes.io~projected/kube-api-access-v7szx DeviceMajor:0 DeviceMinor:214 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1cfc2d59-558a-4f8a-8f23-59fe4b78dd17/volumes/kubernetes.io~projected/kube-api-access-gm2kg DeviceMajor:0 DeviceMinor:226 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-272 DeviceMajor:0 DeviceMinor:272 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-306 DeviceMajor:0 DeviceMinor:306 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/75f808bfea551f6dba711257acdfb614cbcb3d476ffb07a72e35555a7a6a35df/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-49 DeviceMajor:0 DeviceMinor:49 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/11f70cd2-d0b3-4a44-b936-1659972c6605/volumes/kubernetes.io~projected/kube-api-access-9vg5p DeviceMajor:0 DeviceMinor:276 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a1cebb79bcf702596831550d1591c21eeba29e71ffc66e0af4d3b190c40a5b88/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/11f4b7233fc31d031b117f6d34fde2707abff54bc266540ef6b6204aab996ca7/userdata/shm DeviceMajor:0 DeviceMinor:239 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/54a2f1eeec5a024e21ab7d75b23f95d8bf050669fbf984aeca448dd7385434c5/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f9a4c974-1f79-40b2-9f49-427170c8764b/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:203 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b1846d39-a52a-442d-8216-10f0798dbc36/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:205 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/dc691df1-3f27-4829-955d-99b66893279d/volumes/kubernetes.io~projected/kube-api-access-t2v4q DeviceMajor:0 DeviceMinor:210 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/volumes/kubernetes.io~projected/kube-api-access-cz5d8 DeviceMajor:0 DeviceMinor:219 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b710ad88-e867-4ea3-a13b-394eb3d34c89/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:45 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:197 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/66938436-5c78-44c3-93f6-f52272cc9a6a/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:57 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2fff18e2c3dd870d20aaf9d2f9493ea6127941a9079b5705f503452f63a755e9/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/26f68d670e44867d09a6870a368be80cefd7bf4c4da0c7c5d01810915fbc2eba/userdata/shm DeviceMajor:0 DeviceMinor:294 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/77e593a89bbeb1013ba6739b91b273c7ca92065617d266d9dd794631c40eb116/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8e911a1c-c73e-40ed-ba22-74845a60e738/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:56 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/67fa89c3-92f0-4ead-871a-45446e25aad5/volumes/kubernetes.io~projected/kube-api-access-p56mc DeviceMajor:0 DeviceMinor:217 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/54c28267-55bc-4f8e-bb07-47e47951468d/volumes/kubernetes.io~projected/kube-api-access-pbp7k DeviceMajor:0 DeviceMinor:64 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/53725f0f-4d8e-4270-b319-3943c040f794/volumes/kubernetes.io~projected/kube-api-access-2xxsh DeviceMajor:0 DeviceMinor:323 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:11f4b7233fc31d0 MacAddress:96:ed:e4:bd:f2:1d Speed:10000 Mtu:8901} {Name:265726a449123c1 MacAddress:c2:54:3a:33:15:1f Speed:10000 Mtu:8901} {Name:26f68d670e44867 MacAddress:7a:90:bd:13:93:9e Speed:10000 Mtu:8901} {Name:2f98509d2c5ffce MacAddress:0e:45:79:59:3b:02 Speed:10000 Mtu:8901} {Name:438e2fc7da1da73 MacAddress:2a:9c:3f:bb:b0:6e Speed:10000 Mtu:8901} {Name:465a8aaae3501fb MacAddress:76:78:10:68:d4:df Speed:10000 Mtu:8901} {Name:46a3ab18ff88bca MacAddress:46:ac:6b:4c:dd:d5 Speed:10000 Mtu:8901} {Name:54a2f1eeec5a024 MacAddress:d2:f3:33:5c:2e:55 Speed:10000 Mtu:8901} {Name:75f808bfea551f6 MacAddress:fe:df:38:be:bd:c0 Speed:10000 Mtu:8901} {Name:77e593a89bbeb10 MacAddress:a6:77:cd:17:3a:22 Speed:10000 Mtu:8901} {Name:b0bf97023590b3b MacAddress:9a:ea:06:8c:94:a1 Speed:10000 Mtu:8901} {Name:b0dfc5540bd8951 MacAddress:9e:ae:09:3b:90:7c Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:c5:1f:19:63 Speed:0 Mtu:9001} {Name:br-int MacAddress:26:c1:80:06:b6:80 Speed:0 Mtu:8901} {Name:d9775b0ac6cce8d MacAddress:22:90:73:51:de:f6 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:c5:1f:19:63 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:0e:cc:36:b6:61:c6 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:06:4b:e3:c4:bf:69 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 23:19:00.828519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.826823    4921 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 23:19:00.828519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.826870    4921 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 23:19:00.828519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.827125    4921 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 23:19:00.828519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.827141    4921 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-208.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 23:19:00.828519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.827269    4921 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 23:19:00.828519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.827277    4921 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 23:19:00.828519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.827286    4921 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 23:19:00.828519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.827305    4921 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 23:19:00.828519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.827322    4921 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 23:19:00.828519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.827465    4921 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 23:19:00.828519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.827581    4921 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 23:19:00.828519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.827632    4921 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 23:19:00.828519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.827646    4921 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 23:19:00.828519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.827664    4921 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 23:19:00.828519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.827679    4921 kubelet.go:405] "Adding apiserver pod source"
Oct 30 23:19:00.828519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.827691    4921 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 23:19:00.828519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.828502    4921 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 23:19:00.828519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.828512    4921 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 23:19:00.829493 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.829006    4921 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 23:19:00.831363 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.831344    4921 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 23:19:00.831363 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.831359    4921 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 23:19:00.831530 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.831466    4921 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 23:19:00.831760 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.831743    4921 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 23:19:00.831824 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.831785    4921 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 23:19:00.831908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.831897    4921 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 23:19:00.831972 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.831918    4921 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 23:19:00.831972 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.831929    4921 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 23:19:00.831972 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.831938    4921 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 23:19:00.831972 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.831946    4921 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 23:19:00.831972 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.831955    4921 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 23:19:00.831972 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.831965    4921 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 23:19:00.832252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.831974    4921 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 23:19:00.832252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.831984    4921 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 23:19:00.832252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.831994    4921 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 23:19:00.832252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.832015    4921 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 23:19:00.832252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.832029    4921 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 23:19:00.832252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.832066    4921 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 23:19:00.832252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.832075    4921 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 23:19:00.835564 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.835547    4921 server.go:1263] "Started kubelet"
Oct 30 23:19:00.835674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.835631    4921 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 23:19:00.836069 ip-10-0-142-208 systemd[1]: Started Kubernetes Kubelet.
Oct 30 23:19:00.836217 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.836020    4921 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 23:19:00.836217 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.836110    4921 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 23:19:00.844140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.836400    4921 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 23:19:00.844140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.837707    4921 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 23:19:00.844140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.840941    4921 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 23:19:00.844140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.840957    4921 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 23:19:00.844140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.841040    4921 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 23:13:22 +0000 UTC" deadline="2028-05-14 00:06:00.559799943 +0000 UTC"
Oct 30 23:19:00.844140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.841101    4921 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13464h46m59.718702621s"
Oct 30 23:19:00.844140 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:00.841105    4921 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-208.us-east-2.compute.internal\" not found"
Oct 30 23:19:00.844140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.841204    4921 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 23:19:00.844140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.841216    4921 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 23:19:00.844140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.841339    4921 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 23:19:00.844140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.844091    4921 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 23:19:00.844140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.844107    4921 factory.go:55] Registering systemd factory
Oct 30 23:19:00.844140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.844116    4921 factory.go:223] Registration of the systemd container factory successfully
Oct 30 23:19:00.845420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845393    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="66938436-5c78-44c3-93f6-f52272cc9a6a" volumeName="kubernetes.io/configmap/66938436-5c78-44c3-93f6-f52272cc9a6a-env-overrides" seLinuxMountContext=""
Oct 30 23:19:00.845496 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845420    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b1d1b3c8-a603-476b-b51d-8add45d50b13" volumeName="kubernetes.io/configmap/b1d1b3c8-a603-476b-b51d-8add45d50b13-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 23:19:00.845496 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845430    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f9a4c974-1f79-40b2-9f49-427170c8764b" volumeName="kubernetes.io/configmap/f9a4c974-1f79-40b2-9f49-427170c8764b-service-ca-bundle" seLinuxMountContext=""
Oct 30 23:19:00.845496 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845438    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f9a4c974-1f79-40b2-9f49-427170c8764b" volumeName="kubernetes.io/secret/f9a4c974-1f79-40b2-9f49-427170c8764b-serving-cert" seLinuxMountContext=""
Oct 30 23:19:00.845496 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845446    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3536b8b5-e6a8-48c5-8319-8d75a7f4abd8" volumeName="kubernetes.io/configmap/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-trusted-ca" seLinuxMountContext=""
Oct 30 23:19:00.845496 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845463    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="67fa89c3-92f0-4ead-871a-45446e25aad5" volumeName="kubernetes.io/projected/67fa89c3-92f0-4ead-871a-45446e25aad5-kube-api-access-p56mc" seLinuxMountContext=""
Oct 30 23:19:00.845496 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845470    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a73f11a7-b4de-43b4-83de-cc7a630d25c3" volumeName="kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 23:19:00.845496 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845477    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b710ad88-e867-4ea3-a13b-394eb3d34c89" volumeName="kubernetes.io/empty-dir/b710ad88-e867-4ea3-a13b-394eb3d34c89-ca-trust-extracted" seLinuxMountContext=""
Oct 30 23:19:00.845496 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845485    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="499f7257-2e41-413c-b6b7-12089b9514a7" volumeName="kubernetes.io/secret/499f7257-2e41-413c-b6b7-12089b9514a7-agent-certs" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845507    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="84480344-bd78-4528-bfe4-29b67541a818" volumeName="kubernetes.io/configmap/84480344-bd78-4528-bfe4-29b67541a818-nginx-conf" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845516    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e911a1c-c73e-40ed-ba22-74845a60e738" volumeName="kubernetes.io/empty-dir/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-tuned" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845526    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b710ad88-e867-4ea3-a13b-394eb3d34c89" volumeName="kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-certificates" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845537    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b710ad88-e867-4ea3-a13b-394eb3d34c89" volumeName="kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845547    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bb5e9511-9532-4de4-9f4c-5e034cca2773" volumeName="kubernetes.io/configmap/bb5e9511-9532-4de4-9f4c-5e034cca2773-config" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845561    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="deb3bcf9-5f63-469d-b5d5-c5d62ffada99" volumeName="kubernetes.io/projected/deb3bcf9-5f63-469d-b5d5-c5d62ffada99-kube-api-access-cbxgf" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845571    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b" volumeName="kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-default-certificate" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845585    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="499f7257-2e41-413c-b6b7-12089b9514a7" volumeName="kubernetes.io/configmap/499f7257-2e41-413c-b6b7-12089b9514a7-konnectivity-ca" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845615    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a73f11a7-b4de-43b4-83de-cc7a630d25c3" volumeName="kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-trusted-ca" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845623    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b1d1b3c8-a603-476b-b51d-8add45d50b13" volumeName="kubernetes.io/projected/b1d1b3c8-a603-476b-b51d-8add45d50b13-kube-api-access-l9pl4" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845633    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef3b49c5-63b0-4be5-8198-589cc7bc1ce6" volumeName="kubernetes.io/projected/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6-kube-api-access-j5qdd" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845643    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b" volumeName="kubernetes.io/projected/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-kube-api-access-bq7m6" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845650    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f9a4c974-1f79-40b2-9f49-427170c8764b" volumeName="kubernetes.io/configmap/f9a4c974-1f79-40b2-9f49-427170c8764b-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845658    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b710ad88-e867-4ea3-a13b-394eb3d34c89" volumeName="kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-installation-pull-secrets" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845665    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2074c06c-0759-4701-9a2d-48f024879fb2" volumeName="kubernetes.io/projected/2074c06c-0759-4701-9a2d-48f024879fb2-kube-api-access-7p2kb" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845672    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="54c28267-55bc-4f8e-bb07-47e47951468d" volumeName="kubernetes.io/configmap/54c28267-55bc-4f8e-bb07-47e47951468d-cni-binary-copy" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845692    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="66938436-5c78-44c3-93f6-f52272cc9a6a" volumeName="kubernetes.io/configmap/66938436-5c78-44c3-93f6-f52272cc9a6a-ovnkube-config" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845700    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9047f37e-2d3c-4978-a5c1-4078d505ab15" volumeName="kubernetes.io/empty-dir/9047f37e-2d3c-4978-a5c1-4078d505ab15-tmp-dir" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845707    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a73f11a7-b4de-43b4-83de-cc7a630d25c3" volumeName="kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-installation-pull-secrets" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845720    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef3b49c5-63b0-4be5-8198-589cc7bc1ce6" volumeName="kubernetes.io/secret/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6-serving-cert" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845732    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="53725f0f-4d8e-4270-b319-3943c040f794" volumeName="kubernetes.io/projected/53725f0f-4d8e-4270-b319-3943c040f794-kube-api-access-2xxsh" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845739    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b1846d39-a52a-442d-8216-10f0798dbc36" volumeName="kubernetes.io/projected/b1846d39-a52a-442d-8216-10f0798dbc36-kube-api-access-g9rvq" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845747    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b710ad88-e867-4ea3-a13b-394eb3d34c89" volumeName="kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-kube-api-access-v7szx" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845761    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bb5e9511-9532-4de4-9f4c-5e034cca2773" volumeName="kubernetes.io/projected/bb5e9511-9532-4de4-9f4c-5e034cca2773-kube-api-access-kxnxf" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845774    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d27d7b3-0f5f-4604-86b1-eeb9d380104f" volumeName="kubernetes.io/configmap/6d27d7b3-0f5f-4604-86b1-eeb9d380104f-iptables-alerter-script" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845782    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a73f11a7-b4de-43b4-83de-cc7a630d25c3" volumeName="kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-kube-api-access-hmdlw" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845791    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3d1c4c4-03be-43ef-a2e4-bfc406dc7aca" volumeName="kubernetes.io/projected/b3d1c4c4-03be-43ef-a2e4-bfc406dc7aca-kube-api-access-9mrrm" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845798    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b710ad88-e867-4ea3-a13b-394eb3d34c89" volumeName="kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-bound-sa-token" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845811    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="deb3bcf9-5f63-469d-b5d5-c5d62ffada99" volumeName="kubernetes.io/configmap/deb3bcf9-5f63-469d-b5d5-c5d62ffada99-serviceca" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845820    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="53725f0f-4d8e-4270-b319-3943c040f794" volumeName="kubernetes.io/empty-dir/53725f0f-4d8e-4270-b319-3943c040f794-data-volume" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845828    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="54c28267-55bc-4f8e-bb07-47e47951468d" volumeName="kubernetes.io/projected/54c28267-55bc-4f8e-bb07-47e47951468d-kube-api-access-pbp7k" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845836    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ba7c1ba-4162-430e-b267-ebf3f9844750" volumeName="kubernetes.io/configmap/5ba7c1ba-4162-430e-b267-ebf3f9844750-config-volume" seLinuxMountContext=""
Oct 30 23:19:00.845821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845843    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="66938436-5c78-44c3-93f6-f52272cc9a6a" volumeName="kubernetes.io/projected/66938436-5c78-44c3-93f6-f52272cc9a6a-kube-api-access-vkt4n" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845850    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b1d1b3c8-a603-476b-b51d-8add45d50b13" volumeName="kubernetes.io/configmap/b1d1b3c8-a603-476b-b51d-8add45d50b13-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845858    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b1d1b3c8-a603-476b-b51d-8add45d50b13" volumeName="kubernetes.io/configmap/b1d1b3c8-a603-476b-b51d-8add45d50b13-cni-binary-copy" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845864    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f9a4c974-1f79-40b2-9f49-427170c8764b" volumeName="kubernetes.io/empty-dir/f9a4c974-1f79-40b2-9f49-427170c8764b-tmp" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845879    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1cfc2d59-558a-4f8a-8f23-59fe4b78dd17" volumeName="kubernetes.io/projected/1cfc2d59-558a-4f8a-8f23-59fe4b78dd17-kube-api-access-gm2kg" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845891    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="66938436-5c78-44c3-93f6-f52272cc9a6a" volumeName="kubernetes.io/secret/66938436-5c78-44c3-93f6-f52272cc9a6a-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845899    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9047f37e-2d3c-4978-a5c1-4078d505ab15" volumeName="kubernetes.io/projected/9047f37e-2d3c-4978-a5c1-4078d505ab15-kube-api-access-698bb" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845906    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a73f11a7-b4de-43b4-83de-cc7a630d25c3" volumeName="kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-bound-sa-token" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845913    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="54c28267-55bc-4f8e-bb07-47e47951468d" volumeName="kubernetes.io/configmap/54c28267-55bc-4f8e-bb07-47e47951468d-multus-daemon-config" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845919    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a73f11a7-b4de-43b4-83de-cc7a630d25c3" volumeName="kubernetes.io/empty-dir/a73f11a7-b4de-43b4-83de-cc7a630d25c3-ca-trust-extracted" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845928    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dc691df1-3f27-4829-955d-99b66893279d" volumeName="kubernetes.io/projected/dc691df1-3f27-4829-955d-99b66893279d-kube-api-access-t2v4q" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845935    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23c01b5c-af64-4567-9350-41572e762182" volumeName="kubernetes.io/projected/23c01b5c-af64-4567-9350-41572e762182-kube-api-access-pl7lx" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845943    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ba7c1ba-4162-430e-b267-ebf3f9844750" volumeName="kubernetes.io/projected/5ba7c1ba-4162-430e-b267-ebf3f9844750-kube-api-access-tzfpp" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845950    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="11f70cd2-d0b3-4a44-b936-1659972c6605" volumeName="kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845958    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d3c8853f-5927-4411-b293-0030e7f43312" volumeName="kubernetes.io/configmap/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-config" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845970    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f9a4c974-1f79-40b2-9f49-427170c8764b" volumeName="kubernetes.io/projected/f9a4c974-1f79-40b2-9f49-427170c8764b-kube-api-access-qzp75" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845977    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1" volumeName="kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845986    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3536b8b5-e6a8-48c5-8319-8d75a7f4abd8" volumeName="kubernetes.io/configmap/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-config" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.845993    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="66938436-5c78-44c3-93f6-f52272cc9a6a" volumeName="kubernetes.io/configmap/66938436-5c78-44c3-93f6-f52272cc9a6a-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846000    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e911a1c-c73e-40ed-ba22-74845a60e738" volumeName="kubernetes.io/empty-dir/8e911a1c-c73e-40ed-ba22-74845a60e738-tmp" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846007    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa5373ec-3489-4bd2-80e0-ad75abead9e6" volumeName="kubernetes.io/projected/aa5373ec-3489-4bd2-80e0-ad75abead9e6-kube-api-access-hhcnh" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846015    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d3c8853f-5927-4411-b293-0030e7f43312" volumeName="kubernetes.io/projected/d3c8853f-5927-4411-b293-0030e7f43312-kube-api-access-g47ks" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846022    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dc691df1-3f27-4829-955d-99b66893279d" volumeName="kubernetes.io/configmap/dc691df1-3f27-4829-955d-99b66893279d-telemetry-config" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846029    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b" volumeName="kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-stats-auth" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846043    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3536b8b5-e6a8-48c5-8319-8d75a7f4abd8" volumeName="kubernetes.io/secret/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-serving-cert" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846051    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ba7c1ba-4162-430e-b267-ebf3f9844750" volumeName="kubernetes.io/empty-dir/5ba7c1ba-4162-430e-b267-ebf3f9844750-tmp-dir" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846059    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d27d7b3-0f5f-4604-86b1-eeb9d380104f" volumeName="kubernetes.io/projected/6d27d7b3-0f5f-4604-86b1-eeb9d380104f-kube-api-access-csc8h" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846066    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e911a1c-c73e-40ed-ba22-74845a60e738" volumeName="kubernetes.io/projected/8e911a1c-c73e-40ed-ba22-74845a60e738-kube-api-access-x6flp" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846073    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f9a4c974-1f79-40b2-9f49-427170c8764b" volumeName="kubernetes.io/empty-dir/f9a4c974-1f79-40b2-9f49-427170c8764b-snapshots" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846081    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ff444d55-69cb-484d-a989-9dcd7b96524f" volumeName="kubernetes.io/projected/ff444d55-69cb-484d-a989-9dcd7b96524f-kube-api-access-mjqgs" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846087    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b1846d39-a52a-442d-8216-10f0798dbc36" volumeName="kubernetes.io/secret/b1846d39-a52a-442d-8216-10f0798dbc36-cert" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846094    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b710ad88-e867-4ea3-a13b-394eb3d34c89" volumeName="kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-trusted-ca" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846102    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bb5e9511-9532-4de4-9f4c-5e034cca2773" volumeName="kubernetes.io/secret/bb5e9511-9532-4de4-9f4c-5e034cca2773-serving-cert" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846109    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bdb399c5-bad6-4310-9542-509884ea425a" volumeName="kubernetes.io/projected/bdb399c5-bad6-4310-9542-509884ea425a-kube-api-access-r9lbz" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846117    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef3b49c5-63b0-4be5-8198-589cc7bc1ce6" volumeName="kubernetes.io/configmap/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6-config" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846125    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a73f11a7-b4de-43b4-83de-cc7a630d25c3" volumeName="kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-certificates" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846133    4921 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3536b8b5-e6a8-48c5-8319-8d75a7f4abd8" volumeName="kubernetes.io/projected/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-kube-api-access-cz5d8" seLinuxMountContext=""
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846140    4921 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846144    4921 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846870    4921 factory.go:153] Registering CRI-O factory
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846880    4921 factory.go:223] Registration of the crio container factory successfully
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846900    4921 factory.go:103] Registering Raw factory
Oct 30 23:19:00.847212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.846913    4921 manager.go:1199] Started watching for new ooms in manager
Oct 30 23:19:00.850351 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.847305    4921 manager.go:319] Starting recovery of all containers
Oct 30 23:19:00.852883 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.852861    4921 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 23:19:00.853475 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.853455    4921 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 23:19:00.854796 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.853633    4921 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 23:19:00.856953 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.856933    4921 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 23:19:00.865736 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.865714    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/1.log"
Oct 30 23:19:00.865836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.865782    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/1.log"
Oct 30 23:19:00.873300 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.873268    4921 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 23:19:00.874900 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.874881    4921 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 23:19:00.874996 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.874904    4921 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 23:19:00.874996 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.874925    4921 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 23:19:00.874996 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:00.874965    4921 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 23:19:00.879024 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.879003    4921 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 23:19:00.889525 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.889497    4921 generic.go:356] "Generic (PLEG): container finished" podID="72589e04a8c3b3f1c88140c7d0f5529b" containerID="c35a06bdddda30bde08beb785bc8dd52bc89b9216b39a2461a5ed2c0bec59438" exitCode=0
Oct 30 23:19:00.896991 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.896974    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/1.log"
Oct 30 23:19:00.897097 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.896997    4921 generic.go:356] "Generic (PLEG): container finished" podID="3536b8b5-e6a8-48c5-8319-8d75a7f4abd8" containerID="918efe4dcf661e709732583ce65b6af619d2f844c36a25e81025229a5b0a857a" exitCode=255
Oct 30 23:19:00.910575 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.910548    4921 generic.go:356] "Generic (PLEG): container finished" podID="b1d1b3c8-a603-476b-b51d-8add45d50b13" containerID="139a4979493d2d6462061200a9174087d0ce21788760cea9b0c4fca6c95a9ae2" exitCode=0
Oct 30 23:19:00.910575 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.910568    4921 generic.go:356] "Generic (PLEG): container finished" podID="b1d1b3c8-a603-476b-b51d-8add45d50b13" containerID="658b4c4d93fb4b82d8dd3c27f2128b1641f5081cd0b418638398836f861399c8" exitCode=0
Oct 30 23:19:00.910575 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.910575    4921 generic.go:356] "Generic (PLEG): container finished" podID="b1d1b3c8-a603-476b-b51d-8add45d50b13" containerID="cd4c8059f67fd213b720355b6116782022fc967779111c033742d69214d6d916" exitCode=0
Oct 30 23:19:00.910575 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.910580    4921 generic.go:356] "Generic (PLEG): container finished" podID="b1d1b3c8-a603-476b-b51d-8add45d50b13" containerID="844e874fccf277d33efa9f9d59ab9b2fd5a71a1f1cc7ae4d5ed4518498061d2d" exitCode=0
Oct 30 23:19:00.910836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.910585    4921 generic.go:356] "Generic (PLEG): container finished" podID="b1d1b3c8-a603-476b-b51d-8add45d50b13" containerID="f64522f887993421021c15d2e84937b5096aa16f6d7199a6249fcbc4082f9eb2" exitCode=0
Oct 30 23:19:00.910836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.910619    4921 generic.go:356] "Generic (PLEG): container finished" podID="b1d1b3c8-a603-476b-b51d-8add45d50b13" containerID="4c18adb264a07de33f40e38da7fdb82c69904dd978b982475a888b1c208d769c" exitCode=0
Oct 30 23:19:00.942381 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.942364    4921 manager.go:324] Recovery completed
Oct 30 23:19:00.962804 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.962783    4921 cpu_manager.go:226] "Starting" policy="none"
Oct 30 23:19:00.962804 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.962799    4921 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 23:19:00.962965 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.962819    4921 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 23:19:00.963021 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.962964    4921 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 23:19:00.963021 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.962978    4921 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 23:19:00.963021 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.963001    4921 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 23:19:00.963021 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.963010    4921 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 23:19:00.963021 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.963017    4921 policy_none.go:50] "Start"
Oct 30 23:19:00.963266 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.963029    4921 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 23:19:00.963266 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.963042    4921 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 23:19:00.963266 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.963221    4921 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 23:19:00.963266 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.963232    4921 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 23:19:00.963266 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.963240    4921 policy_none.go:44] "Start"
Oct 30 23:19:00.967479 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.967455    4921 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 23:19:00.971511 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.971496    4921 manager.go:341] "Starting Device Plugin manager"
Oct 30 23:19:00.971980 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:00.971528    4921 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 23:19:00.971980 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.971980    4921 server.go:87] "Starting device plugin registration server"
Oct 30 23:19:00.972227 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.972213    4921 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 23:19:00.972304 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.972225    4921 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 23:19:00.972358 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.972328    4921 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 23:19:00.973441 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.972419    4921 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 23:19:00.973441 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.972461    4921 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 23:19:00.973441 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.972467    4921 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 23:19:00.973441 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.972511    4921 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T23:19:00.972451022Z","UUID":"b2e8f19a-482d-4470-a31c-9c4c8d9dc70a","Handler":null,"Name":"","Endpoint":""}
Oct 30 23:19:00.973728 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.973711    4921 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 23:19:00.973783 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.973767    4921 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 23:19:00.974300 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:00.974281    4921 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 23:19:00.975177 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.975088    4921 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal"]
Oct 30 23:19:00.975925 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.975909    4921 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:00.976004 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.975947    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal" event={"ID":"72589e04a8c3b3f1c88140c7d0f5529b","Type":"ContainerStarted","Data":"204b3720d3374a431bc90f0f9e42d785114ccecdbc1b8adb29b5b7eaae8d47f6"}
Oct 30 23:19:00.976004 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.975991    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal" event={"ID":"72589e04a8c3b3f1c88140c7d0f5529b","Type":"ContainerDied","Data":"c35a06bdddda30bde08beb785bc8dd52bc89b9216b39a2461a5ed2c0bec59438"}
Oct 30 23:19:00.976146 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.976016    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal" event={"ID":"72589e04a8c3b3f1c88140c7d0f5529b","Type":"ContainerStarted","Data":"9dbf9d7ad4443212e8208f0481360d30dbba209b7ad5ec315257f930efc9dd6f"}
Oct 30 23:19:00.976146 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.976117    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal" event={"ID":"2cfc9340daa6f45c0fb8540343ee68d0","Type":"ContainerStarted","Data":"09cd119e51317e7a5f7da033fff606a848b8e935d27378ef0426f4fa63f24470"}
Oct 30 23:19:00.976146 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.976138    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal" event={"ID":"2cfc9340daa6f45c0fb8540343ee68d0","Type":"ContainerStarted","Data":"9721ca05ece86f1ab8994e2ff5dcffb9f38efab1f240cda7154bb2af27c56aef"}
Oct 30 23:19:00.976292 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.976249    4921 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:00.989982 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.989952    4921 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 23:19:00.990055 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:00.990010    4921 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:00.990462 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:00.990447    4921 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 23:19:00.990507 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:00.990491    4921 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:01.054518 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.054485    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72589e04a8c3b3f1c88140c7d0f5529b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal\" (UID: \"72589e04a8c3b3f1c88140c7d0f5529b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:01.054518 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.054520    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72589e04a8c3b3f1c88140c7d0f5529b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal\" (UID: \"72589e04a8c3b3f1c88140c7d0f5529b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:01.054728 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.054538    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2cfc9340daa6f45c0fb8540343ee68d0-config\") pod \"kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal\" (UID: \"2cfc9340daa6f45c0fb8540343ee68d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:01.072655 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.072580    4921 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 23:19:01.073952 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.073933    4921 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 23:19:01.074019 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.073972    4921 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 23:19:01.074019 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.073983    4921 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-208.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 23:19:01.074087 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.074028    4921 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:01.088441 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.088424    4921 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:01.088522 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.088474    4921 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:01.155002 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.154977    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72589e04a8c3b3f1c88140c7d0f5529b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal\" (UID: \"72589e04a8c3b3f1c88140c7d0f5529b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:01.155120 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.155015    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72589e04a8c3b3f1c88140c7d0f5529b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal\" (UID: \"72589e04a8c3b3f1c88140c7d0f5529b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:01.155120 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.155036    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2cfc9340daa6f45c0fb8540343ee68d0-config\") pod \"kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal\" (UID: \"2cfc9340daa6f45c0fb8540343ee68d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:01.155120 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.155085    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72589e04a8c3b3f1c88140c7d0f5529b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal\" (UID: \"72589e04a8c3b3f1c88140c7d0f5529b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:01.155120 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.155101    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72589e04a8c3b3f1c88140c7d0f5529b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal\" (UID: \"72589e04a8c3b3f1c88140c7d0f5529b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:01.155273 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.155131    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2cfc9340daa6f45c0fb8540343ee68d0-config\") pod \"kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal\" (UID: \"2cfc9340daa6f45c0fb8540343ee68d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:01.828691 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.828654    4921 apiserver.go:52] "Watching apiserver"
Oct 30 23:19:01.839858 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.839834    4921 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 23:19:01.840479 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.840456    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-hlltf","openshift-image-registry/image-registry-7cf56b4bd9-285cx","openshift-network-diagnostics/network-check-target-mhrmm","openshift-dns/node-resolver-pnk7r","openshift-image-registry/node-ca-xjtcb","openshift-ingress/router-default-54c94948b5-5fm4s","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9","openshift-multus/multus-jr84v","openshift-dns/dns-default-295nz","kube-system/kas-connection-checker-685895c7c9-zlgnn","openshift-multus/network-metrics-daemon-bcpxq","openshift-ingress-canary/ingress-canary-fsbsg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qhkwj","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh","openshift-image-registry/image-registry-6888fc6c96-6gdwr","openshift-ovn-kubernetes/ovnkube-node-jkk8z","kube-system/kas-connection-checker-685895c7c9-gpk5m","openshift-cluster-node-tuning-operator/tuned-jkxzf","openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz","openshift-network-console/networking-console-plugin-86c478bb88-z84cb","openshift-network-diagnostics/network-check-source-6f78d59f99-flrmm","openshift-kube-storage-version-migrator/migrator-66df5d496b-cj25s","kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal","openshift-multus/multus-additional-cni-plugins-smpnh","openshift-insights/insights-runtime-extractor-894kd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw","openshift-console-operator/console-operator-7cd56b8dbc-qs244","openshift-network-operator/iptables-alerter-l6h2l","openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp","kube-system/konnectivity-agent-6kctl","kube-system/global-pull-secret-syncer-nd66m","openshift-insights/insights-operator-7c4986d449-qdr5f"]
Oct 30 23:19:01.841743 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.841725    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:19:01.842226 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.842203    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:01.842842 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.842820    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:19:01.844014 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.843997    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:01.845281 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.845264    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:19:01.847525 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.847242    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 23:19:01.851893 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.851875    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:19:01.854985 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.854970    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:01.855489 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.855477    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-295nz"
Oct 30 23:19:01.856250 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.856235    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 23:19:01.856459 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.856446    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qwtvf\""
Oct 30 23:19:01.856493 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.856472    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kc52k\""
Oct 30 23:19:01.856622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.856588    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:01.857057 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.857032    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 23:19:01.857153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.857075    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-qmkhv\""
Oct 30 23:19:01.857198 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.857175    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 23:19:01.857247 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.857204    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 23:19:01.858643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.858629    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2v4q\" (UniqueName: \"kubernetes.io/projected/dc691df1-3f27-4829-955d-99b66893279d-kube-api-access-t2v4q\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:19:01.858687 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.858653    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhcnh\" (UniqueName: \"kubernetes.io/projected/aa5373ec-3489-4bd2-80e0-ad75abead9e6-kube-api-access-hhcnh\") pod \"kas-connection-checker-685895c7c9-zlgnn\" (UID: \"aa5373ec-3489-4bd2-80e0-ad75abead9e6\") " pod="kube-system/kas-connection-checker-685895c7c9-zlgnn"
Oct 30 23:19:01.858687 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.858670    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2kb\" (UniqueName: \"kubernetes.io/projected/2074c06c-0759-4701-9a2d-48f024879fb2-kube-api-access-7p2kb\") pod \"kas-connection-checker-685895c7c9-hlltf\" (UID: \"2074c06c-0759-4701-9a2d-48f024879fb2\") " pod="kube-system/kas-connection-checker-685895c7c9-hlltf"
Oct 30 23:19:01.858778 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.858684    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p56mc\" (UniqueName: \"kubernetes.io/projected/67fa89c3-92f0-4ead-871a-45446e25aad5-kube-api-access-p56mc\") pod \"kas-connection-checker-685895c7c9-gpk5m\" (UID: \"67fa89c3-92f0-4ead-871a-45446e25aad5\") " pod="kube-system/kas-connection-checker-685895c7c9-gpk5m"
Oct 30 23:19:01.858778 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.858700    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dc691df1-3f27-4829-955d-99b66893279d-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:19:01.858778 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.858717    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:19:01.859363 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.859343    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 23:19:01.859363 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.859360    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 23:19:01.859475 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.859351    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 23:19:01.859475 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.859383    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 23:19:01.859475 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.859363    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 23:19:01.859475 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.859420    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-h4zqg\""
Oct 30 23:19:01.859699 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.859632    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 23:19:01.860900 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.860887    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 23:19:01.861655 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.861637    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 23:19:01.861745 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.861672    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 23:19:01.861745 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.861699    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 23:19:01.861745 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.861725    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 23:19:01.862167 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.862154    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-2nz9z\""
Oct 30 23:19:01.862320 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.862309    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-djdr2\""
Oct 30 23:19:01.862899 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.862883    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 23:19:01.862978 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.862943    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 23:19:01.863051 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.863039    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 23:19:01.863102 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.863072    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 23:19:01.863134 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.863102    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 23:19:01.863352 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.863324    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 23:19:01.863352 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.863344    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 23:19:01.863776 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.863754    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 23:19:01.863776 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.863763    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 23:19:01.863928 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.863789    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 23:19:01.863928 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.863788    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 23:19:01.864010 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.863936    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 23:19:01.864010 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.863942    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 23:19:01.864144 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864129    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 23:19:01.864207 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864164    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zcrv2\""
Oct 30 23:19:01.864207 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864181    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 23:19:01.864207 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864197    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 23:19:01.864207 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864207    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 23:19:01.864369 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864207    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 23:19:01.864369 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864219    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4bbvk\""
Oct 30 23:19:01.864369 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864198    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 23:19:01.864369 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864167    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 23:19:01.864369 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864266    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 23:19:01.864369 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864295    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 23:19:01.864369 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864331    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 23:19:01.864369 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864370    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 23:19:01.864684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864384    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 23:19:01.864684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864403    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 23:19:01.864684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864410    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 23:19:01.864684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864419    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k8dwv\""
Oct 30 23:19:01.864684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864415    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 23:19:01.864684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864435    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-9tmfn\""
Oct 30 23:19:01.864684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864442    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 23:19:01.864684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864385    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jt8kr\""
Oct 30 23:19:01.864684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864413    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 23:19:01.864684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864456    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 23:19:01.864684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864456    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-n9xrj\""
Oct 30 23:19:01.864684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864455    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gddrl\""
Oct 30 23:19:01.864684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864481    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 23:19:01.864684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864502    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lwvlw\""
Oct 30 23:19:01.864684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864503    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 23:19:01.864684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.864535    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 23:19:01.865396 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865381    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 23:19:01.865396 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865395    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 23:19:01.865560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865403    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 23:19:01.865560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865415    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 23:19:01.865560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865422    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 23:19:01.865560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865427    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 23:19:01.865560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865431    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 23:19:01.865560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865444    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 23:19:01.865560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865451    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-82xnp\""
Oct 30 23:19:01.865560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865462    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 23:19:01.865560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865464    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 23:19:01.865560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865464    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 23:19:01.865560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865452    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 23:19:01.865560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865485    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 23:19:01.865560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865502    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 23:19:01.865560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865504    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 23:19:01.865560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865515    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 23:19:01.865560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865521    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 23:19:01.865560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865478    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 23:19:01.866230 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865869    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 23:19:01.866230 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.865902    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 23:19:01.867888 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.867872    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 23:19:01.869681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.869665    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 23:19:01.873644 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.873577    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 23:19:01.874381 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.874145    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 23:19:01.874381 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.874161    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z9rpn\""
Oct 30 23:19:01.874381 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.874261    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 23:19:01.874876 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.874852    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qrvbx\""
Oct 30 23:19:01.875250 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.874854    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 23:19:01.875697 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.875623    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2v4q\" (UniqueName: \"kubernetes.io/projected/dc691df1-3f27-4829-955d-99b66893279d-kube-api-access-t2v4q\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:19:01.875815 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.875797    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-gskv9\""
Oct 30 23:19:01.875887 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.875865    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p56mc\" (UniqueName: \"kubernetes.io/projected/67fa89c3-92f0-4ead-871a-45446e25aad5-kube-api-access-p56mc\") pod \"kas-connection-checker-685895c7c9-gpk5m\" (UID: \"67fa89c3-92f0-4ead-871a-45446e25aad5\") " pod="kube-system/kas-connection-checker-685895c7c9-gpk5m"
Oct 30 23:19:01.875971 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.875877    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p2kb\" (UniqueName: \"kubernetes.io/projected/2074c06c-0759-4701-9a2d-48f024879fb2-kube-api-access-7p2kb\") pod \"kas-connection-checker-685895c7c9-hlltf\" (UID: \"2074c06c-0759-4701-9a2d-48f024879fb2\") " pod="kube-system/kas-connection-checker-685895c7c9-hlltf"
Oct 30 23:19:01.876119 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.876094    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:01.876401 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.876263    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhcnh\" (UniqueName: \"kubernetes.io/projected/aa5373ec-3489-4bd2-80e0-ad75abead9e6-kube-api-access-hhcnh\") pod \"kas-connection-checker-685895c7c9-zlgnn\" (UID: \"aa5373ec-3489-4bd2-80e0-ad75abead9e6\") " pod="kube-system/kas-connection-checker-685895c7c9-zlgnn"
Oct 30 23:19:01.877920 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.876675    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 23:19:01.879089 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.879068    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dc691df1-3f27-4829-955d-99b66893279d-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:19:01.931626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.931582    4921 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:01.931766 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.931681    4921 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:01.943872 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.943850    4921 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 23:19:01.944092 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.944080    4921 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 23:19:01.944133 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:01.944117    4921 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:01.944584 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.944571    4921 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 23:19:01.944641 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:01.944619    4921 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-208.us-east-2.compute.internal"
Oct 30 23:19:01.958699 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.958674    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 23:19:01.958831 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.958746    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 23:19:01.958905 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.958892    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 23:19:01.958941 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.958903    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 23:19:01.958941 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.958903    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 23:19:01.958941 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.958931    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-trusted-ca\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:19:01.959030 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.958971    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/53725f0f-4d8e-4270-b319-3943c040f794-crio-socket\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:01.959030 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.958990    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-698bb\" (UniqueName: \"kubernetes.io/projected/9047f37e-2d3c-4978-a5c1-4078d505ab15-kube-api-access-698bb\") pod \"node-resolver-pnk7r\" (UID: \"9047f37e-2d3c-4978-a5c1-4078d505ab15\") " pod="openshift-dns/node-resolver-pnk7r"
Oct 30 23:19:01.959030 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959007    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mrrm\" (UniqueName: \"kubernetes.io/projected/b3d1c4c4-03be-43ef-a2e4-bfc406dc7aca-kube-api-access-9mrrm\") pod \"volume-data-source-validator-58c9f5f46d-qhkwj\" (UID: \"b3d1c4c4-03be-43ef-a2e4-bfc406dc7aca\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qhkwj"
Oct 30 23:19:01.959116 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959031    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-run-multus-certs\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:01.959116 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959084    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-sysconfig\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:01.959240 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959222    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-kubelet-config\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:19:01.959273 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959264    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-trusted-ca\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:19:01.959302 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959263    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54c28267-55bc-4f8e-bb07-47e47951468d-multus-daemon-config\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:01.959331 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959321    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl7lx\" (UniqueName: \"kubernetes.io/projected/23c01b5c-af64-4567-9350-41572e762182-kube-api-access-pl7lx\") pod \"network-metrics-daemon-bcpxq\" (UID: \"23c01b5c-af64-4567-9350-41572e762182\") " pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:19:01.959418 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959405    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d27d7b3-0f5f-4604-86b1-eeb9d380104f-host-slash\") pod \"iptables-alerter-l6h2l\" (UID: \"6d27d7b3-0f5f-4604-86b1-eeb9d380104f\") " pod="openshift-network-operator/iptables-alerter-l6h2l"
Oct 30 23:19:01.959451 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959428    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/deb3bcf9-5f63-469d-b5d5-c5d62ffada99-serviceca\") pod \"node-ca-xjtcb\" (UID: \"deb3bcf9-5f63-469d-b5d5-c5d62ffada99\") " pod="openshift-image-registry/node-ca-xjtcb"
Oct 30 23:19:01.959451 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959446    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-slash\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.959543 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959470    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkt4n\" (UniqueName: \"kubernetes.io/projected/66938436-5c78-44c3-93f6-f52272cc9a6a-kube-api-access-vkt4n\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.959589 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959573    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e911a1c-c73e-40ed-ba22-74845a60e738-tmp\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:01.959647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959585    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54c28267-55bc-4f8e-bb07-47e47951468d-multus-daemon-config\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:01.959647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959623    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-image-registry-private-configuration\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:01.959741 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959652    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csc8h\" (UniqueName: \"kubernetes.io/projected/6d27d7b3-0f5f-4604-86b1-eeb9d380104f-kube-api-access-csc8h\") pod \"iptables-alerter-l6h2l\" (UID: \"6d27d7b3-0f5f-4604-86b1-eeb9d380104f\") " pod="openshift-network-operator/iptables-alerter-l6h2l"
Oct 30 23:19:01.959741 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959678    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-run-netns\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:01.959741 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959686    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e911a1c-c73e-40ed-ba22-74845a60e738-tmp\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:01.959741 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959702    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-node-log\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.959888 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959746    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/deb3bcf9-5f63-469d-b5d5-c5d62ffada99-serviceca\") pod \"node-ca-xjtcb\" (UID: \"deb3bcf9-5f63-469d-b5d5-c5d62ffada99\") " pod="openshift-image-registry/node-ca-xjtcb"
Oct 30 23:19:01.959888 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959845    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-kubelet\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.959888 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959874    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-image-registry-private-configuration\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:01.959888 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959880    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-modprobe-d\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:01.959997 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959914    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9rvq\" (UniqueName: \"kubernetes.io/projected/b1846d39-a52a-442d-8216-10f0798dbc36-kube-api-access-g9rvq\") pod \"ingress-canary-fsbsg\" (UID: \"b1846d39-a52a-442d-8216-10f0798dbc36\") " pod="openshift-ingress-canary/ingress-canary-fsbsg"
Oct 30 23:19:01.959997 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959949    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:01.959997 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.959966    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/499f7257-2e41-413c-b6b7-12089b9514a7-konnectivity-ca\") pod \"konnectivity-agent-6kctl\" (UID: \"499f7257-2e41-413c-b6b7-12089b9514a7\") " pod="kube-system/konnectivity-agent-6kctl"
Oct 30 23:19:01.960079 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960010    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-run-openvswitch\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.960079 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960032    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/66938436-5c78-44c3-93f6-f52272cc9a6a-env-overrides\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.960079 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960048    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-host\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:01.960079 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960065    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-tuned\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:01.960276 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960086    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xxsh\" (UniqueName: \"kubernetes.io/projected/53725f0f-4d8e-4270-b319-3943c040f794-kube-api-access-2xxsh\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:01.960276 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960130    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/66938436-5c78-44c3-93f6-f52272cc9a6a-ovnkube-script-lib\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.960276 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960157    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-tuned\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:01.960276 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960162    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9\" (UID: \"ef3b49c5-63b0-4be5-8198-589cc7bc1ce6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"
Oct 30 23:19:01.960276 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960196    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/499f7257-2e41-413c-b6b7-12089b9514a7-konnectivity-ca\") pod \"konnectivity-agent-6kctl\" (UID: \"499f7257-2e41-413c-b6b7-12089b9514a7\") " pod="kube-system/konnectivity-agent-6kctl"
Oct 30 23:19:01.960276 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960228    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9a4c974-1f79-40b2-9f49-427170c8764b-tmp\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:19:01.960276 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960276    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-device-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:01.960669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960299    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9a4c974-1f79-40b2-9f49-427170c8764b-tmp\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:19:01.960669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960304    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/53725f0f-4d8e-4270-b319-3943c040f794-data-volume\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:01.960669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960305    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9\" (UID: \"ef3b49c5-63b0-4be5-8198-589cc7bc1ce6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"
Oct 30 23:19:01.960669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960335    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-var-lib-kubelet\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:01.960669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960357    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/66938436-5c78-44c3-93f6-f52272cc9a6a-env-overrides\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.960669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960384    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/53725f0f-4d8e-4270-b319-3943c040f794-data-volume\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:01.960669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960385    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb5e9511-9532-4de4-9f4c-5e034cca2773-serving-cert\") pod \"service-ca-operator-544d749c8c-7m2nz\" (UID: \"bb5e9511-9532-4de4-9f4c-5e034cca2773\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"
Oct 30 23:19:01.960669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960394    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/66938436-5c78-44c3-93f6-f52272cc9a6a-ovnkube-script-lib\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.960669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960419    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-serving-cert\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:19:01.960669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960446    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b710ad88-e867-4ea3-a13b-394eb3d34c89-ca-trust-extracted\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:01.960669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960469    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-bound-sa-token\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:01.960669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960517    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-run-k8s-cni-cncf-io\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:01.960669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960551    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-var-lib-openvswitch\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.960669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960568    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-serving-cert\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:19:01.960669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960613    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-installation-pull-secrets\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:01.960669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960647    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:19:01.960669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960664    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b710ad88-e867-4ea3-a13b-394eb3d34c89-ca-trust-extracted\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960703    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-systemd-units\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960740    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-log-socket\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960742    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb5e9511-9532-4de4-9f4c-5e034cca2773-serving-cert\") pod \"service-ca-operator-544d749c8c-7m2nz\" (UID: \"bb5e9511-9532-4de4-9f4c-5e034cca2773\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960773    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9a4c974-1f79-40b2-9f49-427170c8764b-serving-cert\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960793    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-var-lib-cni-bin\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960807    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-original-pull-secret\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960809    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-multus-conf-dir\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960863    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-installation-pull-secrets\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960906    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9a4c974-1f79-40b2-9f49-427170c8764b-serving-cert\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960926    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-kubernetes\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960945    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-lib-modules\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.960974    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb5e9511-9532-4de4-9f4c-5e034cca2773-config\") pod \"service-ca-operator-544d749c8c-7m2nz\" (UID: \"bb5e9511-9532-4de4-9f4c-5e034cca2773\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961063    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/84480344-bd78-4528-bfe4-29b67541a818-nginx-conf\") pod \"networking-console-plugin-86c478bb88-z84cb\" (UID: \"84480344-bd78-4528-bfe4-29b67541a818\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961094    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb5e9511-9532-4de4-9f4c-5e034cca2773-config\") pod \"service-ca-operator-544d749c8c-7m2nz\" (UID: \"bb5e9511-9532-4de4-9f4c-5e034cca2773\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961100    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53725f0f-4d8e-4270-b319-3943c040f794-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961128    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-run-ovn\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961152    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-cni-bin\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961178    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-stats-auth\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961204    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq7m6\" (UniqueName: \"kubernetes.io/projected/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-kube-api-access-bq7m6\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961223    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/84480344-bd78-4528-bfe4-29b67541a818-nginx-conf\") pod \"networking-console-plugin-86c478bb88-z84cb\" (UID: \"84480344-bd78-4528-bfe4-29b67541a818\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961275    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a73f11a7-b4de-43b4-83de-cc7a630d25c3-ca-trust-extracted\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961380    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-certificates\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961384    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-stats-auth\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961394    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a73f11a7-b4de-43b4-83de-cc7a630d25c3-ca-trust-extracted\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:01.961435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961421    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961501    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961522    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961536    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-certificates\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961575    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmdlw\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-kube-api-access-hmdlw\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961630    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1d1b3c8-a603-476b-b51d-8add45d50b13-cni-binary-copy\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961646    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d27d7b3-0f5f-4604-86b1-eeb9d380104f-iptables-alerter-script\") pod \"iptables-alerter-l6h2l\" (UID: \"6d27d7b3-0f5f-4604-86b1-eeb9d380104f\") " pod="openshift-network-operator/iptables-alerter-l6h2l"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961661    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/499f7257-2e41-413c-b6b7-12089b9514a7-agent-certs\") pod \"konnectivity-agent-6kctl\" (UID: \"499f7257-2e41-413c-b6b7-12089b9514a7\") " pod="kube-system/konnectivity-agent-6kctl"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961676    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-multus-socket-dir-parent\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961741    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-var-lib-cni-multus\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961768    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbp7k\" (UniqueName: \"kubernetes.io/projected/54c28267-55bc-4f8e-bb07-47e47951468d-kube-api-access-pbp7k\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961819    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9pl4\" (UniqueName: \"kubernetes.io/projected/b1d1b3c8-a603-476b-b51d-8add45d50b13-kube-api-access-l9pl4\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961868    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm2kg\" (UniqueName: \"kubernetes.io/projected/1cfc2d59-558a-4f8a-8f23-59fe4b78dd17-kube-api-access-gm2kg\") pod \"network-check-source-6f78d59f99-flrmm\" (UID: \"1cfc2d59-558a-4f8a-8f23-59fe4b78dd17\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-flrmm"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961922    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1d1b3c8-a603-476b-b51d-8add45d50b13-cni-binary-copy\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961914    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-default-certificate\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961935    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/499f7257-2e41-413c-b6b7-12089b9514a7-agent-certs\") pod \"konnectivity-agent-6kctl\" (UID: \"499f7257-2e41-413c-b6b7-12089b9514a7\") " pod="kube-system/konnectivity-agent-6kctl"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961953    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d27d7b3-0f5f-4604-86b1-eeb9d380104f-iptables-alerter-script\") pod \"iptables-alerter-l6h2l\" (UID: \"6d27d7b3-0f5f-4604-86b1-eeb9d380104f\") " pod="openshift-network-operator/iptables-alerter-l6h2l"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.961977    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzp75\" (UniqueName: \"kubernetes.io/projected/f9a4c974-1f79-40b2-9f49-427170c8764b-kube-api-access-qzp75\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962016    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-socket-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962032    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962137    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-trusted-ca\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962141    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-default-certificate\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962157    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-dbus\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962186    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9\" (UID: \"ef3b49c5-63b0-4be5-8198-589cc7bc1ce6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962207    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-installation-pull-secrets\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962245    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1d1b3c8-a603-476b-b51d-8add45d50b13-system-cni-dir\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962302    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/deb3bcf9-5f63-469d-b5d5-c5d62ffada99-host\") pod \"node-ca-xjtcb\" (UID: \"deb3bcf9-5f63-469d-b5d5-c5d62ffada99\") " pod="openshift-image-registry/node-ca-xjtcb"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962331    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ba7c1ba-4162-430e-b267-ebf3f9844750-tmp-dir\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962356    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/66938436-5c78-44c3-93f6-f52272cc9a6a-ovnkube-config\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962374    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9a4c974-1f79-40b2-9f49-427170c8764b-service-ca-bundle\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962413    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-image-registry-private-configuration\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962426    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-installation-pull-secrets\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962433    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-trusted-ca\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962427    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9\" (UID: \"ef3b49c5-63b0-4be5-8198-589cc7bc1ce6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962526    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9047f37e-2d3c-4978-a5c1-4078d505ab15-tmp-dir\") pod \"node-resolver-pnk7r\" (UID: \"9047f37e-2d3c-4978-a5c1-4078d505ab15\") " pod="openshift-dns/node-resolver-pnk7r"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962549    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ba7c1ba-4162-430e-b267-ebf3f9844750-tmp-dir\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962570    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ba7c1ba-4162-430e-b267-ebf3f9844750-config-volume\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962584    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/66938436-5c78-44c3-93f6-f52272cc9a6a-ovnkube-config\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962632    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962636    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9047f37e-2d3c-4978-a5c1-4078d505ab15-tmp-dir\") pod \"node-resolver-pnk7r\" (UID: \"9047f37e-2d3c-4978-a5c1-4078d505ab15\") " pod="openshift-dns/node-resolver-pnk7r"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962661    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-image-registry-private-configuration\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:01.962639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962672    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-config\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:01.962716    4921 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962749    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-cnibin\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962773    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ba7c1ba-4162-430e-b267-ebf3f9844750-config-volume\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962824    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:01.962865    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls podName:dc691df1-3f27-4829-955d-99b66893279d nodeName:}" failed. No retries permitted until 2026-10-30 23:19:02.462842316 +0000 UTC m=+1.707698094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-2w6gp" (UID: "dc691df1-3f27-4829-955d-99b66893279d") : secret "cluster-monitoring-operator-tls" not found
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962891    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-run-ovn-kubernetes\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962912    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-config\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962937    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1846d39-a52a-442d-8216-10f0798dbc36-cert\") pod \"ingress-canary-fsbsg\" (UID: \"b1846d39-a52a-442d-8216-10f0798dbc36\") " pod="openshift-ingress-canary/ingress-canary-fsbsg"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962948    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9a4c974-1f79-40b2-9f49-427170c8764b-service-ca-bundle\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962969    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-z84cb\" (UID: \"84480344-bd78-4528-bfe4-29b67541a818\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.962998    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963025    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963074    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-sys-fs\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963102    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-hostroot\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963129    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9lbz\" (UniqueName: \"kubernetes.io/projected/bdb399c5-bad6-4310-9542-509884ea425a-kube-api-access-r9lbz\") pod \"migrator-66df5d496b-cj25s\" (UID: \"bdb399c5-bad6-4310-9542-509884ea425a\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cj25s"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963130    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1846d39-a52a-442d-8216-10f0798dbc36-cert\") pod \"ingress-canary-fsbsg\" (UID: \"b1846d39-a52a-442d-8216-10f0798dbc36\") " pod="openshift-ingress-canary/ingress-canary-fsbsg"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963228    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-etc-openvswitch\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963258    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f9a4c974-1f79-40b2-9f49-427170c8764b-snapshots\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963281    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-certificates\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963366    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f9a4c974-1f79-40b2-9f49-427170c8764b-snapshots\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963378    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963402    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g47ks\" (UniqueName: \"kubernetes.io/projected/d3c8853f-5927-4411-b293-0030e7f43312-kube-api-access-g47ks\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963404    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-certificates\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963440    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b1d1b3c8-a603-476b-b51d-8add45d50b13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963466    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbxgf\" (UniqueName: \"kubernetes.io/projected/deb3bcf9-5f63-469d-b5d5-c5d62ffada99-kube-api-access-cbxgf\") pod \"node-ca-xjtcb\" (UID: \"deb3bcf9-5f63-469d-b5d5-c5d62ffada99\") " pod="openshift-image-registry/node-ca-xjtcb"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963495    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9047f37e-2d3c-4978-a5c1-4078d505ab15-hosts-file\") pod \"node-resolver-pnk7r\" (UID: \"9047f37e-2d3c-4978-a5c1-4078d505ab15\") " pod="openshift-dns/node-resolver-pnk7r"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963525    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-etc-kubernetes\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963549    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-systemd\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963583    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6flp\" (UniqueName: \"kubernetes.io/projected/8e911a1c-c73e-40ed-ba22-74845a60e738-kube-api-access-x6flp\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963625    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963645    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b1d1b3c8-a603-476b-b51d-8add45d50b13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963673    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b1d1b3c8-a603-476b-b51d-8add45d50b13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963748    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vg5p\" (UniqueName: \"kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p\") pod \"network-check-target-mhrmm\" (UID: \"11f70cd2-d0b3-4a44-b936-1659972c6605\") " pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963767    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-cni-netd\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963785    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b1d1b3c8-a603-476b-b51d-8add45d50b13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963787    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/66938436-5c78-44c3-93f6-f52272cc9a6a-ovn-node-metrics-cert\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963823    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-run\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963861    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9a4c974-1f79-40b2-9f49-427170c8764b-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963888    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjqgs\" (UniqueName: \"kubernetes.io/projected/ff444d55-69cb-484d-a989-9dcd7b96524f-kube-api-access-mjqgs\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963913    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-sysctl-d\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963918    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/66938436-5c78-44c3-93f6-f52272cc9a6a-ovn-node-metrics-cert\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963938    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-bound-sa-token\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.963973    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964121    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-registration-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964136    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9a4c974-1f79-40b2-9f49-427170c8764b-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964154    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964183    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7szx\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-kube-api-access-v7szx\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964210    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-system-cni-dir\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964241    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzfpp\" (UniqueName: \"kubernetes.io/projected/5ba7c1ba-4162-430e-b267-ebf3f9844750-kube-api-access-tzfpp\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964264    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-run-systemd\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964292    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5qdd\" (UniqueName: \"kubernetes.io/projected/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6-kube-api-access-j5qdd\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9\" (UID: \"ef3b49c5-63b0-4be5-8198-589cc7bc1ce6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964320    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs\") pod \"network-metrics-daemon-bcpxq\" (UID: \"23c01b5c-af64-4567-9350-41572e762182\") " pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964347    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxnxf\" (UniqueName: \"kubernetes.io/projected/bb5e9511-9532-4de4-9f4c-5e034cca2773-kube-api-access-kxnxf\") pod \"service-ca-operator-544d749c8c-7m2nz\" (UID: \"bb5e9511-9532-4de4-9f4c-5e034cca2773\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964393    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-trusted-ca\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964461    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1d1b3c8-a603-476b-b51d-8add45d50b13-cnibin\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:19:01.964456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964488    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-var-lib-kubelet\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:01.966267 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964516    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-run-netns\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.966267 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964550    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-sysctl-conf\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:01.966267 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964579    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-sys\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:01.966267 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964631    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz5d8\" (UniqueName: \"kubernetes.io/projected/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-kube-api-access-cz5d8\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:19:01.966267 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964660    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1d1b3c8-a603-476b-b51d-8add45d50b13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:19:01.966267 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964677    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-multus-cni-dir\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:01.966267 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964719    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54c28267-55bc-4f8e-bb07-47e47951468d-cni-binary-copy\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:01.966267 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964741    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-trusted-ca\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:01.966267 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.964871    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54c28267-55bc-4f8e-bb07-47e47951468d-cni-binary-copy\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:01.969523 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.969503    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl7lx\" (UniqueName: \"kubernetes.io/projected/23c01b5c-af64-4567-9350-41572e762182-kube-api-access-pl7lx\") pod \"network-metrics-daemon-bcpxq\" (UID: \"23c01b5c-af64-4567-9350-41572e762182\") " pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:19:01.969628 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.969575    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csc8h\" (UniqueName: \"kubernetes.io/projected/6d27d7b3-0f5f-4604-86b1-eeb9d380104f-kube-api-access-csc8h\") pod \"iptables-alerter-l6h2l\" (UID: \"6d27d7b3-0f5f-4604-86b1-eeb9d380104f\") " pod="openshift-network-operator/iptables-alerter-l6h2l"
Oct 30 23:19:01.969702 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.969686    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mrrm\" (UniqueName: \"kubernetes.io/projected/b3d1c4c4-03be-43ef-a2e4-bfc406dc7aca-kube-api-access-9mrrm\") pod \"volume-data-source-validator-58c9f5f46d-qhkwj\" (UID: \"b3d1c4c4-03be-43ef-a2e4-bfc406dc7aca\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qhkwj"
Oct 30 23:19:01.970869 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.970854    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkt4n\" (UniqueName: \"kubernetes.io/projected/66938436-5c78-44c3-93f6-f52272cc9a6a-kube-api-access-vkt4n\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:01.971177 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.971160    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-698bb\" (UniqueName: \"kubernetes.io/projected/9047f37e-2d3c-4978-a5c1-4078d505ab15-kube-api-access-698bb\") pod \"node-resolver-pnk7r\" (UID: \"9047f37e-2d3c-4978-a5c1-4078d505ab15\") " pod="openshift-dns/node-resolver-pnk7r"
Oct 30 23:19:01.971332 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.971318    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-bound-sa-token\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:01.971818 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.971803    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9rvq\" (UniqueName: \"kubernetes.io/projected/b1846d39-a52a-442d-8216-10f0798dbc36-kube-api-access-g9rvq\") pod \"ingress-canary-fsbsg\" (UID: \"b1846d39-a52a-442d-8216-10f0798dbc36\") " pod="openshift-ingress-canary/ingress-canary-fsbsg"
Oct 30 23:19:01.972971 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.972955    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xxsh\" (UniqueName: \"kubernetes.io/projected/53725f0f-4d8e-4270-b319-3943c040f794-kube-api-access-2xxsh\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:01.979236 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.979215    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmdlw\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-kube-api-access-hmdlw\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:01.981324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.981300    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9lbz\" (UniqueName: \"kubernetes.io/projected/bdb399c5-bad6-4310-9542-509884ea425a-kube-api-access-r9lbz\") pod \"migrator-66df5d496b-cj25s\" (UID: \"bdb399c5-bad6-4310-9542-509884ea425a\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cj25s"
Oct 30 23:19:01.981426 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.981351    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq7m6\" (UniqueName: \"kubernetes.io/projected/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-kube-api-access-bq7m6\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:01.981426 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.981383    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g47ks\" (UniqueName: \"kubernetes.io/projected/d3c8853f-5927-4411-b293-0030e7f43312-kube-api-access-g47ks\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:19:01.981426 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.981418    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9pl4\" (UniqueName: \"kubernetes.io/projected/b1d1b3c8-a603-476b-b51d-8add45d50b13-kube-api-access-l9pl4\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:19:01.981702 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.981458    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbp7k\" (UniqueName: \"kubernetes.io/projected/54c28267-55bc-4f8e-bb07-47e47951468d-kube-api-access-pbp7k\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:01.981702 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.981632    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm2kg\" (UniqueName: \"kubernetes.io/projected/1cfc2d59-558a-4f8a-8f23-59fe4b78dd17-kube-api-access-gm2kg\") pod \"network-check-source-6f78d59f99-flrmm\" (UID: \"1cfc2d59-558a-4f8a-8f23-59fe4b78dd17\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-flrmm"
Oct 30 23:19:01.981794 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.981782    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjqgs\" (UniqueName: \"kubernetes.io/projected/ff444d55-69cb-484d-a989-9dcd7b96524f-kube-api-access-mjqgs\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:01.984369 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.984350    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-bound-sa-token\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:01.984455 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.984434    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5qdd\" (UniqueName: \"kubernetes.io/projected/ef3b49c5-63b0-4be5-8198-589cc7bc1ce6-kube-api-access-j5qdd\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9\" (UID: \"ef3b49c5-63b0-4be5-8198-589cc7bc1ce6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9"
Oct 30 23:19:01.984998 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.984980    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vg5p\" (UniqueName: \"kubernetes.io/projected/11f70cd2-d0b3-4a44-b936-1659972c6605-kube-api-access-9vg5p\") pod \"network-check-target-mhrmm\" (UID: \"11f70cd2-d0b3-4a44-b936-1659972c6605\") " pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:19:01.985607 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.985579    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxnxf\" (UniqueName: \"kubernetes.io/projected/bb5e9511-9532-4de4-9f4c-5e034cca2773-kube-api-access-kxnxf\") pod \"service-ca-operator-544d749c8c-7m2nz\" (UID: \"bb5e9511-9532-4de4-9f4c-5e034cca2773\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz"
Oct 30 23:19:01.986331 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.986283    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6flp\" (UniqueName: \"kubernetes.io/projected/8e911a1c-c73e-40ed-ba22-74845a60e738-kube-api-access-x6flp\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:01.986411 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.986396    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzp75\" (UniqueName: \"kubernetes.io/projected/f9a4c974-1f79-40b2-9f49-427170c8764b-kube-api-access-qzp75\") pod \"insights-operator-7c4986d449-qdr5f\" (UID: \"f9a4c974-1f79-40b2-9f49-427170c8764b\") " pod="openshift-insights/insights-operator-7c4986d449-qdr5f"
Oct 30 23:19:01.986462 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.986445    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbxgf\" (UniqueName: \"kubernetes.io/projected/deb3bcf9-5f63-469d-b5d5-c5d62ffada99-kube-api-access-cbxgf\") pod \"node-ca-xjtcb\" (UID: \"deb3bcf9-5f63-469d-b5d5-c5d62ffada99\") " pod="openshift-image-registry/node-ca-xjtcb"
Oct 30 23:19:01.986779 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.986760    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz5d8\" (UniqueName: \"kubernetes.io/projected/3536b8b5-e6a8-48c5-8319-8d75a7f4abd8-kube-api-access-cz5d8\") pod \"console-operator-7cd56b8dbc-qs244\" (UID: \"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:19:01.986937 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.986923    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzfpp\" (UniqueName: \"kubernetes.io/projected/5ba7c1ba-4162-430e-b267-ebf3f9844750-kube-api-access-tzfpp\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:19:01.986996 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:01.986983    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7szx\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-kube-api-access-v7szx\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:02.012418 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.012386    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:02.065059 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065033    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-run-netns\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.065059 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065062    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-node-log\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.065239 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065077    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-kubelet\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.065239 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065098    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-modprobe-d\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.065239 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065125    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:02.065239 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065141    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-node-log\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.065239 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065152    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-run-openvswitch\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.065239 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065161    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-run-netns\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.065239 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065187    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-kubelet\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.065239 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065199    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-run-openvswitch\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.065239 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065217    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-host\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.065239 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.065233    4921 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065245    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-device-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.065289    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls podName:53725f0f-4d8e-4270-b319-3943c040f794 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:02.565270715 +0000 UTC m=+1.810126468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls") pod "insights-runtime-extractor-894kd" (UID: "53725f0f-4d8e-4270-b319-3943c040f794") : secret "insights-runtime-extractor-tls" not found
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065285    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-modprobe-d\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065302    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-var-lib-kubelet\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065318    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-device-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065318    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-host\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065328    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-run-k8s-cni-cncf-io\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065360    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-run-k8s-cni-cncf-io\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065373    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-var-lib-openvswitch\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065393    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-systemd-units\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065401    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-var-lib-kubelet\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065411    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-log-socket\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065449    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-var-lib-openvswitch\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065451    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-systemd-units\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065471    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-var-lib-cni-bin\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065499    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-multus-conf-dir\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065516    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-kubernetes\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065444    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-log-socket\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065536    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-lib-modules\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065552    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53725f0f-4d8e-4270-b319-3943c040f794-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065554    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-var-lib-cni-bin\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065554    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-multus-conf-dir\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065571    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-run-ovn\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065605    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-cni-bin\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.065619    4921 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065628    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.065656    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53725f0f-4d8e-4270-b319-3943c040f794-kube-rbac-proxy-cm podName:53725f0f-4d8e-4270-b319-3943c040f794 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:02.565645778 +0000 UTC m=+1.810501542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/53725f0f-4d8e-4270-b319-3943c040f794-kube-rbac-proxy-cm") pod "insights-runtime-extractor-894kd" (UID: "53725f0f-4d8e-4270-b319-3943c040f794") : configmap "kube-rbac-proxy" not found
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065618    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-kubernetes\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065660    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-cni-bin\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065672    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-lib-modules\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065675    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-run-ovn\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065676    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.065686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065696    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065714    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065731    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-multus-socket-dir-parent\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065771    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-multus-socket-dir-parent\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.065804    4921 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.065806    4921 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065846    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-var-lib-cni-multus\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.065861    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs podName:f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b nodeName:}" failed. No retries permitted until 2026-10-30 23:19:02.565845331 +0000 UTC m=+1.810701080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs") pod "router-default-54c94948b5-5fm4s" (UID: "f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b") : secret "router-metrics-certs-default" not found
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065878    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-var-lib-cni-multus\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.065890    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls podName:d3c8853f-5927-4411-b293-0030e7f43312 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:02.565880791 +0000 UTC m=+1.810736540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-rrnzh" (UID: "d3c8853f-5927-4411-b293-0030e7f43312") : secret "samples-operator-tls" not found
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065924    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-socket-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065950    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065974    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-dbus\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.065997    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1d1b3c8-a603-476b-b51d-8add45d50b13-system-cni-dir\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066021    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/deb3bcf9-5f63-469d-b5d5-c5d62ffada99-host\") pod \"node-ca-xjtcb\" (UID: \"deb3bcf9-5f63-469d-b5d5-c5d62ffada99\") " pod="openshift-image-registry/node-ca-xjtcb"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066024    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-socket-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066028    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066047    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1d1b3c8-a603-476b-b51d-8add45d50b13-system-cni-dir\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066055    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-dbus\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066060    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-cnibin\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066083    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066105    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-run-ovn-kubernetes\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066117    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/deb3bcf9-5f63-469d-b5d5-c5d62ffada99-host\") pod \"node-ca-xjtcb\" (UID: \"deb3bcf9-5f63-469d-b5d5-c5d62ffada99\") " pod="openshift-image-registry/node-ca-xjtcb"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066122    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-cnibin\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066132    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-z84cb\" (UID: \"84480344-bd78-4528-bfe4-29b67541a818\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066155    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-run-ovn-kubernetes\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066158    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.066172    4921 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.066182    4921 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066195    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066203    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.066209    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls podName:5ba7c1ba-4162-430e-b267-ebf3f9844750 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:02.566195981 +0000 UTC m=+1.811051727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls") pod "dns-default-295nz" (UID: "5ba7c1ba-4162-430e-b267-ebf3f9844750") : secret "dns-default-metrics-tls" not found
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066236    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-sys-fs\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.066241    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert podName:84480344-bd78-4528-bfe4-29b67541a818 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:02.566230209 +0000 UTC m=+1.811085988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-z84cb" (UID: "84480344-bd78-4528-bfe4-29b67541a818") : secret "networking-console-plugin-cert" not found
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066264    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-hostroot\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.066277    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle podName:f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b nodeName:}" failed. No retries permitted until 2026-10-30 23:19:02.566264969 +0000 UTC m=+1.811120741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle") pod "router-default-54c94948b5-5fm4s" (UID: "f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b") : configmap references non-existent config key: service-ca.crt
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066281    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-sys-fs\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066295    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-hostroot\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066302    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-etc-openvswitch\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066328    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9047f37e-2d3c-4978-a5c1-4078d505ab15-hosts-file\") pod \"node-resolver-pnk7r\" (UID: \"9047f37e-2d3c-4978-a5c1-4078d505ab15\") " pod="openshift-dns/node-resolver-pnk7r"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066343    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-etc-kubernetes\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066345    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-etc-openvswitch\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066359    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-systemd\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066376    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-cni-netd\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066391    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-run\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066392    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9047f37e-2d3c-4978-a5c1-4078d505ab15-hosts-file\") pod \"node-resolver-pnk7r\" (UID: \"9047f37e-2d3c-4978-a5c1-4078d505ab15\") " pod="openshift-dns/node-resolver-pnk7r"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066408    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-etc-kubernetes\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066409    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-sysctl-d\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066431    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-cni-netd\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066436    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-systemd\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066436    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066447    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-run\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066496    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-sysctl-d\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066523    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-registration-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066539    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066553    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-system-cni-dir\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066586    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-run-systemd\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066620    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs\") pod \"network-metrics-daemon-bcpxq\" (UID: \"23c01b5c-af64-4567-9350-41572e762182\") " pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066631    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff444d55-69cb-484d-a989-9dcd7b96524f-registration-dir\") pod \"aws-ebs-csi-driver-node-jw5cw\" (UID: \"ff444d55-69cb-484d-a989-9dcd7b96524f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jw5cw"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066642    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-system-cni-dir\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066637    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1d1b3c8-a603-476b-b51d-8add45d50b13-cnibin\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066666    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-run-systemd\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066678    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1d1b3c8-a603-476b-b51d-8add45d50b13-cnibin\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066683    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-var-lib-kubelet\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.066711    4921 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066715    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-var-lib-kubelet\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066713    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-run-netns\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066746    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-sysctl-conf\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066745    4921 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066750    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-run-netns\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.066754    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs podName:23c01b5c-af64-4567-9350-41572e762182 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:02.566741362 +0000 UTC m=+1.811597110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs") pod "network-metrics-daemon-bcpxq" (UID: "23c01b5c-af64-4567-9350-41572e762182") : secret "metrics-daemon-secret" not found
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066801    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-sys\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066827    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1d1b3c8-a603-476b-b51d-8add45d50b13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066851    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-multus-cni-dir\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066862    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-sysctl-conf\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066868    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-sys\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066876    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/53725f0f-4d8e-4270-b319-3943c040f794-crio-socket\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066912    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-run-multus-certs\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066916    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-multus-cni-dir\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066916    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1d1b3c8-a603-476b-b51d-8add45d50b13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-smpnh\" (UID: \"b1d1b3c8-a603-476b-b51d-8add45d50b13\") " pod="openshift-multus/multus-additional-cni-plugins-smpnh"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066933    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-sysconfig\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066951    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/53725f0f-4d8e-4270-b319-3943c040f794-crio-socket\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066956    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-kubelet-config\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066986    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e911a1c-c73e-40ed-ba22-74845a60e738-etc-sysconfig\") pod \"tuned-jkxzf\" (UID: \"8e911a1c-c73e-40ed-ba22-74845a60e738\") " pod="openshift-cluster-node-tuning-operator/tuned-jkxzf"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066992    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1-kubelet-config\") pod \"global-pull-secret-syncer-nd66m\" (UID: \"1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1\") " pod="kube-system/global-pull-secret-syncer-nd66m"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066953    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54c28267-55bc-4f8e-bb07-47e47951468d-host-run-multus-certs\") pod \"multus-jr84v\" (UID: \"54c28267-55bc-4f8e-bb07-47e47951468d\") " pod="openshift-multus/multus-jr84v"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.066998    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d27d7b3-0f5f-4604-86b1-eeb9d380104f-host-slash\") pod \"iptables-alerter-l6h2l\" (UID: \"6d27d7b3-0f5f-4604-86b1-eeb9d380104f\") " pod="openshift-network-operator/iptables-alerter-l6h2l"
Oct 30 23:19:02.067046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.067025    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d27d7b3-0f5f-4604-86b1-eeb9d380104f-host-slash\") pod \"iptables-alerter-l6h2l\" (UID: \"6d27d7b3-0f5f-4604-86b1-eeb9d380104f\") " pod="openshift-network-operator/iptables-alerter-l6h2l"
Oct 30 23:19:02.070378 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.067024    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-slash\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.070378 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.067062    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/66938436-5c78-44c3-93f6-f52272cc9a6a-host-slash\") pod \"ovnkube-node-jkk8z\" (UID: \"66938436-5c78-44c3-93f6-f52272cc9a6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:02.070378 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.069000    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls\") pod \"image-registry-6888fc6c96-6gdwr\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") " pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:02.070378 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.069521    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls\") pod \"image-registry-7cf56b4bd9-285cx\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") " pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:02.142391 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.142358    4921 scope.go:122] "RemoveContainer" containerID="918efe4dcf661e709732583ce65b6af619d2f844c36a25e81025229a5b0a857a"
Oct 30 23:19:02.144459 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.144444    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:02.155263 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.155245    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:02.159868 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.159849    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:02.394185 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.394107    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:02.454043 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.454017    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cf56b4bd9-285cx"]
Oct 30 23:19:02.456691 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:02.456657    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb710ad88_e867_4ea3_a13b_394eb3d34c89.slice/crio-2e25234a2f51835b7ff66ae34c10f176c49f0bb9bdba949a9e550ef72ddd02d2 WatchSource:0}: Error finding container 2e25234a2f51835b7ff66ae34c10f176c49f0bb9bdba949a9e550ef72ddd02d2: Status 404 returned error can't find the container with id 2e25234a2f51835b7ff66ae34c10f176c49f0bb9bdba949a9e550ef72ddd02d2
Oct 30 23:19:02.470504 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.470469    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:19:02.470637 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.470620    4921 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 23:19:02.470715 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.470678    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls podName:dc691df1-3f27-4829-955d-99b66893279d nodeName:}" failed. No retries permitted until 2026-10-30 23:19:03.470664091 +0000 UTC m=+2.715519849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-2w6gp" (UID: "dc691df1-3f27-4829-955d-99b66893279d") : secret "cluster-monitoring-operator-tls" not found
Oct 30 23:19:02.486797 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.486773    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6888fc6c96-6gdwr"]
Oct 30 23:19:02.490038 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:02.490017    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda73f11a7_b4de_43b4_83de_cc7a630d25c3.slice/crio-d5f35ad8c7891a98896896662ad684dd479c6204107389a261ff85b86127cec6 WatchSource:0}: Error finding container d5f35ad8c7891a98896896662ad684dd479c6204107389a261ff85b86127cec6: Status 404 returned error can't find the container with id d5f35ad8c7891a98896896662ad684dd479c6204107389a261ff85b86127cec6
Oct 30 23:19:02.522168 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.522145    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:02.571898 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.571878    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:19:02.571980 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.571906    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-z84cb\" (UID: \"84480344-bd78-4528-bfe4-29b67541a818\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:19:02.571980 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.571927    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:02.571980 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.571971    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs\") pod \"network-metrics-daemon-bcpxq\" (UID: \"23c01b5c-af64-4567-9350-41572e762182\") " pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:19:02.572119 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.572015    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:02.572119 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.572020    4921 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 23:19:02.572119 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.572024    4921 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 23:19:02.572119 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.572073    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls podName:5ba7c1ba-4162-430e-b267-ebf3f9844750 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:03.572053135 +0000 UTC m=+2.816908896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls") pod "dns-default-295nz" (UID: "5ba7c1ba-4162-430e-b267-ebf3f9844750") : secret "dns-default-metrics-tls" not found
Oct 30 23:19:02.572119 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.572093    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53725f0f-4d8e-4270-b319-3943c040f794-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:02.572119 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.572101    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle podName:f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b nodeName:}" failed. No retries permitted until 2026-10-30 23:19:03.572085674 +0000 UTC m=+2.816941434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle") pod "router-default-54c94948b5-5fm4s" (UID: "f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b") : configmap references non-existent config key: service-ca.crt
Oct 30 23:19:02.572119 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.572114    4921 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 23:19:02.572119 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.572123    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert podName:84480344-bd78-4528-bfe4-29b67541a818 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:03.572116761 +0000 UTC m=+2.816972507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-z84cb" (UID: "84480344-bd78-4528-bfe4-29b67541a818") : secret "networking-console-plugin-cert" not found
Oct 30 23:19:02.572448 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.572129    4921 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 23:19:02.572448 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.572141    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls podName:53725f0f-4d8e-4270-b319-3943c040f794 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:03.572132727 +0000 UTC m=+2.816988473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls") pod "insights-runtime-extractor-894kd" (UID: "53725f0f-4d8e-4270-b319-3943c040f794") : secret "insights-runtime-extractor-tls" not found
Oct 30 23:19:02.572448 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.572157    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:02.572448 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.572182    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs podName:23c01b5c-af64-4567-9350-41572e762182 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:03.572166123 +0000 UTC m=+2.817021883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs") pod "network-metrics-daemon-bcpxq" (UID: "23c01b5c-af64-4567-9350-41572e762182") : secret "metrics-daemon-secret" not found
Oct 30 23:19:02.572448 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.572212    4921 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 23:19:02.572448 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.572238    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs podName:f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b nodeName:}" failed. No retries permitted until 2026-10-30 23:19:03.572231292 +0000 UTC m=+2.817087038 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs") pod "router-default-54c94948b5-5fm4s" (UID: "f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b") : secret "router-metrics-certs-default" not found
Oct 30 23:19:02.572448 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.572208    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:19:02.572448 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.572278    4921 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 23:19:02.572448 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.572324    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls podName:d3c8853f-5927-4411-b293-0030e7f43312 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:03.572311215 +0000 UTC m=+2.817166974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-rrnzh" (UID: "d3c8853f-5927-4411-b293-0030e7f43312") : secret "samples-operator-tls" not found
Oct 30 23:19:02.572756 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.572626    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53725f0f-4d8e-4270-b319-3943c040f794-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:02.939821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.938528    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr" event={"ID":"a73f11a7-b4de-43b4-83de-cc7a630d25c3","Type":"ContainerStarted","Data":"66837a30a6d28559ac4dc832a43eda3a5d5eb01d31ec00c0c0c47628a611b969"}
Oct 30 23:19:02.939821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.938671    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr" event={"ID":"a73f11a7-b4de-43b4-83de-cc7a630d25c3","Type":"ContainerStarted","Data":"d5f35ad8c7891a98896896662ad684dd479c6204107389a261ff85b86127cec6"}
Oct 30 23:19:02.941151 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.941118    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx" event={"ID":"b710ad88-e867-4ea3-a13b-394eb3d34c89","Type":"ContainerStarted","Data":"dfee9a6232fce4193628d3cbf6869a9f11e301ad2f8688411bb70f5d1f83a8c5"}
Oct 30 23:19:02.941330 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.941315    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx" event={"ID":"b710ad88-e867-4ea3-a13b-394eb3d34c89","Type":"ContainerStarted","Data":"2e25234a2f51835b7ff66ae34c10f176c49f0bb9bdba949a9e550ef72ddd02d2"}
Oct 30 23:19:02.943317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.943297    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 30 23:19:02.943769 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.943754    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/1.log"
Oct 30 23:19:02.943859 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.943783    4921 generic.go:356] "Generic (PLEG): container finished" podID="3536b8b5-e6a8-48c5-8319-8d75a7f4abd8" containerID="e5f7b2713e421439ac428a7eb945171af06625d565d350ab792df77e84a8cb44" exitCode=255
Oct 30 23:19:02.943859 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.943837    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244" event={"ID":"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8","Type":"ContainerDied","Data":"e5f7b2713e421439ac428a7eb945171af06625d565d350ab792df77e84a8cb44"}
Oct 30 23:19:02.943952 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.943897    4921 scope.go:122] "RemoveContainer" containerID="918efe4dcf661e709732583ce65b6af619d2f844c36a25e81025229a5b0a857a"
Oct 30 23:19:02.944432 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:02.944412    4921 scope.go:122] "RemoveContainer" containerID="e5f7b2713e421439ac428a7eb945171af06625d565d350ab792df77e84a8cb44"
Oct 30 23:19:02.944775 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:02.944710    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-qs244_openshift-console-operator(3536b8b5-e6a8-48c5-8319-8d75a7f4abd8)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244" podUID="3536b8b5-e6a8-48c5-8319-8d75a7f4abd8"
Oct 30 23:19:03.292277 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.292194    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:03.481611 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.481547    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:19:03.481799 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:03.481695    4921 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 23:19:03.481799 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:03.481771    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls podName:dc691df1-3f27-4829-955d-99b66893279d nodeName:}" failed. No retries permitted until 2026-10-30 23:19:05.481757058 +0000 UTC m=+4.726612804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-2w6gp" (UID: "dc691df1-3f27-4829-955d-99b66893279d") : secret "cluster-monitoring-operator-tls" not found
Oct 30 23:19:03.582305 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.582234    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs\") pod \"network-metrics-daemon-bcpxq\" (UID: \"23c01b5c-af64-4567-9350-41572e762182\") " pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:19:03.582305 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.582279    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:03.582485 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.582314    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:03.582485 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.582330    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:19:03.582485 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.582365    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:19:03.582485 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.582383    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-z84cb\" (UID: \"84480344-bd78-4528-bfe4-29b67541a818\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:19:03.582485 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.582408    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:03.582485 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:03.582469    4921 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 23:19:03.582485 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:03.582481    4921 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 23:19:03.582785 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:03.582493    4921 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 23:19:03.582785 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:03.582469    4921 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 23:19:03.582785 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:03.582537    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle podName:f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b nodeName:}" failed. No retries permitted until 2026-10-30 23:19:05.582520548 +0000 UTC m=+4.827376318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle") pod "router-default-54c94948b5-5fm4s" (UID: "f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b") : configmap references non-existent config key: service-ca.crt
Oct 30 23:19:03.582785 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:03.582537    4921 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 23:19:03.582785 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:03.582562    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs podName:f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b nodeName:}" failed. No retries permitted until 2026-10-30 23:19:05.582544892 +0000 UTC m=+4.827400655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs") pod "router-default-54c94948b5-5fm4s" (UID: "f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b") : secret "router-metrics-certs-default" not found
Oct 30 23:19:03.582785 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:03.582582    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls podName:5ba7c1ba-4162-430e-b267-ebf3f9844750 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:05.582573405 +0000 UTC m=+4.827429168 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls") pod "dns-default-295nz" (UID: "5ba7c1ba-4162-430e-b267-ebf3f9844750") : secret "dns-default-metrics-tls" not found
Oct 30 23:19:03.582785 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:03.582621    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls podName:d3c8853f-5927-4411-b293-0030e7f43312 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:05.582589231 +0000 UTC m=+4.827444976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-rrnzh" (UID: "d3c8853f-5927-4411-b293-0030e7f43312") : secret "samples-operator-tls" not found
Oct 30 23:19:03.582785 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:03.582644    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls podName:53725f0f-4d8e-4270-b319-3943c040f794 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:05.582634452 +0000 UTC m=+4.827490197 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls") pod "insights-runtime-extractor-894kd" (UID: "53725f0f-4d8e-4270-b319-3943c040f794") : secret "insights-runtime-extractor-tls" not found
Oct 30 23:19:03.582785 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:03.582660    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert podName:84480344-bd78-4528-bfe4-29b67541a818 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:05.582652276 +0000 UTC m=+4.827508026 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-z84cb" (UID: "84480344-bd78-4528-bfe4-29b67541a818") : secret "networking-console-plugin-cert" not found
Oct 30 23:19:03.584836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.584819    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c01b5c-af64-4567-9350-41572e762182-metrics-certs\") pod \"network-metrics-daemon-bcpxq\" (UID: \"23c01b5c-af64-4567-9350-41572e762182\") " pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:19:03.652885 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.652866    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpxq"
Oct 30 23:19:03.686519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.686486    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:03.900562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.900533    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:03.921347 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.921318    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bcpxq"]
Oct 30 23:19:03.924857 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:03.924833    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c01b5c_af64_4567_9350_41572e762182.slice/crio-1749ea97f0e9642611a6e86ad4b27db32db277924e0fc3fc451684b5401d5796 WatchSource:0}: Error finding container 1749ea97f0e9642611a6e86ad4b27db32db277924e0fc3fc451684b5401d5796: Status 404 returned error can't find the container with id 1749ea97f0e9642611a6e86ad4b27db32db277924e0fc3fc451684b5401d5796
Oct 30 23:19:03.926969 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.926947    4921 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 23:19:03.949121 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.949093    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bcpxq" event={"ID":"23c01b5c-af64-4567-9350-41572e762182","Type":"ContainerStarted","Data":"1749ea97f0e9642611a6e86ad4b27db32db277924e0fc3fc451684b5401d5796"}
Oct 30 23:19:03.950581 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.950563    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 30 23:19:03.950682 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.950669    4921 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 23:19:03.950759 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.950673    4921 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 23:19:03.992379 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:03.992359    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:04.096174 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:04.096150    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:04.102764 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:04.102667    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:04.328207 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:04.328133    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:04.493943 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:04.493892    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:04.836954 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:04.836924    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6kctl"
Oct 30 23:19:04.954828 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:04.954797    4921 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 23:19:05.299223 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.299190    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:05.476791 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.476716    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pnk7r_9047f37e-2d3c-4978-a5c1-4078d505ab15/dns-node-resolver/0.log"
Oct 30 23:19:05.505129 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.505106    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:19:05.505259 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:05.505243    4921 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 23:19:05.505326 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:05.505317    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls podName:dc691df1-3f27-4829-955d-99b66893279d nodeName:}" failed. No retries permitted until 2026-10-30 23:19:09.505302379 +0000 UTC m=+8.750158125 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-2w6gp" (UID: "dc691df1-3f27-4829-955d-99b66893279d") : secret "cluster-monitoring-operator-tls" not found
Oct 30 23:19:05.596020 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.595986    4921 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:19:05.596340 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.596326    4921 scope.go:122] "RemoveContainer" containerID="e5f7b2713e421439ac428a7eb945171af06625d565d350ab792df77e84a8cb44"
Oct 30 23:19:05.596540 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:05.596522    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-qs244_openshift-console-operator(3536b8b5-e6a8-48c5-8319-8d75a7f4abd8)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244" podUID="3536b8b5-e6a8-48c5-8319-8d75a7f4abd8"
Oct 30 23:19:05.606144 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.606118    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:05.606269 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.606162    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:05.606269 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.606181    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:19:05.606379 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:05.606272    4921 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 23:19:05.606379 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.606304    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:19:05.606379 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:05.606274    4921 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 23:19:05.606379 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:05.606328    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs podName:f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b nodeName:}" failed. No retries permitted until 2026-10-30 23:19:09.606309846 +0000 UTC m=+8.851165595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs") pod "router-default-54c94948b5-5fm4s" (UID: "f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b") : secret "router-metrics-certs-default" not found
Oct 30 23:19:05.606379 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:05.606367    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls podName:53725f0f-4d8e-4270-b319-3943c040f794 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:09.606351388 +0000 UTC m=+8.851207151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls") pod "insights-runtime-extractor-894kd" (UID: "53725f0f-4d8e-4270-b319-3943c040f794") : secret "insights-runtime-extractor-tls" not found
Oct 30 23:19:05.606379 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:05.606376    4921 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 23:19:05.606676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.606386    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-z84cb\" (UID: \"84480344-bd78-4528-bfe4-29b67541a818\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:19:05.606676 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:05.606408    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls podName:5ba7c1ba-4162-430e-b267-ebf3f9844750 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:09.606397502 +0000 UTC m=+8.851253248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls") pod "dns-default-295nz" (UID: "5ba7c1ba-4162-430e-b267-ebf3f9844750") : secret "dns-default-metrics-tls" not found
Oct 30 23:19:05.606676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.606445    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:05.606676 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:05.606451    4921 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 23:19:05.606676 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:05.606487    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert podName:84480344-bd78-4528-bfe4-29b67541a818 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:09.606476017 +0000 UTC m=+8.851331783 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-z84cb" (UID: "84480344-bd78-4528-bfe4-29b67541a818") : secret "networking-console-plugin-cert" not found
Oct 30 23:19:05.606676 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:05.606522    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle podName:f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b nodeName:}" failed. No retries permitted until 2026-10-30 23:19:09.606515609 +0000 UTC m=+8.851371392 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle") pod "router-default-54c94948b5-5fm4s" (UID: "f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b") : configmap references non-existent config key: service-ca.crt
Oct 30 23:19:05.608657 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.608636    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3c8853f-5927-4411-b293-0030e7f43312-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-rrnzh\" (UID: \"d3c8853f-5927-4411-b293-0030e7f43312\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:19:05.677302 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.677272    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6888fc6c96-6gdwr_a73f11a7-b4de-43b4-83de-cc7a630d25c3/registry/0.log"
Oct 30 23:19:05.699522 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.699488    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:05.743865 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.743787    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"
Oct 30 23:19:05.825832 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.825803    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:05.889014 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.888984    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7cf56b4bd9-285cx_b710ad88-e867-4ea3-a13b-394eb3d34c89/registry/0.log"
Oct 30 23:19:05.960265 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.960230    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bcpxq" event={"ID":"23c01b5c-af64-4567-9350-41572e762182","Type":"ContainerStarted","Data":"27e9dc9faf0e39f273e33d3fc7df6a6602a9ce22a4f55bcb20d6de75e0dc9aaa"}
Oct 30 23:19:05.960700 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.960291    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bcpxq" event={"ID":"23c01b5c-af64-4567-9350-41572e762182","Type":"ContainerStarted","Data":"3cef473b1f06bc0160cd0708b975ab050b1ff3e4e854a43f0e538441ceb1ac50"}
Oct 30 23:19:05.961118 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.961093    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:05.961819 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.961798    4921 generic.go:356] "Generic (PLEG): container finished" podID="bb5e9511-9532-4de4-9f4c-5e034cca2773" containerID="ff49d3903f680bbff89f7aff07d9ca9acb90fa9491b391cc60e22d97a90414d5" exitCode=0
Oct 30 23:19:05.961912 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.961863    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz" event={"ID":"bb5e9511-9532-4de4-9f4c-5e034cca2773","Type":"ContainerDied","Data":"ff49d3903f680bbff89f7aff07d9ca9acb90fa9491b391cc60e22d97a90414d5"}
Oct 30 23:19:05.962154 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.962140    4921 scope.go:122] "RemoveContainer" containerID="ff49d3903f680bbff89f7aff07d9ca9acb90fa9491b391cc60e22d97a90414d5"
Oct 30 23:19:05.963411 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.963360    4921 generic.go:356] "Generic (PLEG): container finished" podID="f9a4c974-1f79-40b2-9f49-427170c8764b" containerID="40f29213d66008beba5fe8d5da672d3abd69a56f29a0bf793cf91b590c3fc050" exitCode=0
Oct 30 23:19:05.963411 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.963389    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-qdr5f" event={"ID":"f9a4c974-1f79-40b2-9f49-427170c8764b","Type":"ContainerDied","Data":"40f29213d66008beba5fe8d5da672d3abd69a56f29a0bf793cf91b590c3fc050"}
Oct 30 23:19:05.963670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:05.963653    4921 scope.go:122] "RemoveContainer" containerID="40f29213d66008beba5fe8d5da672d3abd69a56f29a0bf793cf91b590c3fc050"
Oct 30 23:19:06.017897 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:06.017874    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh"]
Oct 30 23:19:06.102023 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:06.101988    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:06.314667 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:06.314576    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:06.476617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:06.476567    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xjtcb_deb3bcf9-5f63-469d-b5d5-c5d62ffada99/node-ca/0.log"
Oct 30 23:19:06.514342 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:06.514307    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:06.877165 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:06.877115    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fsbsg_b1846d39-a52a-442d-8216-10f0798dbc36/serve-healthcheck-canary/0.log"
Oct 30 23:19:06.969444 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:06.969404    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-qdr5f" event={"ID":"f9a4c974-1f79-40b2-9f49-427170c8764b","Type":"ContainerStarted","Data":"60a6557ea871166b9e8ae9df428de8bac6832914aa176fffef5a52b1680a14a6"}
Oct 30 23:19:06.971652 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:06.971627    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-7m2nz" event={"ID":"bb5e9511-9532-4de4-9f4c-5e034cca2773","Type":"ContainerStarted","Data":"072b8180c6b5bc0cccf0e5250c3320e077a239224c3b34257f543d044a0fc5d5"}
Oct 30 23:19:06.972944 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:06.972923    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh" event={"ID":"d3c8853f-5927-4411-b293-0030e7f43312","Type":"ContainerStarted","Data":"bdcaef4a33e2552510f6a4cfeeed59b35f28b5df7c0c288b3a26bb23601d8404"}
Oct 30 23:19:07.301332 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:07.301301    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:07.477747 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:07.477720    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-cj25s_bdb399c5-bad6-4310-9542-509884ea425a/migrator/0.log"
Oct 30 23:19:07.678755 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:07.678722    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9_ef3b49c5-63b0-4be5-8198-589cc7bc1ce6/kube-storage-version-migrator-operator/0.log"
Oct 30 23:19:07.712062 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:07.712025    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:07.848208 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:07.848177    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:07.975190 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:07.975107    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:08.105737 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:08.105698    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:08.493419 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:08.493382    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:08.955064 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:08.955033    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:19:08.982717 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:08.982685    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh" event={"ID":"d3c8853f-5927-4411-b293-0030e7f43312","Type":"ContainerStarted","Data":"bfa2265e9617994b91a69759263b7867d43c0f46caba095f059db259db5abce4"}
Oct 30 23:19:08.983125 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:08.982753    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-rrnzh" event={"ID":"d3c8853f-5927-4411-b293-0030e7f43312","Type":"ContainerStarted","Data":"ff8198890334038c9704b08b8c6446293f50f575114fd070f67ed3f2e55d493c"}
Oct 30 23:19:09.292565 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.292483    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:09.439524 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.439490    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:19:09.439899 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.439886    4921 scope.go:122] "RemoveContainer" containerID="e5f7b2713e421439ac428a7eb945171af06625d565d350ab792df77e84a8cb44"
Oct 30 23:19:09.440073 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:09.440056    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-qs244_openshift-console-operator(3536b8b5-e6a8-48c5-8319-8d75a7f4abd8)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244" podUID="3536b8b5-e6a8-48c5-8319-8d75a7f4abd8"
Oct 30 23:19:09.545856 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.545771    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:19:09.546013 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:09.545952    4921 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 23:19:09.546072 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:09.546039    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls podName:dc691df1-3f27-4829-955d-99b66893279d nodeName:}" failed. No retries permitted until 2026-10-30 23:19:17.546016688 +0000 UTC m=+16.790872453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-2w6gp" (UID: "dc691df1-3f27-4829-955d-99b66893279d") : secret "cluster-monitoring-operator-tls" not found
Oct 30 23:19:09.648333 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.648304    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:09.648495 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.648371    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:09.648495 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.648420    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:19:09.648495 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.648448    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-z84cb\" (UID: \"84480344-bd78-4528-bfe4-29b67541a818\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:19:09.648495 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:09.648464    4921 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 23:19:09.648756 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:09.648535    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls podName:53725f0f-4d8e-4270-b319-3943c040f794 nodeName:}" failed. No retries permitted until 2026-10-30 23:19:17.648515547 +0000 UTC m=+16.893371305 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls") pod "insights-runtime-extractor-894kd" (UID: "53725f0f-4d8e-4270-b319-3943c040f794") : secret "insights-runtime-extractor-tls" not found
Oct 30 23:19:09.648756 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.648474    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:09.649429 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.649408    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-service-ca-bundle\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:09.651107 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.651088    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b-metrics-certs\") pod \"router-default-54c94948b5-5fm4s\" (UID: \"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b\") " pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:09.651469 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.651446    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ba7c1ba-4162-430e-b267-ebf3f9844750-metrics-tls\") pod \"dns-default-295nz\" (UID: \"5ba7c1ba-4162-430e-b267-ebf3f9844750\") " pod="openshift-dns/dns-default-295nz"
Oct 30 23:19:09.651561 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.651546    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84480344-bd78-4528-bfe4-29b67541a818-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-z84cb\" (UID: \"84480344-bd78-4528-bfe4-29b67541a818\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:19:09.656054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.656034    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-295nz"
Oct 30 23:19:09.697208 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.697179    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:09.903303 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.903273    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:09.928803 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.928778    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-295nz"]
Oct 30 23:19:09.931836 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:09.931811    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ba7c1ba_4162_430e_b267_ebf3f9844750.slice/crio-827f47e44cf477016102bdc6681bc36a95988b6db01ca41bd7665f673e40ec1c WatchSource:0}: Error finding container 827f47e44cf477016102bdc6681bc36a95988b6db01ca41bd7665f673e40ec1c: Status 404 returned error can't find the container with id 827f47e44cf477016102bdc6681bc36a95988b6db01ca41bd7665f673e40ec1c
Oct 30 23:19:09.943364 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.943343    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:09.946456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.946441    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb"
Oct 30 23:19:09.990048 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:09.990013    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-295nz" event={"ID":"5ba7c1ba-4162-430e-b267-ebf3f9844750","Type":"ContainerStarted","Data":"827f47e44cf477016102bdc6681bc36a95988b6db01ca41bd7665f673e40ec1c"}
Oct 30 23:19:10.106256 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:10.106220    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:10.222232 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:10.222158    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-z84cb"]
Oct 30 23:19:10.225800 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:10.225767    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84480344_bd78_4528_bfe4_29b67541a818.slice/crio-7b86b8a9dbe711d350892b792cc9e4ffec97f47c12dd20dfafe0feeb50ceef9a WatchSource:0}: Error finding container 7b86b8a9dbe711d350892b792cc9e4ffec97f47c12dd20dfafe0feeb50ceef9a: Status 404 returned error can't find the container with id 7b86b8a9dbe711d350892b792cc9e4ffec97f47c12dd20dfafe0feeb50ceef9a
Oct 30 23:19:10.226320 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:10.226301    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54c94948b5-5fm4s"]
Oct 30 23:19:10.229183 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:10.229159    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ffe6e0_c2cd_4ff0_87ba_3817e376bc9b.slice/crio-bbe4037f059d5706d06dc70f123e024d2e8c319d1177e41bb302de4410ceecf9 WatchSource:0}: Error finding container bbe4037f059d5706d06dc70f123e024d2e8c319d1177e41bb302de4410ceecf9: Status 404 returned error can't find the container with id bbe4037f059d5706d06dc70f123e024d2e8c319d1177e41bb302de4410ceecf9
Oct 30 23:19:10.241379 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:10.241347    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:10.497054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:10.496967    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:10.851786 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:10.851707    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jkk8z"
Oct 30 23:19:10.956724 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:10.956689    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:10.995265 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:10.995230    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54c94948b5-5fm4s" event={"ID":"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b","Type":"ContainerStarted","Data":"5c75edf755ce0300f07b01385758ea49ae6fa2cdd557401b4b736ae5b5c4e78d"}
Oct 30 23:19:10.995731 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:10.995286    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54c94948b5-5fm4s" event={"ID":"f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b","Type":"ContainerStarted","Data":"bbe4037f059d5706d06dc70f123e024d2e8c319d1177e41bb302de4410ceecf9"}
Oct 30 23:19:10.996533 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:10.996510    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb" event={"ID":"84480344-bd78-4528-bfe4-29b67541a818","Type":"ContainerStarted","Data":"7b86b8a9dbe711d350892b792cc9e4ffec97f47c12dd20dfafe0feeb50ceef9a"}
Oct 30 23:19:11.327838 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:11.327804    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:11.700485 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:11.700453    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:11.897507 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:11.897483    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:11.944308 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:11.944279    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:11.946885 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:11.946864    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:12.001499 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:12.001414    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-z84cb" event={"ID":"84480344-bd78-4528-bfe4-29b67541a818","Type":"ContainerStarted","Data":"8786b0a3a1ed34205be9ed16d4b60b39f8df7b95e2f8ef8ecfac6a0cafb0b429"}
Oct 30 23:19:12.003338 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:12.003305    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-295nz" event={"ID":"5ba7c1ba-4162-430e-b267-ebf3f9844750","Type":"ContainerStarted","Data":"8be831064f5c056239c257d7438b949f2afc277637667850829ddcf8004b71ed"}
Oct 30 23:19:12.003473 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:12.003367    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-295nz" event={"ID":"5ba7c1ba-4162-430e-b267-ebf3f9844750","Type":"ContainerStarted","Data":"721fc15eb031a5face8f0847ca7858be212e476dc8055a6aa4f4798ae5957ea3"}
Oct 30 23:19:12.102487 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:12.102449    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:12.289041 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:12.288964    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:13.007306 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:13.007276    4921 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 23:19:13.008082 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:13.008060    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-295nz"
Oct 30 23:19:13.034823 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:13.034802    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:13.036039 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:13.036019    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-54c94948b5-5fm4s"
Oct 30 23:19:13.876356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:13.876318    4921 scope.go:122] "RemoveContainer" containerID="e5f7b2713e421439ac428a7eb945171af06625d565d350ab792df77e84a8cb44"
Oct 30 23:19:14.012783 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:14.012758    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 30 23:19:14.013224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:14.012875    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244" event={"ID":"3536b8b5-e6a8-48c5-8319-8d75a7f4abd8","Type":"ContainerStarted","Data":"23bafa6d4c07e492454b4c0b62c3e2cbee15d049dca69c8028969212b64aeb3d"}
Oct 30 23:19:14.013511 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:14.013492    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:19:14.153027 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:14.152994    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-qs244"
Oct 30 23:19:14.394523 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:14.394488    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:14.530238 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:14.530162    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:14.665244 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:14.665213    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:14.792174 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:14.792105    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:14.922953 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:14.922920    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:17.622406 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:17.622375    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:19:17.625075 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:17.625055    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc691df1-3f27-4829-955d-99b66893279d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2w6gp\" (UID: \"dc691df1-3f27-4829-955d-99b66893279d\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:19:17.723289 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:17.723248    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:17.725558 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:17.725533    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53725f0f-4d8e-4270-b319-3943c040f794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-894kd\" (UID: \"53725f0f-4d8e-4270-b319-3943c040f794\") " pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:17.742501 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:17.742482    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"
Oct 30 23:19:17.757639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:17.757618    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-894kd"
Oct 30 23:19:18.016851 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:18.016827    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp"]
Oct 30 23:19:18.019512 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:18.019483    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc691df1_3f27_4829_955d_99b66893279d.slice/crio-6f818cbc5e46cd4052cf4be74d20f4d81ec112eb4f1db78b6b7d6fc7abc5c78b WatchSource:0}: Error finding container 6f818cbc5e46cd4052cf4be74d20f4d81ec112eb4f1db78b6b7d6fc7abc5c78b: Status 404 returned error can't find the container with id 6f818cbc5e46cd4052cf4be74d20f4d81ec112eb4f1db78b6b7d6fc7abc5c78b
Oct 30 23:19:18.028631 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:18.028606    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp" event={"ID":"dc691df1-3f27-4829-955d-99b66893279d","Type":"ContainerStarted","Data":"6f818cbc5e46cd4052cf4be74d20f4d81ec112eb4f1db78b6b7d6fc7abc5c78b"}
Oct 30 23:19:18.040584 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:18.040557    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-894kd"]
Oct 30 23:19:18.043097 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:18.043074    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53725f0f_4d8e_4270_b319_3943c040f794.slice/crio-8e1741a8448b4894b0e1524109af827d4a9bcf2823d3c5174ccac1b9de3e9c32 WatchSource:0}: Error finding container 8e1741a8448b4894b0e1524109af827d4a9bcf2823d3c5174ccac1b9de3e9c32: Status 404 returned error can't find the container with id 8e1741a8448b4894b0e1524109af827d4a9bcf2823d3c5174ccac1b9de3e9c32
Oct 30 23:19:19.033653 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:19.033625    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-894kd" event={"ID":"53725f0f-4d8e-4270-b319-3943c040f794","Type":"ContainerStarted","Data":"589d8edaef53daf768c91456980fd276d9cbf6c3a4e9c4cbeb2023773ae53b85"}
Oct 30 23:19:19.033941 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:19.033682    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-894kd" event={"ID":"53725f0f-4d8e-4270-b319-3943c040f794","Type":"ContainerStarted","Data":"e3bb24d4b1c6ac8166af619a37f32762da1e6c138cb91329bc537733695add4c"}
Oct 30 23:19:19.033941 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:19.033703    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-894kd" event={"ID":"53725f0f-4d8e-4270-b319-3943c040f794","Type":"ContainerStarted","Data":"8e1741a8448b4894b0e1524109af827d4a9bcf2823d3c5174ccac1b9de3e9c32"}
Oct 30 23:19:19.380752 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:19.380674    4921 patch_prober.go:29] interesting pod/image-registry-7cf56b4bd9-285cx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 23:19:19.380752 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:19.380727    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx" podUID="b710ad88-e867-4ea3-a13b-394eb3d34c89" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:19:19.530793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:19.530750    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:19.656781 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:19.656752    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:20.235730 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:20.235692    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cf56b4bd9-285cx"]
Oct 30 23:19:20.247315 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:20.247047    4921 patch_prober.go:29] interesting pod/image-registry-7cf56b4bd9-285cx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 23:19:20.247315 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:20.247100    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx" podUID="b710ad88-e867-4ea3-a13b-394eb3d34c89" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:19:20.373581 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:20.373546    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:20.568818 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:20.568790    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:20.719494 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:20.719443    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:20.857476 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:20.857397    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:20.991754 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:20.991713    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:21.044425 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:21.044395    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-894kd" event={"ID":"53725f0f-4d8e-4270-b319-3943c040f794","Type":"ContainerStarted","Data":"1ce6cfa466a6ca9f6cd883b2b9ebbf23fd234de7341463e7dbc827728fe8ed55"}
Oct 30 23:19:21.045974 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:21.045946    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2w6gp" event={"ID":"dc691df1-3f27-4829-955d-99b66893279d","Type":"ContainerStarted","Data":"333764e3b14c64a1388f123665012b5f31ade0802116808a0e9f9d5dcce8cdc3"}
Oct 30 23:19:21.132514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:21.132445    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:21.341106 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:21.341072    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:21.637781 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:21.637754    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-295nz_5ba7c1ba-4162-430e-b267-ebf3f9844750/dns/0.log"
Oct 30 23:19:21.838279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:21.838205    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-295nz_5ba7c1ba-4162-430e-b267-ebf3f9844750/kube-rbac-proxy/0.log"
Oct 30 23:19:22.671092 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:22.671057    4921 patch_prober.go:29] interesting pod/image-registry-6888fc6c96-6gdwr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 23:19:22.671476 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:22.671116    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr" podUID="a73f11a7-b4de-43b4-83de-cc7a630d25c3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:19:22.837677 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:22.837646    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pnk7r_9047f37e-2d3c-4978-a5c1-4078d505ab15/dns-node-resolver/0.log"
Oct 30 23:19:23.014957 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:23.014889    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-295nz"
Oct 30 23:19:23.038528 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:23.038507    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6888fc6c96-6gdwr_a73f11a7-b4de-43b4-83de-cc7a630d25c3/registry/0.log"
Oct 30 23:19:23.438218 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:23.438192    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7cf56b4bd9-285cx_b710ad88-e867-4ea3-a13b-394eb3d34c89/registry/0.log"
Oct 30 23:19:24.037956 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:24.037934    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xjtcb_deb3bcf9-5f63-469d-b5d5-c5d62ffada99/node-ca/0.log"
Oct 30 23:19:24.108134 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:24.108099    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:24.244961 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:24.244928    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54c94948b5-5fm4s_f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b/router/0.log"
Oct 30 23:19:24.248251 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:24.248223    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:24.437051 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:24.437021    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fsbsg_b1846d39-a52a-442d-8216-10f0798dbc36/serve-healthcheck-canary/0.log"
Oct 30 23:19:25.132911 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:25.132879    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:25.274617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:25.274568    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:25.914558 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:25.914526    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:26.044449 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:26.044416    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:26.319732 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:26.319667    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:19:26.536666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:26.536639    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:26.679870 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:26.679845    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:26.809463 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:26.809435    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:26.937710 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:26.937616    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:27.108488 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:27.108456    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:27.236575 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:27.236496    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:28.276824 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.276781    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:28.439453 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.439421    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:28.513214 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.513178    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s4mg4"]
Oct 30 23:19:28.554101 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.554035    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.584702 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.584675    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:28.588780 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.588745    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 23:19:28.588780 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.588761    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 23:19:28.588937 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.588812    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hgj94\""
Oct 30 23:19:28.601292 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.601263    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 23:19:28.601496 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.601481    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 23:19:28.705822 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.705795    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:28.711913 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.711886    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9e56af7-2986-45dc-b083-496f7f618e98-node-exporter-textfile\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.712027 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.711928    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9e56af7-2986-45dc-b083-496f7f618e98-root\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.712027 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.711962    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9e56af7-2986-45dc-b083-496f7f618e98-sys\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.712103 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.712069    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9e56af7-2986-45dc-b083-496f7f618e98-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.712103 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.712094    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lcx7\" (UniqueName: \"kubernetes.io/projected/e9e56af7-2986-45dc-b083-496f7f618e98-kube-api-access-8lcx7\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.712186 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.712120    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9e56af7-2986-45dc-b083-496f7f618e98-metrics-client-ca\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.712244 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.712226    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9e56af7-2986-45dc-b083-496f7f618e98-node-exporter-tls\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.712334 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.712263    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9e56af7-2986-45dc-b083-496f7f618e98-node-exporter-wtmp\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.712334 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.712283    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9e56af7-2986-45dc-b083-496f7f618e98-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.812812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.812739    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9e56af7-2986-45dc-b083-496f7f618e98-node-exporter-wtmp\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.812812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.812774    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9e56af7-2986-45dc-b083-496f7f618e98-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.813031 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.812817    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9e56af7-2986-45dc-b083-496f7f618e98-node-exporter-textfile\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.813031 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.812845    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9e56af7-2986-45dc-b083-496f7f618e98-root\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.813031 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.812871    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9e56af7-2986-45dc-b083-496f7f618e98-sys\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.813031 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.812902    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9e56af7-2986-45dc-b083-496f7f618e98-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.813031 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.812929    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9e56af7-2986-45dc-b083-496f7f618e98-node-exporter-wtmp\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.813031 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.812957    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9e56af7-2986-45dc-b083-496f7f618e98-root\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.813031 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.812932    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lcx7\" (UniqueName: \"kubernetes.io/projected/e9e56af7-2986-45dc-b083-496f7f618e98-kube-api-access-8lcx7\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.813031 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.813032    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9e56af7-2986-45dc-b083-496f7f618e98-metrics-client-ca\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.813388 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.812971    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9e56af7-2986-45dc-b083-496f7f618e98-sys\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.813388 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.813077    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9e56af7-2986-45dc-b083-496f7f618e98-node-exporter-tls\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.813388 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.813299    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9e56af7-2986-45dc-b083-496f7f618e98-node-exporter-textfile\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.813632 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.813609    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9e56af7-2986-45dc-b083-496f7f618e98-metrics-client-ca\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.813827 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.813806    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9e56af7-2986-45dc-b083-496f7f618e98-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.815362 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.815342    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9e56af7-2986-45dc-b083-496f7f618e98-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.815842 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.815821    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9e56af7-2986-45dc-b083-496f7f618e98-node-exporter-tls\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.825465 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.825436    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lcx7\" (UniqueName: \"kubernetes.io/projected/e9e56af7-2986-45dc-b083-496f7f618e98-kube-api-access-8lcx7\") pod \"node-exporter-s4mg4\" (UID: \"e9e56af7-2986-45dc-b083-496f7f618e98\") " pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.835373 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.835352    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:28.903890 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.903863    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s4mg4"
Oct 30 23:19:28.943938 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:19:28.943884    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9e56af7_2986_45dc_b083_496f7f618e98.slice/crio-9baa39c5cde534e83921aebe9b43bcdca93ef80446ef269906d41f5054de6b4b WatchSource:0}: Error finding container 9baa39c5cde534e83921aebe9b43bcdca93ef80446ef269906d41f5054de6b4b: Status 404 returned error can't find the container with id 9baa39c5cde534e83921aebe9b43bcdca93ef80446ef269906d41f5054de6b4b
Oct 30 23:19:28.957571 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.957551    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mhrmm"
Oct 30 23:19:28.972817 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:28.972795    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:29.078264 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:29.078197    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4mg4" event={"ID":"e9e56af7-2986-45dc-b083-496f7f618e98","Type":"ContainerStarted","Data":"9baa39c5cde534e83921aebe9b43bcdca93ef80446ef269906d41f5054de6b4b"}
Oct 30 23:19:29.105708 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:29.105673    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:29.531749 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:29.531716    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:29.736073 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:29.736039    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:29.874942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:29.874836    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:30.240224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:30.240199    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:31.087463 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:31.087429    4921 generic.go:356] "Generic (PLEG): container finished" podID="e9e56af7-2986-45dc-b083-496f7f618e98" containerID="fa4f716c317d4cd5472813e78ae9e6cc95ba0320d0e7fe579888a30b69270430" exitCode=0
Oct 30 23:19:31.087897 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:31.087513    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4mg4" event={"ID":"e9e56af7-2986-45dc-b083-496f7f618e98","Type":"ContainerDied","Data":"fa4f716c317d4cd5472813e78ae9e6cc95ba0320d0e7fe579888a30b69270430"}
Oct 30 23:19:31.479816 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:31.479781    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:31.609579 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:31.609546    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:31.809017 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:31.808915    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:32.009105 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:32.009057    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:32.093698 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:32.093619    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4mg4" event={"ID":"e9e56af7-2986-45dc-b083-496f7f618e98","Type":"ContainerStarted","Data":"1cfda32ceadfab1ea428662b821ac1c1baee1fcda7898440e76480592b2b96a6"}
Oct 30 23:19:32.093698 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:32.093691    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4mg4" event={"ID":"e9e56af7-2986-45dc-b083-496f7f618e98","Type":"ContainerStarted","Data":"1b73b1c85d246c4a35a784069a8d364e33e5c3c0ba393a540cb75cfe04392e4f"}
Oct 30 23:19:32.116342 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:32.116206    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s4mg4" podStartSLOduration=2.351347166 podStartE2EDuration="4.116189278s" totalImagesPullingTime="1.682727302s" totalInitContainerRuntime="82.11481ms" isStatefulPod=true podCreationTimestamp="2026-10-30 23:19:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:19:32.115116483 +0000 UTC m=+31.359972253" watchObservedRunningTime="2026-10-30 23:19:32.116189278 +0000 UTC m=+31.361045044"
Oct 30 23:19:32.144347 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:32.144319    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:33.319358 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:33.319328    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:33.446042 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:33.446009    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:33.646276 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:33.646241    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:34.025789 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:34.025716    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:34.144486 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:34.144459    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:34.797108 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:34.797062    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:35.948881 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:35.948843    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:36.101289 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:36.101263    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:40.150527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:40.150495    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:40.289795 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:40.289763    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:41.181696 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:41.181661    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:41.315808 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:41.315775    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:41.402970 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:41.402939    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:19:41.573534 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:41.573439    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:41.703217 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:41.703185    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:42.404140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:42.404111    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6888fc6c96-6gdwr"]
Oct 30 23:19:42.551517 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:42.551473    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:42.693526 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:42.693434    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:43.277492 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:43.277445    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:43.412969 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:43.412937    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:43.543858 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:43.543773    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:45.218366 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.218332    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:45.263405 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.263369    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx" podUID="b710ad88-e867-4ea3-a13b-394eb3d34c89" containerName="registry" containerID="cri-o://dfee9a6232fce4193628d3cbf6869a9f11e301ad2f8688411bb70f5d1f83a8c5" gracePeriod=30
Oct 30 23:19:45.368140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.368109    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:45.513189 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.513168    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:45.557580 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.557552    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b710ad88-e867-4ea3-a13b-394eb3d34c89-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b710ad88-e867-4ea3-a13b-394eb3d34c89-ca-trust-extracted\") pod \"b710ad88-e867-4ea3-a13b-394eb3d34c89\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") "
Oct 30 23:19:45.557743 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.557613    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-kube-api-access-v7szx\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-kube-api-access-v7szx\") pod \"b710ad88-e867-4ea3-a13b-394eb3d34c89\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") "
Oct 30 23:19:45.557743 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.557635    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-certificates\") pod \"b710ad88-e867-4ea3-a13b-394eb3d34c89\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") "
Oct 30 23:19:45.557743 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.557672    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-trusted-ca\") pod \"b710ad88-e867-4ea3-a13b-394eb3d34c89\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") "
Oct 30 23:19:45.557743 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.557694    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-image-registry-private-configuration\") pod \"b710ad88-e867-4ea3-a13b-394eb3d34c89\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") "
Oct 30 23:19:45.557743 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.557715    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls\") pod \"b710ad88-e867-4ea3-a13b-394eb3d34c89\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") "
Oct 30 23:19:45.558026 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.557767    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-bound-sa-token\") pod \"b710ad88-e867-4ea3-a13b-394eb3d34c89\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") "
Oct 30 23:19:45.558026 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.557796    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-installation-pull-secrets\") pod \"b710ad88-e867-4ea3-a13b-394eb3d34c89\" (UID: \"b710ad88-e867-4ea3-a13b-394eb3d34c89\") "
Oct 30 23:19:45.558136 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.558118    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-certificates" pod "b710ad88-e867-4ea3-a13b-394eb3d34c89" (UID: "b710ad88-e867-4ea3-a13b-394eb3d34c89"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:19:45.559476 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.559447    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-trusted-ca" pod "b710ad88-e867-4ea3-a13b-394eb3d34c89" (UID: "b710ad88-e867-4ea3-a13b-394eb3d34c89"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:19:45.560758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.560728    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-image-registry-private-configuration" pod "b710ad88-e867-4ea3-a13b-394eb3d34c89" (UID: "b710ad88-e867-4ea3-a13b-394eb3d34c89"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:19:45.560891 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.560864    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls" pod "b710ad88-e867-4ea3-a13b-394eb3d34c89" (UID: "b710ad88-e867-4ea3-a13b-394eb3d34c89"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:19:45.561007 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.560988    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-installation-pull-secrets" pod "b710ad88-e867-4ea3-a13b-394eb3d34c89" (UID: "b710ad88-e867-4ea3-a13b-394eb3d34c89"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:19:45.561068 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.561040    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-kube-api-access-v7szx" pod "b710ad88-e867-4ea3-a13b-394eb3d34c89" (UID: "b710ad88-e867-4ea3-a13b-394eb3d34c89"). InnerVolumeSpecName "kube-api-access-v7szx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:19:45.561214 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.561196    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-bound-sa-token" pod "b710ad88-e867-4ea3-a13b-394eb3d34c89" (UID: "b710ad88-e867-4ea3-a13b-394eb3d34c89"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:19:45.564834 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.564813    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b710ad88-e867-4ea3-a13b-394eb3d34c89-ca-trust-extracted" pod "b710ad88-e867-4ea3-a13b-394eb3d34c89" (UID: "b710ad88-e867-4ea3-a13b-394eb3d34c89"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:19:45.659243 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.659215    4921 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-trusted-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:19:45.659243 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.659242    4921 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-image-registry-private-configuration\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:19:45.659433 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.659252    4921 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:19:45.659433 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.659263    4921 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-bound-sa-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:19:45.659433 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.659273    4921 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b710ad88-e867-4ea3-a13b-394eb3d34c89-installation-pull-secrets\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:19:45.659433 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.659282    4921 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b710ad88-e867-4ea3-a13b-394eb3d34c89-ca-trust-extracted\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:19:45.659433 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.659291    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7szx\" (UniqueName: \"kubernetes.io/projected/b710ad88-e867-4ea3-a13b-394eb3d34c89-kube-api-access-v7szx\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:19:45.659433 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:45.659300    4921 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b710ad88-e867-4ea3-a13b-394eb3d34c89-registry-certificates\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:19:46.152465 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:46.152425    4921 generic.go:356] "Generic (PLEG): container finished" podID="b710ad88-e867-4ea3-a13b-394eb3d34c89" containerID="dfee9a6232fce4193628d3cbf6869a9f11e301ad2f8688411bb70f5d1f83a8c5" exitCode=0
Oct 30 23:19:46.152659 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:46.152477    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx"
Oct 30 23:19:46.152659 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:46.152475    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx" event={"ID":"b710ad88-e867-4ea3-a13b-394eb3d34c89","Type":"ContainerDied","Data":"dfee9a6232fce4193628d3cbf6869a9f11e301ad2f8688411bb70f5d1f83a8c5"}
Oct 30 23:19:46.152659 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:46.152584    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cf56b4bd9-285cx" event={"ID":"b710ad88-e867-4ea3-a13b-394eb3d34c89","Type":"ContainerDied","Data":"2e25234a2f51835b7ff66ae34c10f176c49f0bb9bdba949a9e550ef72ddd02d2"}
Oct 30 23:19:46.152659 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:46.152634    4921 scope.go:122] "RemoveContainer" containerID="dfee9a6232fce4193628d3cbf6869a9f11e301ad2f8688411bb70f5d1f83a8c5"
Oct 30 23:19:46.161357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:46.161338    4921 scope.go:122] "RemoveContainer" containerID="dfee9a6232fce4193628d3cbf6869a9f11e301ad2f8688411bb70f5d1f83a8c5"
Oct 30 23:19:46.161655 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:19:46.161634    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfee9a6232fce4193628d3cbf6869a9f11e301ad2f8688411bb70f5d1f83a8c5\": container with ID starting with dfee9a6232fce4193628d3cbf6869a9f11e301ad2f8688411bb70f5d1f83a8c5 not found: ID does not exist" containerID="dfee9a6232fce4193628d3cbf6869a9f11e301ad2f8688411bb70f5d1f83a8c5"
Oct 30 23:19:46.161699 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:46.161664    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfee9a6232fce4193628d3cbf6869a9f11e301ad2f8688411bb70f5d1f83a8c5"} err="failed to get container status \"dfee9a6232fce4193628d3cbf6869a9f11e301ad2f8688411bb70f5d1f83a8c5\": rpc error: code = NotFound desc = could not find container \"dfee9a6232fce4193628d3cbf6869a9f11e301ad2f8688411bb70f5d1f83a8c5\": container with ID starting with dfee9a6232fce4193628d3cbf6869a9f11e301ad2f8688411bb70f5d1f83a8c5 not found: ID does not exist"
Oct 30 23:19:46.173077 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:46.173054    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cf56b4bd9-285cx"]
Oct 30 23:19:46.177152 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:46.177131    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7cf56b4bd9-285cx"]
Oct 30 23:19:46.882995 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:46.882953    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b710ad88-e867-4ea3-a13b-394eb3d34c89" path="/var/lib/kubelet/pods/b710ad88-e867-4ea3-a13b-394eb3d34c89/volumes"
Oct 30 23:19:50.708884 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:50.708830    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:50.866431 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:50.866393    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:55.130867 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:55.130836    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:55.253332 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:55.253289    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:56.043292 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:56.043261    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:19:56.170001 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:19:56.169968    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:20:02.887906 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:02.887867    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:20:03.023097 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:03.023067    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:20:03.260243 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:03.260155    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:20:03.402728 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:03.402696    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:20:05.514785 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:05.514744    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:20:05.689340 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:05.689305    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:20:07.379835 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.379800    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:20:07.425797 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.425745    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr" podUID="a73f11a7-b4de-43b4-83de-cc7a630d25c3" containerName="registry" containerID="cri-o://66837a30a6d28559ac4dc832a43eda3a5d5eb01d31ec00c0c0c47628a611b969" gracePeriod=30
Oct 30 23:20:07.507449 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.507415    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:20:07.680092 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.680067    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:20:07.724885 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.724853    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls\") pod \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") "
Oct 30 23:20:07.725037 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.724904    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-trusted-ca\") pod \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") "
Oct 30 23:20:07.725037 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.724955    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-image-registry-private-configuration\") pod \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") "
Oct 30 23:20:07.725037 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.724983    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-certificates\") pod \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") "
Oct 30 23:20:07.725037 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.725033    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-installation-pull-secrets\") pod \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") "
Oct 30 23:20:07.725252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.725061    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-bound-sa-token\") pod \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") "
Oct 30 23:20:07.725252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.725094    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a73f11a7-b4de-43b4-83de-cc7a630d25c3-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a73f11a7-b4de-43b4-83de-cc7a630d25c3-ca-trust-extracted\") pod \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") "
Oct 30 23:20:07.725252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.725146    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-kube-api-access-hmdlw\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-kube-api-access-hmdlw\") pod \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\" (UID: \"a73f11a7-b4de-43b4-83de-cc7a630d25c3\") "
Oct 30 23:20:07.725410 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.725383    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-trusted-ca" pod "a73f11a7-b4de-43b4-83de-cc7a630d25c3" (UID: "a73f11a7-b4de-43b4-83de-cc7a630d25c3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:20:07.725718 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.725685    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-certificates" pod "a73f11a7-b4de-43b4-83de-cc7a630d25c3" (UID: "a73f11a7-b4de-43b4-83de-cc7a630d25c3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:20:07.730173 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.730130    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-image-registry-private-configuration" pod "a73f11a7-b4de-43b4-83de-cc7a630d25c3" (UID: "a73f11a7-b4de-43b4-83de-cc7a630d25c3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:20:07.730173 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.730145    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls" pod "a73f11a7-b4de-43b4-83de-cc7a630d25c3" (UID: "a73f11a7-b4de-43b4-83de-cc7a630d25c3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:20:07.730173 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.730153    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-kube-api-access-hmdlw" pod "a73f11a7-b4de-43b4-83de-cc7a630d25c3" (UID: "a73f11a7-b4de-43b4-83de-cc7a630d25c3"). InnerVolumeSpecName "kube-api-access-hmdlw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:20:07.730464 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.730441    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-installation-pull-secrets" pod "a73f11a7-b4de-43b4-83de-cc7a630d25c3" (UID: "a73f11a7-b4de-43b4-83de-cc7a630d25c3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:20:07.730533 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.730469    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-bound-sa-token" pod "a73f11a7-b4de-43b4-83de-cc7a630d25c3" (UID: "a73f11a7-b4de-43b4-83de-cc7a630d25c3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:20:07.733501 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.733476    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a73f11a7-b4de-43b4-83de-cc7a630d25c3-ca-trust-extracted" pod "a73f11a7-b4de-43b4-83de-cc7a630d25c3" (UID: "a73f11a7-b4de-43b4-83de-cc7a630d25c3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:20:07.826086 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.826050    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmdlw\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-kube-api-access-hmdlw\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:20:07.826086 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.826081    4921 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:20:07.826086 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.826091    4921 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-trusted-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:20:07.826306 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.826102    4921 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-image-registry-private-configuration\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:20:07.826306 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.826111    4921 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a73f11a7-b4de-43b4-83de-cc7a630d25c3-registry-certificates\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:20:07.826306 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.826120    4921 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a73f11a7-b4de-43b4-83de-cc7a630d25c3-installation-pull-secrets\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:20:07.826306 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.826128    4921 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a73f11a7-b4de-43b4-83de-cc7a630d25c3-bound-sa-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:20:07.826306 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:07.826137    4921 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a73f11a7-b4de-43b4-83de-cc7a630d25c3-ca-trust-extracted\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:20:08.235500 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:08.235471    4921 generic.go:356] "Generic (PLEG): container finished" podID="a73f11a7-b4de-43b4-83de-cc7a630d25c3" containerID="66837a30a6d28559ac4dc832a43eda3a5d5eb01d31ec00c0c0c47628a611b969" exitCode=0
Oct 30 23:20:08.235704 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:08.235521    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr"
Oct 30 23:20:08.235704 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:08.235557    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr" event={"ID":"a73f11a7-b4de-43b4-83de-cc7a630d25c3","Type":"ContainerDied","Data":"66837a30a6d28559ac4dc832a43eda3a5d5eb01d31ec00c0c0c47628a611b969"}
Oct 30 23:20:08.235704 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:08.235631    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6888fc6c96-6gdwr" event={"ID":"a73f11a7-b4de-43b4-83de-cc7a630d25c3","Type":"ContainerDied","Data":"d5f35ad8c7891a98896896662ad684dd479c6204107389a261ff85b86127cec6"}
Oct 30 23:20:08.235704 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:08.235653    4921 scope.go:122] "RemoveContainer" containerID="66837a30a6d28559ac4dc832a43eda3a5d5eb01d31ec00c0c0c47628a611b969"
Oct 30 23:20:08.246188 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:08.246165    4921 scope.go:122] "RemoveContainer" containerID="66837a30a6d28559ac4dc832a43eda3a5d5eb01d31ec00c0c0c47628a611b969"
Oct 30 23:20:08.246453 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:20:08.246429    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66837a30a6d28559ac4dc832a43eda3a5d5eb01d31ec00c0c0c47628a611b969\": container with ID starting with 66837a30a6d28559ac4dc832a43eda3a5d5eb01d31ec00c0c0c47628a611b969 not found: ID does not exist" containerID="66837a30a6d28559ac4dc832a43eda3a5d5eb01d31ec00c0c0c47628a611b969"
Oct 30 23:20:08.246515 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:08.246462    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66837a30a6d28559ac4dc832a43eda3a5d5eb01d31ec00c0c0c47628a611b969"} err="failed to get container status \"66837a30a6d28559ac4dc832a43eda3a5d5eb01d31ec00c0c0c47628a611b969\": rpc error: code = NotFound desc = could not find container \"66837a30a6d28559ac4dc832a43eda3a5d5eb01d31ec00c0c0c47628a611b969\": container with ID starting with 66837a30a6d28559ac4dc832a43eda3a5d5eb01d31ec00c0c0c47628a611b969 not found: ID does not exist"
Oct 30 23:20:08.273002 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:08.272949    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6888fc6c96-6gdwr"]
Oct 30 23:20:08.279136 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:08.279106    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6888fc6c96-6gdwr"]
Oct 30 23:20:08.880298 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:08.880266    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a73f11a7-b4de-43b4-83de-cc7a630d25c3" path="/var/lib/kubelet/pods/a73f11a7-b4de-43b4-83de-cc7a630d25c3/volumes"
Oct 30 23:20:10.125162 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:10.125117    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:20:10.248119 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:10.248086    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:20:10.537439 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:10.537410    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:20:10.670945 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:10.670914    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:20:11.401571 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:20:11.401534    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:20:15.279101 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:15.279052    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:20:16.270082 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:16.270049    4921 generic.go:356] "Generic (PLEG): container finished" podID="f9a4c974-1f79-40b2-9f49-427170c8764b" containerID="60a6557ea871166b9e8ae9df428de8bac6832914aa176fffef5a52b1680a14a6" exitCode=0
Oct 30 23:20:16.270244 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:16.270095    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-qdr5f" event={"ID":"f9a4c974-1f79-40b2-9f49-427170c8764b","Type":"ContainerDied","Data":"60a6557ea871166b9e8ae9df428de8bac6832914aa176fffef5a52b1680a14a6"}
Oct 30 23:20:16.270244 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:16.270140    4921 scope.go:122] "RemoveContainer" containerID="40f29213d66008beba5fe8d5da672d3abd69a56f29a0bf793cf91b590c3fc050"
Oct 30 23:20:16.270453 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:16.270428    4921 scope.go:122] "RemoveContainer" containerID="60a6557ea871166b9e8ae9df428de8bac6832914aa176fffef5a52b1680a14a6"
Oct 30 23:20:16.270710 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:20:16.270683    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"insights-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=insights-operator pod=insights-operator-7c4986d449-qdr5f_openshift-insights(f9a4c974-1f79-40b2-9f49-427170c8764b)\"" pod="openshift-insights/insights-operator-7c4986d449-qdr5f" podUID="f9a4c974-1f79-40b2-9f49-427170c8764b"
Oct 30 23:20:17.275336 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:17.275307    4921 generic.go:356] "Generic (PLEG): container finished" podID="ef3b49c5-63b0-4be5-8198-589cc7bc1ce6" containerID="0084b034fe7fb71d84cc8f774b821c53291e3b62602e4d5f1ab62a994fe33aca" exitCode=0
Oct 30 23:20:17.275820 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:17.275380    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9" event={"ID":"ef3b49c5-63b0-4be5-8198-589cc7bc1ce6","Type":"ContainerDied","Data":"0084b034fe7fb71d84cc8f774b821c53291e3b62602e4d5f1ab62a994fe33aca"}
Oct 30 23:20:17.275820 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:17.275718    4921 scope.go:122] "RemoveContainer" containerID="0084b034fe7fb71d84cc8f774b821c53291e3b62602e4d5f1ab62a994fe33aca"
Oct 30 23:20:18.287311 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:18.287278    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-pv2k9" event={"ID":"ef3b49c5-63b0-4be5-8198-589cc7bc1ce6","Type":"ContainerStarted","Data":"6ce1eb6726bcbdcb29cce4d7c6ddd531f3e5ee4584433cd6db59aec04ed7d407"}
Oct 30 23:20:28.875765 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:28.875738    4921 scope.go:122] "RemoveContainer" containerID="60a6557ea871166b9e8ae9df428de8bac6832914aa176fffef5a52b1680a14a6"
Oct 30 23:20:29.330360 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:29.330325    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-qdr5f" event={"ID":"f9a4c974-1f79-40b2-9f49-427170c8764b","Type":"ContainerStarted","Data":"9152d82b2bc69f573935358ec766b23ae7090092c4ff6c8ab4daca5f167a502f"}
Oct 30 23:20:41.401115 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:20:41.401077    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:20:46.321413 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:46.321368    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:20:46.447230 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:46.447198    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:20:50.772290 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:20:50.772258    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:21:11.402541 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:21:11.402505    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:21:41.402000 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:21:41.401965    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:21:45.225494 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:45.225467    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:21:45.419522 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:45.419478    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:21:47.059323 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.059289    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"]
Oct 30 23:21:47.059787 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.059621    4921 cpu_manager.go:414] "containerMap: removing container" podUID="b710ad88-e867-4ea3-a13b-394eb3d34c89" containerName="registry"
Oct 30 23:21:47.059787 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.059636    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b710ad88-e867-4ea3-a13b-394eb3d34c89" containerName="registry"
Oct 30 23:21:47.059787 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.059650    4921 cpu_manager.go:414] "containerMap: removing container" podUID="a73f11a7-b4de-43b4-83de-cc7a630d25c3" containerName="registry"
Oct 30 23:21:47.059787 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.059655    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a73f11a7-b4de-43b4-83de-cc7a630d25c3" containerName="registry"
Oct 30 23:21:47.059787 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.059720    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="b710ad88-e867-4ea3-a13b-394eb3d34c89" containerName="registry"
Oct 30 23:21:47.059787 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.059728    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="a73f11a7-b4de-43b4-83de-cc7a630d25c3" containerName="registry"
Oct 30 23:21:47.062637 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.062621    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.069401 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.069381    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 23:21:47.069713 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.069697    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 23:21:47.069792 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.069696    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 23:21:47.070062 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.070026    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 23:21:47.070148 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.070071    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qbh58\""
Oct 30 23:21:47.080035 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.080009    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"]
Oct 30 23:21:47.120718 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.120689    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:21:47.165789 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.165765    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.165904 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.165798    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.165904 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.165830    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b5bee24-6ddf-4586-a46c-e203f20ef21d-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.166164 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.165918    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.166164 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.165950    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.166164 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.166043    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5wd9\" (UniqueName: \"kubernetes.io/projected/3b5bee24-6ddf-4586-a46c-e203f20ef21d-kube-api-access-t5wd9\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.166164 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.166082    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.267000 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.266968    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5wd9\" (UniqueName: \"kubernetes.io/projected/3b5bee24-6ddf-4586-a46c-e203f20ef21d-kube-api-access-t5wd9\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.267151 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.267012    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.267151 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.267042    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.267151 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.267081    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.267151 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.267113    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b5bee24-6ddf-4586-a46c-e203f20ef21d-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.267354 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.267160    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.267354 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.267191    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.267841 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.267821    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.269547 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.269525    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.269660 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.269608    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.269897 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.269876    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b5bee24-6ddf-4586-a46c-e203f20ef21d-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.269965 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.269951    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.280957 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.280937    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.281317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.281299    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5wd9\" (UniqueName: \"kubernetes.io/projected/3b5bee24-6ddf-4586-a46c-e203f20ef21d-kube-api-access-t5wd9\") pod \"istiod-openshift-gateway-7876bfcb74-k47zx\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.291520 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.291500    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:21:47.374404 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.374341    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:47.651729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:47.651703    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"]
Oct 30 23:21:47.654189 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:21:47.654161    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b5bee24_6ddf_4586_a46c_e203f20ef21d.slice/crio-662ffc3293b9f1ae338caedfc1b229ec065cd4abc55aa6105b2589d849726678 WatchSource:0}: Error finding container 662ffc3293b9f1ae338caedfc1b229ec065cd4abc55aa6105b2589d849726678: Status 404 returned error can't find the container with id 662ffc3293b9f1ae338caedfc1b229ec065cd4abc55aa6105b2589d849726678
Oct 30 23:21:48.620473 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:48.620440    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx" event={"ID":"3b5bee24-6ddf-4586-a46c-e203f20ef21d","Type":"ContainerStarted","Data":"662ffc3293b9f1ae338caedfc1b229ec065cd4abc55aa6105b2589d849726678"}
Oct 30 23:21:48.696057 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:48.696028    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:21:50.839188 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:50.839155    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:21:51.676880 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:51.676844    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:21:51.676966 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:51.676915    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:21:52.595561 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:52.595529    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:21:52.635379 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:52.635340    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx" event={"ID":"3b5bee24-6ddf-4586-a46c-e203f20ef21d","Type":"ContainerStarted","Data":"9991e02380ec4f17f6b2085ece7c37e360aebdafc4543a7b73c25a47b3695ae1"}
Oct 30 23:21:52.635559 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:52.635494    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:52.637292 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:52.637257    4921 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-k47zx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:21:52.637401 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:52.637309    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx" podUID="3b5bee24-6ddf-4586-a46c-e203f20ef21d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:21:52.669066 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:52.669006    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx" podStartSLOduration=1.649000294 podStartE2EDuration="5.668989364s" totalImagesPullingTime="4.01998907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:21:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:21:52.666698658 +0000 UTC m=+171.911554426" watchObservedRunningTime="2026-10-30 23:21:52.668989364 +0000 UTC m=+171.913845133"
Oct 30 23:21:52.865296 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:52.865214    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:21:53.033826 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:53.033798    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:21:53.203668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:53.203630    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:21:53.640137 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:53.640107    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:21:55.760095 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:21:55.760050    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:11.401547 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:22:11.401512    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:22:30.398249 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:30.398214    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:30.532416 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:30.532384    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:31.110892 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.110858    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:31.241833 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.241799    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"]
Oct 30 23:22:31.245220 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.245198    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.289508 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.289468    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"]
Oct 30 23:22:31.295917 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.295884    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6f250a6-8cd5-4658-a6d8-892c6f8cc652-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6986c789f7-f4lx6\" (UID: \"d6f250a6-8cd5-4658-a6d8-892c6f8cc652\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.296084 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.295921    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhvbc\" (UniqueName: \"kubernetes.io/projected/d6f250a6-8cd5-4658-a6d8-892c6f8cc652-kube-api-access-lhvbc\") pod \"opendatahub-operator-controller-manager-6986c789f7-f4lx6\" (UID: \"d6f250a6-8cd5-4658-a6d8-892c6f8cc652\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.296084 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.296011    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6f250a6-8cd5-4658-a6d8-892c6f8cc652-tmp\") pod \"opendatahub-operator-controller-manager-6986c789f7-f4lx6\" (UID: \"d6f250a6-8cd5-4658-a6d8-892c6f8cc652\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.296084 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.296058    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6f250a6-8cd5-4658-a6d8-892c6f8cc652-webhook-cert\") pod \"opendatahub-operator-controller-manager-6986c789f7-f4lx6\" (UID: \"d6f250a6-8cd5-4658-a6d8-892c6f8cc652\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.296084 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.296078    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d6f250a6-8cd5-4658-a6d8-892c6f8cc652-manifests\") pod \"opendatahub-operator-controller-manager-6986c789f7-f4lx6\" (UID: \"d6f250a6-8cd5-4658-a6d8-892c6f8cc652\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.296282 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.296129    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6f250a6-8cd5-4658-a6d8-892c6f8cc652-metrics-cert\") pod \"opendatahub-operator-controller-manager-6986c789f7-f4lx6\" (UID: \"d6f250a6-8cd5-4658-a6d8-892c6f8cc652\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.341271 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.341243    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 23:22:31.345697 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.345675    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 30 23:22:31.345813 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.345698    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 23:22:31.345813 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.345717    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 30 23:22:31.345813 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.345763    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-2mrzn\""
Oct 30 23:22:31.345999 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.345982    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 30 23:22:31.397455 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.397431    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d6f250a6-8cd5-4658-a6d8-892c6f8cc652-manifests\") pod \"opendatahub-operator-controller-manager-6986c789f7-f4lx6\" (UID: \"d6f250a6-8cd5-4658-a6d8-892c6f8cc652\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.397586 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.397466    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6f250a6-8cd5-4658-a6d8-892c6f8cc652-metrics-cert\") pod \"opendatahub-operator-controller-manager-6986c789f7-f4lx6\" (UID: \"d6f250a6-8cd5-4658-a6d8-892c6f8cc652\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.397586 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.397511    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6f250a6-8cd5-4658-a6d8-892c6f8cc652-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6986c789f7-f4lx6\" (UID: \"d6f250a6-8cd5-4658-a6d8-892c6f8cc652\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.397586 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.397537    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhvbc\" (UniqueName: \"kubernetes.io/projected/d6f250a6-8cd5-4658-a6d8-892c6f8cc652-kube-api-access-lhvbc\") pod \"opendatahub-operator-controller-manager-6986c789f7-f4lx6\" (UID: \"d6f250a6-8cd5-4658-a6d8-892c6f8cc652\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.397586 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.397578    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6f250a6-8cd5-4658-a6d8-892c6f8cc652-tmp\") pod \"opendatahub-operator-controller-manager-6986c789f7-f4lx6\" (UID: \"d6f250a6-8cd5-4658-a6d8-892c6f8cc652\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.397838 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.397634    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6f250a6-8cd5-4658-a6d8-892c6f8cc652-webhook-cert\") pod \"opendatahub-operator-controller-manager-6986c789f7-f4lx6\" (UID: \"d6f250a6-8cd5-4658-a6d8-892c6f8cc652\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.397957 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.397935    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d6f250a6-8cd5-4658-a6d8-892c6f8cc652-manifests\") pod \"opendatahub-operator-controller-manager-6986c789f7-f4lx6\" (UID: \"d6f250a6-8cd5-4658-a6d8-892c6f8cc652\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.400121 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.400092    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6f250a6-8cd5-4658-a6d8-892c6f8cc652-tmp\") pod \"opendatahub-operator-controller-manager-6986c789f7-f4lx6\" (UID: \"d6f250a6-8cd5-4658-a6d8-892c6f8cc652\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.400506 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.400382    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6f250a6-8cd5-4658-a6d8-892c6f8cc652-metrics-cert\") pod \"opendatahub-operator-controller-manager-6986c789f7-f4lx6\" (UID: \"d6f250a6-8cd5-4658-a6d8-892c6f8cc652\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.400506 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.400383    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6f250a6-8cd5-4658-a6d8-892c6f8cc652-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6986c789f7-f4lx6\" (UID: \"d6f250a6-8cd5-4658-a6d8-892c6f8cc652\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.400608 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.400579    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6f250a6-8cd5-4658-a6d8-892c6f8cc652-webhook-cert\") pod \"opendatahub-operator-controller-manager-6986c789f7-f4lx6\" (UID: \"d6f250a6-8cd5-4658-a6d8-892c6f8cc652\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.416754 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.416731    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhvbc\" (UniqueName: \"kubernetes.io/projected/d6f250a6-8cd5-4658-a6d8-892c6f8cc652-kube-api-access-lhvbc\") pod \"opendatahub-operator-controller-manager-6986c789f7-f4lx6\" (UID: \"d6f250a6-8cd5-4658-a6d8-892c6f8cc652\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.487688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.487661    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:31.558817 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.558786    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:31.629007 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.628978    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:31.779079 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.779002    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:31.878090 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.878063    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"]
Oct 30 23:22:31.878873 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:22:31.878842    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6f250a6_8cd5_4658_a6d8_892c6f8cc652.slice/crio-0e75f987929ba7a9b38e10f3ad29ed64193486fe60d9cdee96b9853b72320428 WatchSource:0}: Error finding container 0e75f987929ba7a9b38e10f3ad29ed64193486fe60d9cdee96b9853b72320428: Status 404 returned error can't find the container with id 0e75f987929ba7a9b38e10f3ad29ed64193486fe60d9cdee96b9853b72320428
Oct 30 23:22:31.913783 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:31.913742    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:32.170328 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:32.170287    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:32.373362 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:32.373324    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:32.778277 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:32.778235    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6" event={"ID":"d6f250a6-8cd5-4658-a6d8-892c6f8cc652","Type":"ContainerStarted","Data":"0e75f987929ba7a9b38e10f3ad29ed64193486fe60d9cdee96b9853b72320428"}
Oct 30 23:22:34.209405 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:34.209372    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:35.005636 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:35.005573    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:35.793438 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:35.793400    4921 generic.go:356] "Generic (PLEG): container finished" podID="d6f250a6-8cd5-4658-a6d8-892c6f8cc652" containerID="884207b5c0d7ac85f8fa93cd3393664b79af4e13428540e537a02c3d705455a5" exitCode=0
Oct 30 23:22:35.793928 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:35.793458    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6" event={"ID":"d6f250a6-8cd5-4658-a6d8-892c6f8cc652","Type":"ContainerDied","Data":"884207b5c0d7ac85f8fa93cd3393664b79af4e13428540e537a02c3d705455a5"}
Oct 30 23:22:36.799560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:36.799523    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6" event={"ID":"d6f250a6-8cd5-4658-a6d8-892c6f8cc652","Type":"ContainerStarted","Data":"be5487e3e323c154c4ecd2ce2716a6cec55998686a0d9b0eec34e291d9c4b5bd"}
Oct 30 23:22:36.799984 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:36.799647    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:36.848368 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:36.848306    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6" podStartSLOduration=2.037551488 podStartE2EDuration="5.848287123s" totalImagesPullingTime="3.389581968s" totalInitContainerRuntime="421.153667ms" isStatefulPod=false podCreationTimestamp="2026-10-30 23:22:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:22:36.846563246 +0000 UTC m=+216.091419014" watchObservedRunningTime="2026-10-30 23:22:36.848287123 +0000 UTC m=+216.093142892"
Oct 30 23:22:36.939273 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:36.939238    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:38.279791 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:38.279763    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:41.402037 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:22:41.402002    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:22:43.563354 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:43.563314    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:44.350009 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:44.349953    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:46.604213 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:46.604179    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:46.746493 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:46.746458    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:47.805823 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:47.805795    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6986c789f7-f4lx6"
Oct 30 23:22:47.956207 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:47.956174    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:48.755928 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:48.755891    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:49.192282 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:49.192246    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:49.576869 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:49.576794    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:50.332612 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:50.332564    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:50.465027 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:50.464993    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:50.941202 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:50.941171    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:51.570522 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:51.570493    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:51.730541 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:51.730509    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:52.364782 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:52.364751    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:53.994791 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:53.994754    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:54.406887 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:54.406854    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:55.349753 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:55.349717    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:59.587548 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:59.587512    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:59.738457 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:59.738425    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:22:59.981588 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:22:59.981553    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:00.199016 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.198987    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:00.404972 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.404941    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-dfd47b86c-fz9nb"]
Oct 30 23:23:00.413646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.413623    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-dfd47b86c-fz9nb"
Oct 30 23:23:00.429736 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.429712    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-dfd47b86c-fz9nb"]
Oct 30 23:23:00.482647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.482615    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:00.496408 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.496386    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Oct 30 23:23:00.496631 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.496409    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ttclb\""
Oct 30 23:23:00.496739 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.496509    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Oct 30 23:23:00.543756 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.543720    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9c61210-8afc-4d1a-a74b-9948b5b5f385-tmp\") pod \"kube-auth-proxy-dfd47b86c-fz9nb\" (UID: \"b9c61210-8afc-4d1a-a74b-9948b5b5f385\") " pod="openshift-ingress/kube-auth-proxy-dfd47b86c-fz9nb"
Oct 30 23:23:00.543928 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.543781    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwlgs\" (UniqueName: \"kubernetes.io/projected/b9c61210-8afc-4d1a-a74b-9948b5b5f385-kube-api-access-mwlgs\") pod \"kube-auth-proxy-dfd47b86c-fz9nb\" (UID: \"b9c61210-8afc-4d1a-a74b-9948b5b5f385\") " pod="openshift-ingress/kube-auth-proxy-dfd47b86c-fz9nb"
Oct 30 23:23:00.543928 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.543859    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c61210-8afc-4d1a-a74b-9948b5b5f385-tls-certs\") pod \"kube-auth-proxy-dfd47b86c-fz9nb\" (UID: \"b9c61210-8afc-4d1a-a74b-9948b5b5f385\") " pod="openshift-ingress/kube-auth-proxy-dfd47b86c-fz9nb"
Oct 30 23:23:00.644689 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.644656    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwlgs\" (UniqueName: \"kubernetes.io/projected/b9c61210-8afc-4d1a-a74b-9948b5b5f385-kube-api-access-mwlgs\") pod \"kube-auth-proxy-dfd47b86c-fz9nb\" (UID: \"b9c61210-8afc-4d1a-a74b-9948b5b5f385\") " pod="openshift-ingress/kube-auth-proxy-dfd47b86c-fz9nb"
Oct 30 23:23:00.644689 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.644690    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c61210-8afc-4d1a-a74b-9948b5b5f385-tls-certs\") pod \"kube-auth-proxy-dfd47b86c-fz9nb\" (UID: \"b9c61210-8afc-4d1a-a74b-9948b5b5f385\") " pod="openshift-ingress/kube-auth-proxy-dfd47b86c-fz9nb"
Oct 30 23:23:00.645146 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.644748    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9c61210-8afc-4d1a-a74b-9948b5b5f385-tmp\") pod \"kube-auth-proxy-dfd47b86c-fz9nb\" (UID: \"b9c61210-8afc-4d1a-a74b-9948b5b5f385\") " pod="openshift-ingress/kube-auth-proxy-dfd47b86c-fz9nb"
Oct 30 23:23:00.647155 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.647127    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9c61210-8afc-4d1a-a74b-9948b5b5f385-tmp\") pod \"kube-auth-proxy-dfd47b86c-fz9nb\" (UID: \"b9c61210-8afc-4d1a-a74b-9948b5b5f385\") " pod="openshift-ingress/kube-auth-proxy-dfd47b86c-fz9nb"
Oct 30 23:23:00.647498 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.647476    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c61210-8afc-4d1a-a74b-9948b5b5f385-tls-certs\") pod \"kube-auth-proxy-dfd47b86c-fz9nb\" (UID: \"b9c61210-8afc-4d1a-a74b-9948b5b5f385\") " pod="openshift-ingress/kube-auth-proxy-dfd47b86c-fz9nb"
Oct 30 23:23:00.669797 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.669725    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwlgs\" (UniqueName: \"kubernetes.io/projected/b9c61210-8afc-4d1a-a74b-9948b5b5f385-kube-api-access-mwlgs\") pod \"kube-auth-proxy-dfd47b86c-fz9nb\" (UID: \"b9c61210-8afc-4d1a-a74b-9948b5b5f385\") " pod="openshift-ingress/kube-auth-proxy-dfd47b86c-fz9nb"
Oct 30 23:23:00.695298 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.695266    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:00.725356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.725325    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-dfd47b86c-fz9nb"
Oct 30 23:23:00.888869 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:00.888840    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:01.009482 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:01.009407    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-dfd47b86c-fz9nb"]
Oct 30 23:23:01.013919 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:23:01.013881    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c61210_8afc_4d1a_a74b_9948b5b5f385.slice/crio-b850072f7542cb7f889011c811bf40ab030f2dbecf845b5ad1b7a41df57e086e WatchSource:0}: Error finding container b850072f7542cb7f889011c811bf40ab030f2dbecf845b5ad1b7a41df57e086e: Status 404 returned error can't find the container with id b850072f7542cb7f889011c811bf40ab030f2dbecf845b5ad1b7a41df57e086e
Oct 30 23:23:01.058967 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:01.058931    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:01.360434 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:01.360346    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:01.519755 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:01.519712    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:01.774549 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:01.774517    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:01.906707 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:01.906635    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-dfd47b86c-fz9nb" event={"ID":"b9c61210-8afc-4d1a-a74b-9948b5b5f385","Type":"ContainerStarted","Data":"b850072f7542cb7f889011c811bf40ab030f2dbecf845b5ad1b7a41df57e086e"}
Oct 30 23:23:01.991504 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:01.991465    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:02.672096 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:02.672007    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:02.856259 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:02.856224    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:03.649766 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:03.649743    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Oct 30 23:23:03.916467 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:03.916390    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-dfd47b86c-fz9nb" event={"ID":"b9c61210-8afc-4d1a-a74b-9948b5b5f385","Type":"ContainerStarted","Data":"29a98ef5029338a7675e47ddb75212e3f4bd9c6a8846e326f7f987fa4973d27d"}
Oct 30 23:23:03.935330 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:03.935286    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-dfd47b86c-fz9nb" podStartSLOduration=1.305422764 podStartE2EDuration="3.935273932s" totalImagesPullingTime="2.629851168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:23:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:23:03.934116939 +0000 UTC m=+243.178972708" watchObservedRunningTime="2026-10-30 23:23:03.935273932 +0000 UTC m=+243.180129701"
Oct 30 23:23:04.463957 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:04.463920    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:04.596756 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:04.596726    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:06.606218 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:06.606141    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:06.737370 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:06.737338    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:11.402637 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:23:11.402584    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:23:12.757906 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:12.757874    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:12.902000 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:12.901945    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:13.768776 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:13.768747    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:13.912944 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:13.912889    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:14.069334 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:14.069255    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:19.262333 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:19.262301    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:19.402666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:19.402632    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:22.201986 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:22.201952    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:23.313707 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:23.313672    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:24.719573 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:24.719538    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:24.851361 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:24.851332    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:29.982474 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:29.982441    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:30.109799 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:30.109769    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:31.195958 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:31.195923    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:31.341409 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:31.341359    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:38.244919 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:38.244834    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:38.376555 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:38.376521    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:41.209482 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:41.209443    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:41.343214 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:41.343186    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:41.401709 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:23:41.401662    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:23:44.643007 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:44.642974    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:44.778824 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:44.778791    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:50.953252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:50.953221    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:51.645467 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:51.645436    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:51.819014 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:51.818980    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:52.263358 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:52.263300    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:52.395996 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:52.395965    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:52.909353 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:52.909324    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:53.100233 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:53.100195    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:56.715331 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:56.715301    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:56.861150 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:56.861118    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-8l59t"]
Oct 30 23:23:56.864353 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:56.864337    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-8l59t"
Oct 30 23:23:56.870312 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:56.870285    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:56.885187 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:56.885165    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-8l59t"]
Oct 30 23:23:56.930478 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:56.930457    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-wvj72\""
Oct 30 23:23:56.930478 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:56.930472    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Oct 30 23:23:56.932788 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:56.932771    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 30 23:23:56.932978 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:56.932963    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 30 23:23:57.001799 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.001738    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/762b14d4-9c86-435e-b185-76d16f68a175-tls-certs\") pod \"model-serving-api-75bd89fdfc-8l59t\" (UID: \"762b14d4-9c86-435e-b185-76d16f68a175\") " pod="opendatahub/model-serving-api-75bd89fdfc-8l59t"
Oct 30 23:23:57.001904 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.001889    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chs9t\" (UniqueName: \"kubernetes.io/projected/762b14d4-9c86-435e-b185-76d16f68a175-kube-api-access-chs9t\") pod \"model-serving-api-75bd89fdfc-8l59t\" (UID: \"762b14d4-9c86-435e-b185-76d16f68a175\") " pod="opendatahub/model-serving-api-75bd89fdfc-8l59t"
Oct 30 23:23:57.023896 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.023873    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:57.103171 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.103138    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chs9t\" (UniqueName: \"kubernetes.io/projected/762b14d4-9c86-435e-b185-76d16f68a175-kube-api-access-chs9t\") pod \"model-serving-api-75bd89fdfc-8l59t\" (UID: \"762b14d4-9c86-435e-b185-76d16f68a175\") " pod="opendatahub/model-serving-api-75bd89fdfc-8l59t"
Oct 30 23:23:57.103300 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.103192    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/762b14d4-9c86-435e-b185-76d16f68a175-tls-certs\") pod \"model-serving-api-75bd89fdfc-8l59t\" (UID: \"762b14d4-9c86-435e-b185-76d16f68a175\") " pod="opendatahub/model-serving-api-75bd89fdfc-8l59t"
Oct 30 23:23:57.105827 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.105800    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/762b14d4-9c86-435e-b185-76d16f68a175-tls-certs\") pod \"model-serving-api-75bd89fdfc-8l59t\" (UID: \"762b14d4-9c86-435e-b185-76d16f68a175\") " pod="opendatahub/model-serving-api-75bd89fdfc-8l59t"
Oct 30 23:23:57.115407 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.115386    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chs9t\" (UniqueName: \"kubernetes.io/projected/762b14d4-9c86-435e-b185-76d16f68a175-kube-api-access-chs9t\") pod \"model-serving-api-75bd89fdfc-8l59t\" (UID: \"762b14d4-9c86-435e-b185-76d16f68a175\") " pod="opendatahub/model-serving-api-75bd89fdfc-8l59t"
Oct 30 23:23:57.156557 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.156521    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:57.177552 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.177527    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-8l59t"
Oct 30 23:23:57.286005 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.285925    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"]
Oct 30 23:23:57.289519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.289502    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.302316 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.302295    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"]
Oct 30 23:23:57.406089 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.406060    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0dd139da-49a9-4406-bfa3-369c639b5704-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.406266 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.406101    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dd139da-49a9-4406-bfa3-369c639b5704-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.406266 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.406118    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0dd139da-49a9-4406-bfa3-369c639b5704-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.406266 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.406186    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0dd139da-49a9-4406-bfa3-369c639b5704-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.406408 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.406317    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0dd139da-49a9-4406-bfa3-369c639b5704-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.406408 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.406344    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dd139da-49a9-4406-bfa3-369c639b5704-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.406408 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.406363    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k8x9\" (UniqueName: \"kubernetes.io/projected/0dd139da-49a9-4406-bfa3-369c639b5704-kube-api-access-6k8x9\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.451927 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.451901    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-8l59t"]
Oct 30 23:23:57.455029 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:23:57.455003    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod762b14d4_9c86_435e_b185_76d16f68a175.slice/crio-2fd27238b633b442fb7e5146ac164c85dc9dec4154111b9b2cc195d7e165ccf7 WatchSource:0}: Error finding container 2fd27238b633b442fb7e5146ac164c85dc9dec4154111b9b2cc195d7e165ccf7: Status 404 returned error can't find the container with id 2fd27238b633b442fb7e5146ac164c85dc9dec4154111b9b2cc195d7e165ccf7
Oct 30 23:23:57.506983 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.506961    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0dd139da-49a9-4406-bfa3-369c639b5704-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.507098 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.507011    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0dd139da-49a9-4406-bfa3-369c639b5704-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.507098 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.507029    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dd139da-49a9-4406-bfa3-369c639b5704-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.507098 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.507048    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k8x9\" (UniqueName: \"kubernetes.io/projected/0dd139da-49a9-4406-bfa3-369c639b5704-kube-api-access-6k8x9\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.507098 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.507080    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0dd139da-49a9-4406-bfa3-369c639b5704-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.507305 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.507110    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dd139da-49a9-4406-bfa3-369c639b5704-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.507305 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.507125    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0dd139da-49a9-4406-bfa3-369c639b5704-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.508005 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.507977    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0dd139da-49a9-4406-bfa3-369c639b5704-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.509510 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.509486    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dd139da-49a9-4406-bfa3-369c639b5704-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.509620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.509549    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0dd139da-49a9-4406-bfa3-369c639b5704-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.509980 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.509963    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0dd139da-49a9-4406-bfa3-369c639b5704-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.510066 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.510030    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0dd139da-49a9-4406-bfa3-369c639b5704-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.519227 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.519205    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k8x9\" (UniqueName: \"kubernetes.io/projected/0dd139da-49a9-4406-bfa3-369c639b5704-kube-api-access-6k8x9\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.519317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.519230    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dd139da-49a9-4406-bfa3-369c639b5704-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-hmb6d\" (UID: \"0dd139da-49a9-4406-bfa3-369c639b5704\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.600787 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.600734    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:57.948339 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.948315    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"]
Oct 30 23:23:57.950768 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:23:57.950738    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd139da_49a9_4406_bfa3_369c639b5704.slice/crio-ff51b78de035a87e0559eb02f024031d958d2c3094206e81b30ce3d8c47b83db WatchSource:0}: Error finding container ff51b78de035a87e0559eb02f024031d958d2c3094206e81b30ce3d8c47b83db: Status 404 returned error can't find the container with id ff51b78de035a87e0559eb02f024031d958d2c3094206e81b30ce3d8c47b83db
Oct 30 23:23:57.952858 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.952827    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:23:57.952922 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.952889    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:23:57.991035 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:57.991011    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:58.135093 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:58.134967    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-8l59t" event={"ID":"762b14d4-9c86-435e-b185-76d16f68a175","Type":"ContainerStarted","Data":"2fd27238b633b442fb7e5146ac164c85dc9dec4154111b9b2cc195d7e165ccf7"}
Oct 30 23:23:58.136344 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:58.136297    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:58.138423 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:58.138401    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d" event={"ID":"0dd139da-49a9-4406-bfa3-369c639b5704","Type":"ContainerStarted","Data":"6db7fb6c247342fabd3d6787539eb83850640dc19d68431660f5e68b04e6f4e4"}
Oct 30 23:23:58.138537 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:58.138445    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d" event={"ID":"0dd139da-49a9-4406-bfa3-369c639b5704","Type":"ContainerStarted","Data":"ff51b78de035a87e0559eb02f024031d958d2c3094206e81b30ce3d8c47b83db"}
Oct 30 23:23:58.138734 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:58.138667    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:58.165248 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:58.165191    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d" podStartSLOduration=1.165175138 podStartE2EDuration="1.165175138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:23:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:23:58.164799152 +0000 UTC m=+297.409654920" watchObservedRunningTime="2026-10-30 23:23:58.165175138 +0000 UTC m=+297.410030903"
Oct 30 23:23:58.280817 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:58.280737    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:59.145272 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.145241    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hmb6d"
Oct 30 23:23:59.206576 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.206543    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"]
Oct 30 23:23:59.206821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.206794    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx" podUID="3b5bee24-6ddf-4586-a46c-e203f20ef21d" containerName="discovery" containerID="cri-o://9991e02380ec4f17f6b2085ece7c37e360aebdafc4543a7b73c25a47b3695ae1" gracePeriod=30
Oct 30 23:23:59.458132 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.458110    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:23:59.626941 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.626897    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-kubeconfig\") pod \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") "
Oct 30 23:23:59.626941 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.626951    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-cacerts\" (UniqueName: \"kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-cacerts\") pod \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") "
Oct 30 23:23:59.627206 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.626988    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3b5bee24-6ddf-4586-a46c-e203f20ef21d-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b5bee24-6ddf-4586-a46c-e203f20ef21d-local-certs\") pod \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") "
Oct 30 23:23:59.627206 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.627017    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-token\" (UniqueName: \"kubernetes.io/projected/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-token\") pod \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") "
Oct 30 23:23:59.627206 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.627043    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3b5bee24-6ddf-4586-a46c-e203f20ef21d-kube-api-access-t5wd9\" (UniqueName: \"kubernetes.io/projected/3b5bee24-6ddf-4586-a46c-e203f20ef21d-kube-api-access-t5wd9\") pod \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") "
Oct 30 23:23:59.627206 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.627089    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-csr-dns-cert\") pod \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") "
Oct 30 23:23:59.627206 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.627142    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-csr-ca-configmap\") pod \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\" (UID: \"3b5bee24-6ddf-4586-a46c-e203f20ef21d\") "
Oct 30 23:23:59.628021 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.627969    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-csr-ca-configmap" pod "3b5bee24-6ddf-4586-a46c-e203f20ef21d" (UID: "3b5bee24-6ddf-4586-a46c-e203f20ef21d"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:23:59.629758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.629728    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b5bee24-6ddf-4586-a46c-e203f20ef21d-local-certs" pod "3b5bee24-6ddf-4586-a46c-e203f20ef21d" (UID: "3b5bee24-6ddf-4586-a46c-e203f20ef21d"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:23:59.629902 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.629868    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-token" pod "3b5bee24-6ddf-4586-a46c-e203f20ef21d" (UID: "3b5bee24-6ddf-4586-a46c-e203f20ef21d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:23:59.629976 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.629955    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-cacerts" pod "3b5bee24-6ddf-4586-a46c-e203f20ef21d" (UID: "3b5bee24-6ddf-4586-a46c-e203f20ef21d"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:23:59.630031 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.629984    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-kubeconfig" pod "3b5bee24-6ddf-4586-a46c-e203f20ef21d" (UID: "3b5bee24-6ddf-4586-a46c-e203f20ef21d"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:23:59.630221 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.630197    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b5bee24-6ddf-4586-a46c-e203f20ef21d-kube-api-access-t5wd9" pod "3b5bee24-6ddf-4586-a46c-e203f20ef21d" (UID: "3b5bee24-6ddf-4586-a46c-e203f20ef21d"). InnerVolumeSpecName "kube-api-access-t5wd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:23:59.630327 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.630240    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-csr-dns-cert" pod "3b5bee24-6ddf-4586-a46c-e203f20ef21d" (UID: "3b5bee24-6ddf-4586-a46c-e203f20ef21d"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:23:59.728477 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.728400    4921 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-kubeconfig\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:23:59.728477 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.728426    4921 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-cacerts\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:23:59.728477 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.728435    4921 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b5bee24-6ddf-4586-a46c-e203f20ef21d-local-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:23:59.728477 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.728444    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:23:59.728477 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.728453    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5wd9\" (UniqueName: \"kubernetes.io/projected/3b5bee24-6ddf-4586-a46c-e203f20ef21d-kube-api-access-t5wd9\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:23:59.728477 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.728462    4921 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-csr-dns-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:23:59.728477 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.728472    4921 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3b5bee24-6ddf-4586-a46c-e203f20ef21d-istio-csr-ca-configmap\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:23:59.841071 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.841036    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:23:59.967918 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:23:59.967888    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:24:00.148120 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:00.148091    4921 generic.go:356] "Generic (PLEG): container finished" podID="3b5bee24-6ddf-4586-a46c-e203f20ef21d" containerID="9991e02380ec4f17f6b2085ece7c37e360aebdafc4543a7b73c25a47b3695ae1" exitCode=0
Oct 30 23:24:00.148584 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:00.148137    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"
Oct 30 23:24:00.148584 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:00.148185    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx" event={"ID":"3b5bee24-6ddf-4586-a46c-e203f20ef21d","Type":"ContainerDied","Data":"9991e02380ec4f17f6b2085ece7c37e360aebdafc4543a7b73c25a47b3695ae1"}
Oct 30 23:24:00.148584 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:00.148236    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx" event={"ID":"3b5bee24-6ddf-4586-a46c-e203f20ef21d","Type":"ContainerDied","Data":"662ffc3293b9f1ae338caedfc1b229ec065cd4abc55aa6105b2589d849726678"}
Oct 30 23:24:00.148584 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:00.148257    4921 scope.go:122] "RemoveContainer" containerID="9991e02380ec4f17f6b2085ece7c37e360aebdafc4543a7b73c25a47b3695ae1"
Oct 30 23:24:00.150152 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:00.150129    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-8l59t" event={"ID":"762b14d4-9c86-435e-b185-76d16f68a175","Type":"ContainerStarted","Data":"14d48d8e7b3fb23c3b99177bb0755ba3b0d4cf5840422628e796336e0491eede"}
Oct 30 23:24:00.157287 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:00.157270    4921 scope.go:122] "RemoveContainer" containerID="9991e02380ec4f17f6b2085ece7c37e360aebdafc4543a7b73c25a47b3695ae1"
Oct 30 23:24:00.157586 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:24:00.157565    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9991e02380ec4f17f6b2085ece7c37e360aebdafc4543a7b73c25a47b3695ae1\": container with ID starting with 9991e02380ec4f17f6b2085ece7c37e360aebdafc4543a7b73c25a47b3695ae1 not found: ID does not exist" containerID="9991e02380ec4f17f6b2085ece7c37e360aebdafc4543a7b73c25a47b3695ae1"
Oct 30 23:24:00.157746 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:00.157658    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9991e02380ec4f17f6b2085ece7c37e360aebdafc4543a7b73c25a47b3695ae1"} err="failed to get container status \"9991e02380ec4f17f6b2085ece7c37e360aebdafc4543a7b73c25a47b3695ae1\": rpc error: code = NotFound desc = could not find container \"9991e02380ec4f17f6b2085ece7c37e360aebdafc4543a7b73c25a47b3695ae1\": container with ID starting with 9991e02380ec4f17f6b2085ece7c37e360aebdafc4543a7b73c25a47b3695ae1 not found: ID does not exist"
Oct 30 23:24:00.174902 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:00.174861    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-8l59t" podStartSLOduration=2.382606508 podStartE2EDuration="4.174848231s" totalImagesPullingTime="1.792241723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:23:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:24:00.172972459 +0000 UTC m=+299.417828227" watchObservedRunningTime="2026-10-30 23:24:00.174848231 +0000 UTC m=+299.419704036"
Oct 30 23:24:00.188324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:00.188300    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"]
Oct 30 23:24:00.196623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:00.194768    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-k47zx"]
Oct 30 23:24:00.882029 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:00.881994    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3b5bee24-6ddf-4586-a46c-e203f20ef21d" path="/var/lib/kubelet/pods/3b5bee24-6ddf-4586-a46c-e203f20ef21d/volumes"
Oct 30 23:24:00.898311 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:00.898290    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 30 23:24:00.898430 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:00.898300    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 30 23:24:01.154318 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:01.154295    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-8l59t"
Oct 30 23:24:01.802849 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:01.802790    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:24:01.939199 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:01.939165    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:24:06.100173 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:06.100138    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:24:06.242814 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:06.237955    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:24:11.401718 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:24:11.401685    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:24:12.162245 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:12.162216    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-8l59t"
Oct 30 23:24:41.402155 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:24:41.402113    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:24:51.017585 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:24:51.017531    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:25:11.401665 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:25:11.401629    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:25:41.402115 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:25:41.402079    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:25:51.076759 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:25:51.076726    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:25:52.116181 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:25:52.116139    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:26:11.401299 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:26:11.401256    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:26:41.401967 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:26:41.401930    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:26:46.562518 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:26:46.562483    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:26:46.704628 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:26:46.704580    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:26:51.142467 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:26:51.142435    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:27:11.401754 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:27:11.401719    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:27:18.431719 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:27:18.431666    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:27:29.405814 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:27:29.405780    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:27:40.893252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:27:40.893214    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:27:41.402330 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:27:41.402291    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:27:51.181739 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:27:51.181703    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:28:11.401730 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:28:11.401696    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:28:25.183675 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:28:25.183637    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:28:26.134707 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:28:26.134674    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:28:41.401222 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:28:41.401186    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:28:51.225238 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:28:51.225203    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:29:00.922018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:29:00.921986    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 30 23:29:00.923051 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:29:00.923032    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 30 23:29:09.592409 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:29:09.592374    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:29:09.720423 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:29:09.720378    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:29:11.402872 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:29:11.402834    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:29:36.213407 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:29:36.213374    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:29:36.376503 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:29:36.376473    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:29:41.402635 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:29:41.402586    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:29:51.318101 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:29:51.318069    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:30:07.660753 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:30:07.660718    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:30:11.402406 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:30:11.402363    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:30:41.402277 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:30:41.402231    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:30:51.356256 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:30:51.356221    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:31:11.402119 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:31:11.402074    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:31:41.401904 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:31:41.401870    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:31:51.408701 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:31:51.408662    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:32:11.401961 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:32:11.401925    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:32:41.401755 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:32:41.401720    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:32:51.440732 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:32:51.440697    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:32:51.574488 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:32:51.574454    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:33:11.405042 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:33:11.405005    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:33:41.111673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.111628    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-stnzt"]
Oct 30 23:33:41.112205 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.111967    4921 cpu_manager.go:414] "containerMap: removing container" podUID="3b5bee24-6ddf-4586-a46c-e203f20ef21d" containerName="discovery"
Oct 30 23:33:41.112205 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.111978    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b5bee24-6ddf-4586-a46c-e203f20ef21d" containerName="discovery"
Oct 30 23:33:41.112205 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.112048    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="3b5bee24-6ddf-4586-a46c-e203f20ef21d" containerName="discovery"
Oct 30 23:33:41.114942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.114920    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-stnzt"
Oct 30 23:33:41.119369 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.119345    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 23:33:41.120530 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.120507    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 23:33:41.120530 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.120523    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jzg7x\""
Oct 30 23:33:41.120716 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.120507    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Oct 30 23:33:41.124309 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.124287    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-stnzt"]
Oct 30 23:33:41.139927 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.139902    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aefc3afd-88d6-449e-a521-d99952e0c9f0-config-file\") pod \"limitador-limitador-74dfcfb894-stnzt\" (UID: \"aefc3afd-88d6-449e-a521-d99952e0c9f0\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-stnzt"
Oct 30 23:33:41.140030 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.139934    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmhxz\" (UniqueName: \"kubernetes.io/projected/aefc3afd-88d6-449e-a521-d99952e0c9f0-kube-api-access-pmhxz\") pod \"limitador-limitador-74dfcfb894-stnzt\" (UID: \"aefc3afd-88d6-449e-a521-d99952e0c9f0\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-stnzt"
Oct 30 23:33:41.178140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.178092    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:33:41.215689 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.215648    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-stnzt"]
Oct 30 23:33:41.241213 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.241185    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aefc3afd-88d6-449e-a521-d99952e0c9f0-config-file\") pod \"limitador-limitador-74dfcfb894-stnzt\" (UID: \"aefc3afd-88d6-449e-a521-d99952e0c9f0\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-stnzt"
Oct 30 23:33:41.241375 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.241220    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmhxz\" (UniqueName: \"kubernetes.io/projected/aefc3afd-88d6-449e-a521-d99952e0c9f0-kube-api-access-pmhxz\") pod \"limitador-limitador-74dfcfb894-stnzt\" (UID: \"aefc3afd-88d6-449e-a521-d99952e0c9f0\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-stnzt"
Oct 30 23:33:41.241815 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.241797    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aefc3afd-88d6-449e-a521-d99952e0c9f0-config-file\") pod \"limitador-limitador-74dfcfb894-stnzt\" (UID: \"aefc3afd-88d6-449e-a521-d99952e0c9f0\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-stnzt"
Oct 30 23:33:41.259494 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.259465    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmhxz\" (UniqueName: \"kubernetes.io/projected/aefc3afd-88d6-449e-a521-d99952e0c9f0-kube-api-access-pmhxz\") pod \"limitador-limitador-74dfcfb894-stnzt\" (UID: \"aefc3afd-88d6-449e-a521-d99952e0c9f0\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-stnzt"
Oct 30 23:33:41.401845 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:33:41.401811    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:33:41.428807 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.428782    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-stnzt"
Oct 30 23:33:41.704029 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.704004    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-stnzt"]
Oct 30 23:33:41.706899 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:33:41.706874    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaefc3afd_88d6_449e_a521_d99952e0c9f0.slice/crio-d0055699cc42080f326c6d0ec01a4b3153dc6ceec032b8acfc27e678c7046888 WatchSource:0}: Error finding container d0055699cc42080f326c6d0ec01a4b3153dc6ceec032b8acfc27e678c7046888: Status 404 returned error can't find the container with id d0055699cc42080f326c6d0ec01a4b3153dc6ceec032b8acfc27e678c7046888
Oct 30 23:33:41.709086 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.709070    4921 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 23:33:41.921957 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.921926    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-vb82h"]
Oct 30 23:33:41.926278 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.926257    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-vb82h"
Oct 30 23:33:41.932704 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.932678    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-vb82h"]
Oct 30 23:33:41.935700 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.935676    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hc9wr\""
Oct 30 23:33:41.946871 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:41.946845    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c57hd\" (UniqueName: \"kubernetes.io/projected/5aa43e7e-7219-433a-9136-037a5cb42e36-kube-api-access-c57hd\") pod \"authorino-57f7f8659f-vb82h\" (UID: \"5aa43e7e-7219-433a-9136-037a5cb42e36\") " pod="kuadrant-system/authorino-57f7f8659f-vb82h"
Oct 30 23:33:42.048363 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:42.048263    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c57hd\" (UniqueName: \"kubernetes.io/projected/5aa43e7e-7219-433a-9136-037a5cb42e36-kube-api-access-c57hd\") pod \"authorino-57f7f8659f-vb82h\" (UID: \"5aa43e7e-7219-433a-9136-037a5cb42e36\") " pod="kuadrant-system/authorino-57f7f8659f-vb82h"
Oct 30 23:33:42.063621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:42.063564    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c57hd\" (UniqueName: \"kubernetes.io/projected/5aa43e7e-7219-433a-9136-037a5cb42e36-kube-api-access-c57hd\") pod \"authorino-57f7f8659f-vb82h\" (UID: \"5aa43e7e-7219-433a-9136-037a5cb42e36\") " pod="kuadrant-system/authorino-57f7f8659f-vb82h"
Oct 30 23:33:42.249818 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:42.249786    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-vb82h"
Oct 30 23:33:42.369362 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:42.369321    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:33:42.450810 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:42.450774    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-stnzt" event={"ID":"aefc3afd-88d6-449e-a521-d99952e0c9f0","Type":"ContainerStarted","Data":"d0055699cc42080f326c6d0ec01a4b3153dc6ceec032b8acfc27e678c7046888"}
Oct 30 23:33:42.522533 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:42.522508    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-vb82h"]
Oct 30 23:33:42.525547 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:33:42.525514    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5aa43e7e_7219_433a_9136_037a5cb42e36.slice/crio-6fb51458c98240484a9a9bd90227f446d35842ac1eeeaf945c8e42d0152df9fb WatchSource:0}: Error finding container 6fb51458c98240484a9a9bd90227f446d35842ac1eeeaf945c8e42d0152df9fb: Status 404 returned error can't find the container with id 6fb51458c98240484a9a9bd90227f446d35842ac1eeeaf945c8e42d0152df9fb
Oct 30 23:33:43.457202 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:43.457162    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-vb82h" event={"ID":"5aa43e7e-7219-433a-9136-037a5cb42e36","Type":"ContainerStarted","Data":"6fb51458c98240484a9a9bd90227f446d35842ac1eeeaf945c8e42d0152df9fb"}
Oct 30 23:33:45.468666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:45.468622    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-stnzt" event={"ID":"aefc3afd-88d6-449e-a521-d99952e0c9f0","Type":"ContainerStarted","Data":"f898c375c76ecd66c77dd9cfb10b0e0c7372be715a6c98c08d6f68c6c4f6e10d"}
Oct 30 23:33:45.469087 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:45.468688    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-stnzt"
Oct 30 23:33:45.488363 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:45.488309    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-stnzt" podStartSLOduration=1.578234996 podStartE2EDuration="4.488296986s" totalImagesPullingTime="2.91006199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:33:45.487048315 +0000 UTC m=+884.731904082" watchObservedRunningTime="2026-10-30 23:33:45.488296986 +0000 UTC m=+884.733152753"
Oct 30 23:33:46.266527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:46.266490    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-vb82h"]
Oct 30 23:33:46.474171 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:46.474134    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-vb82h" event={"ID":"5aa43e7e-7219-433a-9136-037a5cb42e36","Type":"ContainerStarted","Data":"319711702b6d6a343322166fae990622b498c3ce0e866b7426bbad691cb85180"}
Oct 30 23:33:46.490921 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:46.490878    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-vb82h" podStartSLOduration=2.46393492 podStartE2EDuration="5.490864819s" totalImagesPullingTime="3.026929899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:33:46.48964415 +0000 UTC m=+885.734499919" watchObservedRunningTime="2026-10-30 23:33:46.490864819 +0000 UTC m=+885.735720919"
Oct 30 23:33:47.477749 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:47.477704    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-vb82h" podUID="5aa43e7e-7219-433a-9136-037a5cb42e36" containerName="authorino" containerID="cri-o://319711702b6d6a343322166fae990622b498c3ce0e866b7426bbad691cb85180" gracePeriod=30
Oct 30 23:33:47.717239 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:47.717213    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-vb82h"
Oct 30 23:33:47.796464 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:47.796396    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5aa43e7e-7219-433a-9136-037a5cb42e36-kube-api-access-c57hd\" (UniqueName: \"kubernetes.io/projected/5aa43e7e-7219-433a-9136-037a5cb42e36-kube-api-access-c57hd\") pod \"5aa43e7e-7219-433a-9136-037a5cb42e36\" (UID: \"5aa43e7e-7219-433a-9136-037a5cb42e36\") "
Oct 30 23:33:47.798708 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:47.798686    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aa43e7e-7219-433a-9136-037a5cb42e36-kube-api-access-c57hd" pod "5aa43e7e-7219-433a-9136-037a5cb42e36" (UID: "5aa43e7e-7219-433a-9136-037a5cb42e36"). InnerVolumeSpecName "kube-api-access-c57hd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:33:47.897968 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:47.897934    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c57hd\" (UniqueName: \"kubernetes.io/projected/5aa43e7e-7219-433a-9136-037a5cb42e36-kube-api-access-c57hd\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:33:48.482148 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:48.482114    4921 generic.go:356] "Generic (PLEG): container finished" podID="5aa43e7e-7219-433a-9136-037a5cb42e36" containerID="319711702b6d6a343322166fae990622b498c3ce0e866b7426bbad691cb85180" exitCode=0
Oct 30 23:33:48.482686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:48.482157    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-vb82h"
Oct 30 23:33:48.482686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:48.482199    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-vb82h" event={"ID":"5aa43e7e-7219-433a-9136-037a5cb42e36","Type":"ContainerDied","Data":"319711702b6d6a343322166fae990622b498c3ce0e866b7426bbad691cb85180"}
Oct 30 23:33:48.482686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:48.482242    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-vb82h" event={"ID":"5aa43e7e-7219-433a-9136-037a5cb42e36","Type":"ContainerDied","Data":"6fb51458c98240484a9a9bd90227f446d35842ac1eeeaf945c8e42d0152df9fb"}
Oct 30 23:33:48.482686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:48.482268    4921 scope.go:122] "RemoveContainer" containerID="319711702b6d6a343322166fae990622b498c3ce0e866b7426bbad691cb85180"
Oct 30 23:33:48.490762 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:48.490744    4921 scope.go:122] "RemoveContainer" containerID="319711702b6d6a343322166fae990622b498c3ce0e866b7426bbad691cb85180"
Oct 30 23:33:48.490993 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:33:48.490974    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"319711702b6d6a343322166fae990622b498c3ce0e866b7426bbad691cb85180\": container with ID starting with 319711702b6d6a343322166fae990622b498c3ce0e866b7426bbad691cb85180 not found: ID does not exist" containerID="319711702b6d6a343322166fae990622b498c3ce0e866b7426bbad691cb85180"
Oct 30 23:33:48.491038 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:48.491002    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"319711702b6d6a343322166fae990622b498c3ce0e866b7426bbad691cb85180"} err="failed to get container status \"319711702b6d6a343322166fae990622b498c3ce0e866b7426bbad691cb85180\": rpc error: code = NotFound desc = could not find container \"319711702b6d6a343322166fae990622b498c3ce0e866b7426bbad691cb85180\": container with ID starting with 319711702b6d6a343322166fae990622b498c3ce0e866b7426bbad691cb85180 not found: ID does not exist"
Oct 30 23:33:48.502821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:48.502798    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-vb82h"]
Oct 30 23:33:48.509090 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:48.509073    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-vb82h"]
Oct 30 23:33:48.880546 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:48.880475    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5aa43e7e-7219-433a-9136-037a5cb42e36" path="/var/lib/kubelet/pods/5aa43e7e-7219-433a-9136-037a5cb42e36/volumes"
Oct 30 23:33:51.514471 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:51.514440    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:33:55.865613 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:55.865568    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-stnzt"]
Oct 30 23:33:55.866098 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:55.865899    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-stnzt" podUID="aefc3afd-88d6-449e-a521-d99952e0c9f0" containerName="limitador" containerID="cri-o://f898c375c76ecd66c77dd9cfb10b0e0c7372be715a6c98c08d6f68c6c4f6e10d" gracePeriod=30
Oct 30 23:33:55.866631 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:55.866500    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-stnzt"
Oct 30 23:33:56.404359 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:56.404336    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-stnzt"
Oct 30 23:33:56.464058 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:56.463992    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aefc3afd-88d6-449e-a521-d99952e0c9f0-kube-api-access-pmhxz\" (UniqueName: \"kubernetes.io/projected/aefc3afd-88d6-449e-a521-d99952e0c9f0-kube-api-access-pmhxz\") pod \"aefc3afd-88d6-449e-a521-d99952e0c9f0\" (UID: \"aefc3afd-88d6-449e-a521-d99952e0c9f0\") "
Oct 30 23:33:56.464058 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:56.464028    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aefc3afd-88d6-449e-a521-d99952e0c9f0-config-file\" (UniqueName: \"kubernetes.io/configmap/aefc3afd-88d6-449e-a521-d99952e0c9f0-config-file\") pod \"aefc3afd-88d6-449e-a521-d99952e0c9f0\" (UID: \"aefc3afd-88d6-449e-a521-d99952e0c9f0\") "
Oct 30 23:33:56.464371 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:56.464351    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aefc3afd-88d6-449e-a521-d99952e0c9f0-config-file" pod "aefc3afd-88d6-449e-a521-d99952e0c9f0" (UID: "aefc3afd-88d6-449e-a521-d99952e0c9f0"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:33:56.466338 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:56.466310    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aefc3afd-88d6-449e-a521-d99952e0c9f0-kube-api-access-pmhxz" pod "aefc3afd-88d6-449e-a521-d99952e0c9f0" (UID: "aefc3afd-88d6-449e-a521-d99952e0c9f0"). InnerVolumeSpecName "kube-api-access-pmhxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:33:56.516646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:56.516612    4921 generic.go:356] "Generic (PLEG): container finished" podID="aefc3afd-88d6-449e-a521-d99952e0c9f0" containerID="f898c375c76ecd66c77dd9cfb10b0e0c7372be715a6c98c08d6f68c6c4f6e10d" exitCode=0
Oct 30 23:33:56.516786 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:56.516669    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-stnzt"
Oct 30 23:33:56.516786 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:56.516694    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-stnzt" event={"ID":"aefc3afd-88d6-449e-a521-d99952e0c9f0","Type":"ContainerDied","Data":"f898c375c76ecd66c77dd9cfb10b0e0c7372be715a6c98c08d6f68c6c4f6e10d"}
Oct 30 23:33:56.516786 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:56.516750    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-stnzt" event={"ID":"aefc3afd-88d6-449e-a521-d99952e0c9f0","Type":"ContainerDied","Data":"d0055699cc42080f326c6d0ec01a4b3153dc6ceec032b8acfc27e678c7046888"}
Oct 30 23:33:56.516786 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:56.516772    4921 scope.go:122] "RemoveContainer" containerID="f898c375c76ecd66c77dd9cfb10b0e0c7372be715a6c98c08d6f68c6c4f6e10d"
Oct 30 23:33:56.525699 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:56.525682    4921 scope.go:122] "RemoveContainer" containerID="f898c375c76ecd66c77dd9cfb10b0e0c7372be715a6c98c08d6f68c6c4f6e10d"
Oct 30 23:33:56.525943 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:33:56.525924    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f898c375c76ecd66c77dd9cfb10b0e0c7372be715a6c98c08d6f68c6c4f6e10d\": container with ID starting with f898c375c76ecd66c77dd9cfb10b0e0c7372be715a6c98c08d6f68c6c4f6e10d not found: ID does not exist" containerID="f898c375c76ecd66c77dd9cfb10b0e0c7372be715a6c98c08d6f68c6c4f6e10d"
Oct 30 23:33:56.525982 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:56.525951    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f898c375c76ecd66c77dd9cfb10b0e0c7372be715a6c98c08d6f68c6c4f6e10d"} err="failed to get container status \"f898c375c76ecd66c77dd9cfb10b0e0c7372be715a6c98c08d6f68c6c4f6e10d\": rpc error: code = NotFound desc = could not find container \"f898c375c76ecd66c77dd9cfb10b0e0c7372be715a6c98c08d6f68c6c4f6e10d\": container with ID starting with f898c375c76ecd66c77dd9cfb10b0e0c7372be715a6c98c08d6f68c6c4f6e10d not found: ID does not exist"
Oct 30 23:33:56.537901 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:56.537880    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-stnzt"]
Oct 30 23:33:56.542232 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:56.542213    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-stnzt"]
Oct 30 23:33:56.564668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:56.564650    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmhxz\" (UniqueName: \"kubernetes.io/projected/aefc3afd-88d6-449e-a521-d99952e0c9f0-kube-api-access-pmhxz\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:33:56.564668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:56.564668    4921 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aefc3afd-88d6-449e-a521-d99952e0c9f0-config-file\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:33:56.880125 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:56.880054    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aefc3afd-88d6-449e-a521-d99952e0c9f0" path="/var/lib/kubelet/pods/aefc3afd-88d6-449e-a521-d99952e0c9f0/volumes"
Oct 30 23:33:59.670723 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:59.670696    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:33:59.809014 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:33:59.808983    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:34:00.327611 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.327561    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-hc658"]
Oct 30 23:34:00.327938 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.327924    4921 cpu_manager.go:414] "containerMap: removing container" podUID="5aa43e7e-7219-433a-9136-037a5cb42e36" containerName="authorino"
Oct 30 23:34:00.327981 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.327940    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5aa43e7e-7219-433a-9136-037a5cb42e36" containerName="authorino"
Oct 30 23:34:00.327981 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.327956    4921 cpu_manager.go:414] "containerMap: removing container" podUID="aefc3afd-88d6-449e-a521-d99952e0c9f0" containerName="limitador"
Oct 30 23:34:00.327981 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.327965    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aefc3afd-88d6-449e-a521-d99952e0c9f0" containerName="limitador"
Oct 30 23:34:00.328071 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.328024    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="5aa43e7e-7219-433a-9136-037a5cb42e36" containerName="authorino"
Oct 30 23:34:00.328071 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.328036    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="aefc3afd-88d6-449e-a521-d99952e0c9f0" containerName="limitador"
Oct 30 23:34:00.332566 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.332548    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hc658"
Oct 30 23:34:00.339868 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.339848    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 23:34:00.339993 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.339926    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Oct 30 23:34:00.339993 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.339982    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-hfn7v\""
Oct 30 23:34:00.340118 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.340055    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 23:34:00.340465 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.340444    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-hc658"]
Oct 30 23:34:00.396360 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.396329    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb5w2\" (UniqueName: \"kubernetes.io/projected/10323a62-1e87-4a58-b415-0add56c3618d-kube-api-access-cb5w2\") pod \"postgres-7cdbf6dc44-hc658\" (UID: \"10323a62-1e87-4a58-b415-0add56c3618d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hc658"
Oct 30 23:34:00.396562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.396364    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/10323a62-1e87-4a58-b415-0add56c3618d-data\") pod \"postgres-7cdbf6dc44-hc658\" (UID: \"10323a62-1e87-4a58-b415-0add56c3618d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hc658"
Oct 30 23:34:00.448854 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.448825    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:34:00.496764 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.496737    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb5w2\" (UniqueName: \"kubernetes.io/projected/10323a62-1e87-4a58-b415-0add56c3618d-kube-api-access-cb5w2\") pod \"postgres-7cdbf6dc44-hc658\" (UID: \"10323a62-1e87-4a58-b415-0add56c3618d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hc658"
Oct 30 23:34:00.496899 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.496773    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/10323a62-1e87-4a58-b415-0add56c3618d-data\") pod \"postgres-7cdbf6dc44-hc658\" (UID: \"10323a62-1e87-4a58-b415-0add56c3618d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hc658"
Oct 30 23:34:00.497128 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.497109    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/10323a62-1e87-4a58-b415-0add56c3618d-data\") pod \"postgres-7cdbf6dc44-hc658\" (UID: \"10323a62-1e87-4a58-b415-0add56c3618d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hc658"
Oct 30 23:34:00.509244 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.509221    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb5w2\" (UniqueName: \"kubernetes.io/projected/10323a62-1e87-4a58-b415-0add56c3618d-kube-api-access-cb5w2\") pod \"postgres-7cdbf6dc44-hc658\" (UID: \"10323a62-1e87-4a58-b415-0add56c3618d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hc658"
Oct 30 23:34:00.645173 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.645147    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hc658"
Oct 30 23:34:00.918740 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.918718    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-hc658"]
Oct 30 23:34:00.921159 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:34:00.921134    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10323a62_1e87_4a58_b415_0add56c3618d.slice/crio-6bee94069638e1e86813f9fd53445da5923912d76d5753ae7984fdb770d78a2a WatchSource:0}: Error finding container 6bee94069638e1e86813f9fd53445da5923912d76d5753ae7984fdb770d78a2a: Status 404 returned error can't find the container with id 6bee94069638e1e86813f9fd53445da5923912d76d5753ae7984fdb770d78a2a
Oct 30 23:34:00.948401 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.948365    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 30 23:34:00.949242 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:00.949220    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 30 23:34:01.538328 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:01.538292    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hc658" event={"ID":"10323a62-1e87-4a58-b415-0add56c3618d","Type":"ContainerStarted","Data":"6bee94069638e1e86813f9fd53445da5923912d76d5753ae7984fdb770d78a2a"}
Oct 30 23:34:06.395296 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:06.395273    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Oct 30 23:34:06.563368 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:06.563334    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hc658" event={"ID":"10323a62-1e87-4a58-b415-0add56c3618d","Type":"ContainerStarted","Data":"8928abb74024b1e6dee0229ce83bb6c85dde3dcb39772327e4bcb5e7b596acb4"}
Oct 30 23:34:06.563579 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:06.563449    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hc658"
Oct 30 23:34:11.401176 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:34:11.401142    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:34:12.596213 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:12.596184    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hc658"
Oct 30 23:34:12.615913 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:12.615861    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-hc658" podStartSLOduration=7.14608811 podStartE2EDuration="12.615842899s" totalImagesPullingTime="5.469754789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:06.58195991 +0000 UTC m=+905.826815679" watchObservedRunningTime="2026-10-30 23:34:12.615842899 +0000 UTC m=+911.860698665"
Oct 30 23:34:14.420968 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:14.420931    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:34:14.547264 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:14.547235    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:34:19.778714 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:19.778686    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:34:19.796985 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:19.796954    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-579cf7c6d-kbk66"]
Oct 30 23:34:19.861316 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:19.861280    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-kbk66"]
Oct 30 23:34:19.861473 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:19.861406    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-kbk66"
Oct 30 23:34:19.865736 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:19.865713    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 30 23:34:19.867249 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:19.867229    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 30 23:34:19.867336 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:19.867300    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 30 23:34:19.867336 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:19.867317    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c7j2t\""
Oct 30 23:34:19.910488 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:19.910457    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:34:19.954910 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:19.954885    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cff31819-e9f8-4054-985c-80e2afdb483c-webhook-cert\") pod \"maas-controller-579cf7c6d-kbk66\" (UID: \"cff31819-e9f8-4054-985c-80e2afdb483c\") " pod="opendatahub/maas-controller-579cf7c6d-kbk66"
Oct 30 23:34:19.955009 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:19.954918    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmwgr\" (UniqueName: \"kubernetes.io/projected/cff31819-e9f8-4054-985c-80e2afdb483c-kube-api-access-mmwgr\") pod \"maas-controller-579cf7c6d-kbk66\" (UID: \"cff31819-e9f8-4054-985c-80e2afdb483c\") " pod="opendatahub/maas-controller-579cf7c6d-kbk66"
Oct 30 23:34:19.955009 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:19.954936    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cff31819-e9f8-4054-985c-80e2afdb483c-metrics-certs\") pod \"maas-controller-579cf7c6d-kbk66\" (UID: \"cff31819-e9f8-4054-985c-80e2afdb483c\") " pod="opendatahub/maas-controller-579cf7c6d-kbk66"
Oct 30 23:34:20.040432 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.040362    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:34:20.055461 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.055439    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cff31819-e9f8-4054-985c-80e2afdb483c-webhook-cert\") pod \"maas-controller-579cf7c6d-kbk66\" (UID: \"cff31819-e9f8-4054-985c-80e2afdb483c\") " pod="opendatahub/maas-controller-579cf7c6d-kbk66"
Oct 30 23:34:20.055556 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.055474    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmwgr\" (UniqueName: \"kubernetes.io/projected/cff31819-e9f8-4054-985c-80e2afdb483c-kube-api-access-mmwgr\") pod \"maas-controller-579cf7c6d-kbk66\" (UID: \"cff31819-e9f8-4054-985c-80e2afdb483c\") " pod="opendatahub/maas-controller-579cf7c6d-kbk66"
Oct 30 23:34:20.055556 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.055493    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cff31819-e9f8-4054-985c-80e2afdb483c-metrics-certs\") pod \"maas-controller-579cf7c6d-kbk66\" (UID: \"cff31819-e9f8-4054-985c-80e2afdb483c\") " pod="opendatahub/maas-controller-579cf7c6d-kbk66"
Oct 30 23:34:20.058080 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.058057    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cff31819-e9f8-4054-985c-80e2afdb483c-metrics-certs\") pod \"maas-controller-579cf7c6d-kbk66\" (UID: \"cff31819-e9f8-4054-985c-80e2afdb483c\") " pod="opendatahub/maas-controller-579cf7c6d-kbk66"
Oct 30 23:34:20.058169 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.058089    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cff31819-e9f8-4054-985c-80e2afdb483c-webhook-cert\") pod \"maas-controller-579cf7c6d-kbk66\" (UID: \"cff31819-e9f8-4054-985c-80e2afdb483c\") " pod="opendatahub/maas-controller-579cf7c6d-kbk66"
Oct 30 23:34:20.068092 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.068064    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmwgr\" (UniqueName: \"kubernetes.io/projected/cff31819-e9f8-4054-985c-80e2afdb483c-kube-api-access-mmwgr\") pod \"maas-controller-579cf7c6d-kbk66\" (UID: \"cff31819-e9f8-4054-985c-80e2afdb483c\") " pod="opendatahub/maas-controller-579cf7c6d-kbk66"
Oct 30 23:34:20.115814 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.115784    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d4db8f8cf-ngxnw"]
Oct 30 23:34:20.130756 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.130734    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d4db8f8cf-ngxnw"]
Oct 30 23:34:20.130873 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.130821    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw"
Oct 30 23:34:20.204770 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.204741    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-kbk66"
Oct 30 23:34:20.257660 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.257636    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a720b4f3-1ee9-4251-a83a-95f1357fe638-webhook-cert\") pod \"maas-controller-7d4db8f8cf-ngxnw\" (UID: \"a720b4f3-1ee9-4251-a83a-95f1357fe638\") " pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw"
Oct 30 23:34:20.257759 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.257683    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x49cx\" (UniqueName: \"kubernetes.io/projected/a720b4f3-1ee9-4251-a83a-95f1357fe638-kube-api-access-x49cx\") pod \"maas-controller-7d4db8f8cf-ngxnw\" (UID: \"a720b4f3-1ee9-4251-a83a-95f1357fe638\") " pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw"
Oct 30 23:34:20.257870 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.257847    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a720b4f3-1ee9-4251-a83a-95f1357fe638-metrics-certs\") pod \"maas-controller-7d4db8f8cf-ngxnw\" (UID: \"a720b4f3-1ee9-4251-a83a-95f1357fe638\") " pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw"
Oct 30 23:34:20.358404 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.358366    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a720b4f3-1ee9-4251-a83a-95f1357fe638-metrics-certs\") pod \"maas-controller-7d4db8f8cf-ngxnw\" (UID: \"a720b4f3-1ee9-4251-a83a-95f1357fe638\") " pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw"
Oct 30 23:34:20.358562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.358423    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a720b4f3-1ee9-4251-a83a-95f1357fe638-webhook-cert\") pod \"maas-controller-7d4db8f8cf-ngxnw\" (UID: \"a720b4f3-1ee9-4251-a83a-95f1357fe638\") " pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw"
Oct 30 23:34:20.358562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.358457    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x49cx\" (UniqueName: \"kubernetes.io/projected/a720b4f3-1ee9-4251-a83a-95f1357fe638-kube-api-access-x49cx\") pod \"maas-controller-7d4db8f8cf-ngxnw\" (UID: \"a720b4f3-1ee9-4251-a83a-95f1357fe638\") " pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw"
Oct 30 23:34:20.360983 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.360959    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a720b4f3-1ee9-4251-a83a-95f1357fe638-webhook-cert\") pod \"maas-controller-7d4db8f8cf-ngxnw\" (UID: \"a720b4f3-1ee9-4251-a83a-95f1357fe638\") " pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw"
Oct 30 23:34:20.361088 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.361000    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a720b4f3-1ee9-4251-a83a-95f1357fe638-metrics-certs\") pod \"maas-controller-7d4db8f8cf-ngxnw\" (UID: \"a720b4f3-1ee9-4251-a83a-95f1357fe638\") " pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw"
Oct 30 23:34:20.370791 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.370772    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x49cx\" (UniqueName: \"kubernetes.io/projected/a720b4f3-1ee9-4251-a83a-95f1357fe638-kube-api-access-x49cx\") pod \"maas-controller-7d4db8f8cf-ngxnw\" (UID: \"a720b4f3-1ee9-4251-a83a-95f1357fe638\") " pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw"
Oct 30 23:34:20.447652 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.447620    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw"
Oct 30 23:34:20.521837 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.521661    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-kbk66"]
Oct 30 23:34:20.531491 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:34:20.531427    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcff31819_e9f8_4054_985c_80e2afdb483c.slice/crio-035396d289419843915e26d341a58319dd42b2bf956da746fc80143cfec4e150 WatchSource:0}: Error finding container 035396d289419843915e26d341a58319dd42b2bf956da746fc80143cfec4e150: Status 404 returned error can't find the container with id 035396d289419843915e26d341a58319dd42b2bf956da746fc80143cfec4e150
Oct 30 23:34:20.621456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.621378    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-kbk66" event={"ID":"cff31819-e9f8-4054-985c-80e2afdb483c","Type":"ContainerStarted","Data":"035396d289419843915e26d341a58319dd42b2bf956da746fc80143cfec4e150"}
Oct 30 23:34:20.749972 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:20.749944    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d4db8f8cf-ngxnw"]
Oct 30 23:34:20.753200 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:34:20.753173    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda720b4f3_1ee9_4251_a83a_95f1357fe638.slice/crio-1a1f562d1b6db68e5f39f27e911529cbfad7d7becdfdd6eb46c1a7bb97bdaa45 WatchSource:0}: Error finding container 1a1f562d1b6db68e5f39f27e911529cbfad7d7becdfdd6eb46c1a7bb97bdaa45: Status 404 returned error can't find the container with id 1a1f562d1b6db68e5f39f27e911529cbfad7d7becdfdd6eb46c1a7bb97bdaa45
Oct 30 23:34:21.629716 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:21.629633    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw" event={"ID":"a720b4f3-1ee9-4251-a83a-95f1357fe638","Type":"ContainerStarted","Data":"1a1f562d1b6db68e5f39f27e911529cbfad7d7becdfdd6eb46c1a7bb97bdaa45"}
Oct 30 23:34:23.641913 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:23.641878    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw" event={"ID":"a720b4f3-1ee9-4251-a83a-95f1357fe638","Type":"ContainerStarted","Data":"50df50e50916d0636df181a4d28151f8e461c932786e94656a6980ed07478c24"}
Oct 30 23:34:23.642333 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:23.641983    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw"
Oct 30 23:34:23.643814 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:23.643789    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-kbk66" event={"ID":"cff31819-e9f8-4054-985c-80e2afdb483c","Type":"ContainerStarted","Data":"fc8152f909ae7d961ea6280449d9e59b783badef2510ab9284f07076d10b148a"}
Oct 30 23:34:23.643917 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:23.643871    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-579cf7c6d-kbk66"
Oct 30 23:34:23.668658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:23.668616    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw" podStartSLOduration=0.8515153 podStartE2EDuration="3.668577615s" totalImagesPullingTime="2.817062315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:23.666805184 +0000 UTC m=+922.911660953" watchObservedRunningTime="2026-10-30 23:34:23.668577615 +0000 UTC m=+922.913433382"
Oct 30 23:34:23.688130 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:23.688078    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-579cf7c6d-kbk66" podStartSLOduration=1.704805106 podStartE2EDuration="4.68806608s" totalImagesPullingTime="2.983260974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:34:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:23.687330016 +0000 UTC m=+922.932185788" watchObservedRunningTime="2026-10-30 23:34:23.68806608 +0000 UTC m=+922.932921842"
Oct 30 23:34:23.743882 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:23.743848    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:34:23.974685 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:23.974652    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:34:25.298329 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.298296    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5"]
Oct 30 23:34:25.301713 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.301693    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5"
Oct 30 23:34:25.312399 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.310738    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\""
Oct 30 23:34:25.312399 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.310759    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\""
Oct 30 23:34:25.312399 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.310807    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-vmvmj\""
Oct 30 23:34:25.312399 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.310819    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\""
Oct 30 23:34:25.312399 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.312352    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5"]
Oct 30 23:34:25.393285 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.393249    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:34:25.404664 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.404588    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r2bg5\" (UID: \"c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5"
Oct 30 23:34:25.404664 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.404667    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r2bg5\" (UID: \"c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5"
Oct 30 23:34:25.404893 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.404713    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r2bg5\" (UID: \"c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5"
Oct 30 23:34:25.404893 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.404778    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmztg\" (UniqueName: \"kubernetes.io/projected/c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3-kube-api-access-hmztg\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r2bg5\" (UID: \"c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5"
Oct 30 23:34:25.505461 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.505425    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r2bg5\" (UID: \"c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5"
Oct 30 23:34:25.505461 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.505463    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r2bg5\" (UID: \"c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5"
Oct 30 23:34:25.505690 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.505502    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmztg\" (UniqueName: \"kubernetes.io/projected/c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3-kube-api-access-hmztg\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r2bg5\" (UID: \"c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5"
Oct 30 23:34:25.505690 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.505559    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r2bg5\" (UID: \"c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5"
Oct 30 23:34:25.506204 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.506165    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r2bg5\" (UID: \"c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5"
Oct 30 23:34:25.506474 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.506447    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r2bg5\" (UID: \"c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5"
Oct 30 23:34:25.508067 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.508049    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r2bg5\" (UID: \"c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5"
Oct 30 23:34:25.520021 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.519998    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmztg\" (UniqueName: \"kubernetes.io/projected/c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3-kube-api-access-hmztg\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r2bg5\" (UID: \"c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5"
Oct 30 23:34:25.558939 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.558865    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:34:25.617847 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.617816    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5"
Oct 30 23:34:25.895800 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:25.895707    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5"]
Oct 30 23:34:25.898438 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:34:25.898412    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e75b86_d5ea_4eb0_aff6_7b224eceb9c3.slice/crio-245e080993a621e37af9948d8c51cec72edbe43118bda9d73271c4d008e183e3 WatchSource:0}: Error finding container 245e080993a621e37af9948d8c51cec72edbe43118bda9d73271c4d008e183e3: Status 404 returned error can't find the container with id 245e080993a621e37af9948d8c51cec72edbe43118bda9d73271c4d008e183e3
Oct 30 23:34:26.658643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:26.658605    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5" event={"ID":"c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3","Type":"ContainerStarted","Data":"245e080993a621e37af9948d8c51cec72edbe43118bda9d73271c4d008e183e3"}
Oct 30 23:34:34.650938 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:34.650911    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw"
Oct 30 23:34:34.651475 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:34.651414    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-579cf7c6d-kbk66"
Oct 30 23:34:34.706898 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:34.706862    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-kbk66"]
Oct 30 23:34:34.707124 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:34.707100    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-579cf7c6d-kbk66" podUID="cff31819-e9f8-4054-985c-80e2afdb483c" containerName="manager" containerID="cri-o://fc8152f909ae7d961ea6280449d9e59b783badef2510ab9284f07076d10b148a" gracePeriod=30
Oct 30 23:34:34.959710 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:34.959680    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-kbk66"
Oct 30 23:34:34.980558 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:34.980015    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cff31819-e9f8-4054-985c-80e2afdb483c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/cff31819-e9f8-4054-985c-80e2afdb483c-metrics-certs\") pod \"cff31819-e9f8-4054-985c-80e2afdb483c\" (UID: \"cff31819-e9f8-4054-985c-80e2afdb483c\") "
Oct 30 23:34:34.980558 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:34.980062    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cff31819-e9f8-4054-985c-80e2afdb483c-webhook-cert\" (UniqueName: \"kubernetes.io/secret/cff31819-e9f8-4054-985c-80e2afdb483c-webhook-cert\") pod \"cff31819-e9f8-4054-985c-80e2afdb483c\" (UID: \"cff31819-e9f8-4054-985c-80e2afdb483c\") "
Oct 30 23:34:34.980558 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:34.980139    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cff31819-e9f8-4054-985c-80e2afdb483c-kube-api-access-mmwgr\" (UniqueName: \"kubernetes.io/projected/cff31819-e9f8-4054-985c-80e2afdb483c-kube-api-access-mmwgr\") pod \"cff31819-e9f8-4054-985c-80e2afdb483c\" (UID: \"cff31819-e9f8-4054-985c-80e2afdb483c\") "
Oct 30 23:34:34.990800 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:34.990747    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cff31819-e9f8-4054-985c-80e2afdb483c-webhook-cert" pod "cff31819-e9f8-4054-985c-80e2afdb483c" (UID: "cff31819-e9f8-4054-985c-80e2afdb483c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:34:34.992030 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:34.991980    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cff31819-e9f8-4054-985c-80e2afdb483c-metrics-certs" pod "cff31819-e9f8-4054-985c-80e2afdb483c" (UID: "cff31819-e9f8-4054-985c-80e2afdb483c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:34:34.993859 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:34.993829    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cff31819-e9f8-4054-985c-80e2afdb483c-kube-api-access-mmwgr" pod "cff31819-e9f8-4054-985c-80e2afdb483c" (UID: "cff31819-e9f8-4054-985c-80e2afdb483c"). InnerVolumeSpecName "kube-api-access-mmwgr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:34:35.080890 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:35.080853    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmwgr\" (UniqueName: \"kubernetes.io/projected/cff31819-e9f8-4054-985c-80e2afdb483c-kube-api-access-mmwgr\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:34:35.080890 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:35.080884    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cff31819-e9f8-4054-985c-80e2afdb483c-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:34:35.080890 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:35.080893    4921 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cff31819-e9f8-4054-985c-80e2afdb483c-webhook-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:34:35.701816 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:35.701774    4921 generic.go:356] "Generic (PLEG): container finished" podID="cff31819-e9f8-4054-985c-80e2afdb483c" containerID="fc8152f909ae7d961ea6280449d9e59b783badef2510ab9284f07076d10b148a" exitCode=0
Oct 30 23:34:35.702256 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:35.701831    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-kbk66"
Oct 30 23:34:35.702256 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:35.701842    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-kbk66" event={"ID":"cff31819-e9f8-4054-985c-80e2afdb483c","Type":"ContainerDied","Data":"fc8152f909ae7d961ea6280449d9e59b783badef2510ab9284f07076d10b148a"}
Oct 30 23:34:35.702256 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:35.701894    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-kbk66" event={"ID":"cff31819-e9f8-4054-985c-80e2afdb483c","Type":"ContainerDied","Data":"035396d289419843915e26d341a58319dd42b2bf956da746fc80143cfec4e150"}
Oct 30 23:34:35.702256 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:35.701923    4921 scope.go:122] "RemoveContainer" containerID="fc8152f909ae7d961ea6280449d9e59b783badef2510ab9284f07076d10b148a"
Oct 30 23:34:35.712567 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:35.712368    4921 scope.go:122] "RemoveContainer" containerID="fc8152f909ae7d961ea6280449d9e59b783badef2510ab9284f07076d10b148a"
Oct 30 23:34:35.712699 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:34:35.712667    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc8152f909ae7d961ea6280449d9e59b783badef2510ab9284f07076d10b148a\": container with ID starting with fc8152f909ae7d961ea6280449d9e59b783badef2510ab9284f07076d10b148a not found: ID does not exist" containerID="fc8152f909ae7d961ea6280449d9e59b783badef2510ab9284f07076d10b148a"
Oct 30 23:34:35.712758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:35.712696    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc8152f909ae7d961ea6280449d9e59b783badef2510ab9284f07076d10b148a"} err="failed to get container status \"fc8152f909ae7d961ea6280449d9e59b783badef2510ab9284f07076d10b148a\": rpc error: code = NotFound desc = could not find container \"fc8152f909ae7d961ea6280449d9e59b783badef2510ab9284f07076d10b148a\": container with ID starting with fc8152f909ae7d961ea6280449d9e59b783badef2510ab9284f07076d10b148a not found: ID does not exist"
Oct 30 23:34:35.726623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:35.726575    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-kbk66"]
Oct 30 23:34:35.730562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:35.730538    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-kbk66"]
Oct 30 23:34:36.882799 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:36.882764    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cff31819-e9f8-4054-985c-80e2afdb483c" path="/var/lib/kubelet/pods/cff31819-e9f8-4054-985c-80e2afdb483c/volumes"
Oct 30 23:34:41.404759 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:34:41.404722    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:34:41.729903 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:41.729874    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5" event={"ID":"c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3","Type":"ContainerStarted","Data":"c799753b0d61b10bf218b06b2a77d09e43d7f8a61fc513213271a8d2e5573e8e"}
Oct 30 23:34:41.730065 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:41.730048    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5"
Oct 30 23:34:41.749970 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:41.749926    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5" podStartSLOduration=1.006122923 podStartE2EDuration="16.749912527s" totalImagesPullingTime="15.743789604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:34:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:41.749174193 +0000 UTC m=+940.994029959" watchObservedRunningTime="2026-10-30 23:34:41.749912527 +0000 UTC m=+940.994768294"
Oct 30 23:34:51.568175 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:51.568142    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:34:52.740631 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:52.740587    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r2bg5"
Oct 30 23:34:55.710611 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:55.710550    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:34:55.846245 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:55.846194    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:34:57.104941 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.104911    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:34:57.169185 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.169156    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"]
Oct 30 23:34:57.169531 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.169517    4921 cpu_manager.go:414] "containerMap: removing container" podUID="cff31819-e9f8-4054-985c-80e2afdb483c" containerName="manager"
Oct 30 23:34:57.169579 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.169532    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cff31819-e9f8-4054-985c-80e2afdb483c" containerName="manager"
Oct 30 23:34:57.169648 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.169615    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="cff31819-e9f8-4054-985c-80e2afdb483c" containerName="manager"
Oct 30 23:34:57.176850 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.176830    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"
Oct 30 23:34:57.196201 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.196156    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-59scr\""
Oct 30 23:34:57.196379 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.196232    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 23:34:57.196379 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.196297    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 30 23:34:57.196379 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.196329    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"]
Oct 30 23:34:57.246964 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.246937    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:34:57.264090 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.264062    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klcwp\" (UniqueName: \"kubernetes.io/projected/ab2e875b-9131-427f-80d7-dfca22172df8-kube-api-access-klcwp\") pod \"maas-api-6d669c7fcd-wmfjr\" (UID: \"ab2e875b-9131-427f-80d7-dfca22172df8\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"
Oct 30 23:34:57.264235 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.264102    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab2e875b-9131-427f-80d7-dfca22172df8-maas-api-tls\") pod \"maas-api-6d669c7fcd-wmfjr\" (UID: \"ab2e875b-9131-427f-80d7-dfca22172df8\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"
Oct 30 23:34:57.264235 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.264131    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab2e875b-9131-427f-80d7-dfca22172df8-openshift-service-ca\") pod \"maas-api-6d669c7fcd-wmfjr\" (UID: \"ab2e875b-9131-427f-80d7-dfca22172df8\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"
Oct 30 23:34:57.264355 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.264299    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2e875b-9131-427f-80d7-dfca22172df8-metrics-certs\") pod \"maas-api-6d669c7fcd-wmfjr\" (UID: \"ab2e875b-9131-427f-80d7-dfca22172df8\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"
Oct 30 23:34:57.364905 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.364835    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2e875b-9131-427f-80d7-dfca22172df8-metrics-certs\") pod \"maas-api-6d669c7fcd-wmfjr\" (UID: \"ab2e875b-9131-427f-80d7-dfca22172df8\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"
Oct 30 23:34:57.364905 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.364883    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klcwp\" (UniqueName: \"kubernetes.io/projected/ab2e875b-9131-427f-80d7-dfca22172df8-kube-api-access-klcwp\") pod \"maas-api-6d669c7fcd-wmfjr\" (UID: \"ab2e875b-9131-427f-80d7-dfca22172df8\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"
Oct 30 23:34:57.364905 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.364907    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab2e875b-9131-427f-80d7-dfca22172df8-maas-api-tls\") pod \"maas-api-6d669c7fcd-wmfjr\" (UID: \"ab2e875b-9131-427f-80d7-dfca22172df8\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"
Oct 30 23:34:57.365166 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.364934    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab2e875b-9131-427f-80d7-dfca22172df8-openshift-service-ca\") pod \"maas-api-6d669c7fcd-wmfjr\" (UID: \"ab2e875b-9131-427f-80d7-dfca22172df8\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"
Oct 30 23:34:57.365571 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.365548    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab2e875b-9131-427f-80d7-dfca22172df8-openshift-service-ca\") pod \"maas-api-6d669c7fcd-wmfjr\" (UID: \"ab2e875b-9131-427f-80d7-dfca22172df8\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"
Oct 30 23:34:57.367503 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.367483    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab2e875b-9131-427f-80d7-dfca22172df8-maas-api-tls\") pod \"maas-api-6d669c7fcd-wmfjr\" (UID: \"ab2e875b-9131-427f-80d7-dfca22172df8\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"
Oct 30 23:34:57.367583 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.367523    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2e875b-9131-427f-80d7-dfca22172df8-metrics-certs\") pod \"maas-api-6d669c7fcd-wmfjr\" (UID: \"ab2e875b-9131-427f-80d7-dfca22172df8\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"
Oct 30 23:34:57.376958 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.376936    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klcwp\" (UniqueName: \"kubernetes.io/projected/ab2e875b-9131-427f-80d7-dfca22172df8-kube-api-access-klcwp\") pod \"maas-api-6d669c7fcd-wmfjr\" (UID: \"ab2e875b-9131-427f-80d7-dfca22172df8\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"
Oct 30 23:34:57.489288 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.489256    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"
Oct 30 23:34:57.764737 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.764709    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"]
Oct 30 23:34:57.767142 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:34:57.767105    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab2e875b_9131_427f_80d7_dfca22172df8.slice/crio-38f5dbf1c7ac4e4c323f4078b8276655aa99ca6ea13e92abe87a42e50fdba6a0 WatchSource:0}: Error finding container 38f5dbf1c7ac4e4c323f4078b8276655aa99ca6ea13e92abe87a42e50fdba6a0: Status 404 returned error can't find the container with id 38f5dbf1c7ac4e4c323f4078b8276655aa99ca6ea13e92abe87a42e50fdba6a0
Oct 30 23:34:57.797516 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:34:57.797489    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr" event={"ID":"ab2e875b-9131-427f-80d7-dfca22172df8","Type":"ContainerStarted","Data":"38f5dbf1c7ac4e4c323f4078b8276655aa99ca6ea13e92abe87a42e50fdba6a0"}
Oct 30 23:35:00.810439 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:00.810399    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr" event={"ID":"ab2e875b-9131-427f-80d7-dfca22172df8","Type":"ContainerStarted","Data":"89eb698002b9f74269ffa7157442f54f008d0b48589dfb46ac9234d5d342eb93"}
Oct 30 23:35:00.810868 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:00.810496    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"
Oct 30 23:35:00.832983 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:00.832938    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr" podStartSLOduration=1.753225339 podStartE2EDuration="3.832924248s" totalImagesPullingTime="2.079698909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:00.831465265 +0000 UTC m=+960.076321039" watchObservedRunningTime="2026-10-30 23:35:00.832924248 +0000 UTC m=+960.077780017"
Oct 30 23:35:06.820577 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:06.820546    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"
Oct 30 23:35:07.311471 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.311433    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:35:07.554798 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.554764    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:35:07.588289 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.588215    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6dd76875b5-tkhgn"]
Oct 30 23:35:07.609190 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.609163    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-tkhgn"]
Oct 30 23:35:07.609348 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.609258    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-tkhgn"
Oct 30 23:35:07.614721 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.614697    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hc9wr\""
Oct 30 23:35:07.614878 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.614843    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Oct 30 23:35:07.621588 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.621567    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 23:35:07.621765 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.621638    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 23:35:07.626249 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.626225    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-tkhgn"]
Oct 30 23:35:07.629069 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:35:07.629048    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-m8gwc tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-m8gwc tls-cert]: context canceled" pod="kuadrant-system/authorino-6dd76875b5-tkhgn" podUID="04fb3c48-9dbd-4495-8dce-ac5e0430fd2f"
Oct 30 23:35:07.656143 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.656115    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-9fnj6"]
Oct 30 23:35:07.659547 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.659532    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-9fnj6"
Oct 30 23:35:07.670709 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.670685    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-9fnj6"]
Oct 30 23:35:07.757265 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.757236    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/004a1bbe-431a-44c2-81fa-0213e7e02eb1-tls-cert\") pod \"authorino-6889cbd8c4-9fnj6\" (UID: \"004a1bbe-431a-44c2-81fa-0213e7e02eb1\") " pod="kuadrant-system/authorino-6889cbd8c4-9fnj6"
Oct 30 23:35:07.757452 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.757276    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/04fb3c48-9dbd-4495-8dce-ac5e0430fd2f-tls-cert\") pod \"authorino-6dd76875b5-tkhgn\" (UID: \"04fb3c48-9dbd-4495-8dce-ac5e0430fd2f\") " pod="kuadrant-system/authorino-6dd76875b5-tkhgn"
Oct 30 23:35:07.757452 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.757368    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmxxn\" (UniqueName: \"kubernetes.io/projected/004a1bbe-431a-44c2-81fa-0213e7e02eb1-kube-api-access-mmxxn\") pod \"authorino-6889cbd8c4-9fnj6\" (UID: \"004a1bbe-431a-44c2-81fa-0213e7e02eb1\") " pod="kuadrant-system/authorino-6889cbd8c4-9fnj6"
Oct 30 23:35:07.757452 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.757412    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8gwc\" (UniqueName: \"kubernetes.io/projected/04fb3c48-9dbd-4495-8dce-ac5e0430fd2f-kube-api-access-m8gwc\") pod \"authorino-6dd76875b5-tkhgn\" (UID: \"04fb3c48-9dbd-4495-8dce-ac5e0430fd2f\") " pod="kuadrant-system/authorino-6dd76875b5-tkhgn"
Oct 30 23:35:07.818309 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.818275    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"]
Oct 30 23:35:07.821780 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.821764    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"
Oct 30 23:35:07.835293 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.835269    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"]
Oct 30 23:35:07.839539 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.839480    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-tkhgn"
Oct 30 23:35:07.849859 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.849834    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-tkhgn"
Oct 30 23:35:07.857844 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.857820    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/04fb3c48-9dbd-4495-8dce-ac5e0430fd2f-tls-cert\") pod \"authorino-6dd76875b5-tkhgn\" (UID: \"04fb3c48-9dbd-4495-8dce-ac5e0430fd2f\") " pod="kuadrant-system/authorino-6dd76875b5-tkhgn"
Oct 30 23:35:07.857973 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.857870    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmxxn\" (UniqueName: \"kubernetes.io/projected/004a1bbe-431a-44c2-81fa-0213e7e02eb1-kube-api-access-mmxxn\") pod \"authorino-6889cbd8c4-9fnj6\" (UID: \"004a1bbe-431a-44c2-81fa-0213e7e02eb1\") " pod="kuadrant-system/authorino-6889cbd8c4-9fnj6"
Oct 30 23:35:07.857973 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.857898    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8gwc\" (UniqueName: \"kubernetes.io/projected/04fb3c48-9dbd-4495-8dce-ac5e0430fd2f-kube-api-access-m8gwc\") pod \"authorino-6dd76875b5-tkhgn\" (UID: \"04fb3c48-9dbd-4495-8dce-ac5e0430fd2f\") " pod="kuadrant-system/authorino-6dd76875b5-tkhgn"
Oct 30 23:35:07.857973 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.857949    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/004a1bbe-431a-44c2-81fa-0213e7e02eb1-tls-cert\") pod \"authorino-6889cbd8c4-9fnj6\" (UID: \"004a1bbe-431a-44c2-81fa-0213e7e02eb1\") " pod="kuadrant-system/authorino-6889cbd8c4-9fnj6"
Oct 30 23:35:07.860469 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.860445    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/04fb3c48-9dbd-4495-8dce-ac5e0430fd2f-tls-cert\") pod \"authorino-6dd76875b5-tkhgn\" (UID: \"04fb3c48-9dbd-4495-8dce-ac5e0430fd2f\") " pod="kuadrant-system/authorino-6dd76875b5-tkhgn"
Oct 30 23:35:07.861083 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.861063    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/004a1bbe-431a-44c2-81fa-0213e7e02eb1-tls-cert\") pod \"authorino-6889cbd8c4-9fnj6\" (UID: \"004a1bbe-431a-44c2-81fa-0213e7e02eb1\") " pod="kuadrant-system/authorino-6889cbd8c4-9fnj6"
Oct 30 23:35:07.872887 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.872860    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8gwc\" (UniqueName: \"kubernetes.io/projected/04fb3c48-9dbd-4495-8dce-ac5e0430fd2f-kube-api-access-m8gwc\") pod \"authorino-6dd76875b5-tkhgn\" (UID: \"04fb3c48-9dbd-4495-8dce-ac5e0430fd2f\") " pod="kuadrant-system/authorino-6dd76875b5-tkhgn"
Oct 30 23:35:07.874729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.874708    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmxxn\" (UniqueName: \"kubernetes.io/projected/004a1bbe-431a-44c2-81fa-0213e7e02eb1-kube-api-access-mmxxn\") pod \"authorino-6889cbd8c4-9fnj6\" (UID: \"004a1bbe-431a-44c2-81fa-0213e7e02eb1\") " pod="kuadrant-system/authorino-6889cbd8c4-9fnj6"
Oct 30 23:35:07.958815 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.958777    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04fb3c48-9dbd-4495-8dce-ac5e0430fd2f-kube-api-access-m8gwc\" (UniqueName: \"kubernetes.io/projected/04fb3c48-9dbd-4495-8dce-ac5e0430fd2f-kube-api-access-m8gwc\") pod \"04fb3c48-9dbd-4495-8dce-ac5e0430fd2f\" (UID: \"04fb3c48-9dbd-4495-8dce-ac5e0430fd2f\") "
Oct 30 23:35:07.958972 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.958835    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/04fb3c48-9dbd-4495-8dce-ac5e0430fd2f-tls-cert\" (UniqueName: \"kubernetes.io/secret/04fb3c48-9dbd-4495-8dce-ac5e0430fd2f-tls-cert\") pod \"04fb3c48-9dbd-4495-8dce-ac5e0430fd2f\" (UID: \"04fb3c48-9dbd-4495-8dce-ac5e0430fd2f\") "
Oct 30 23:35:07.958972 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.958922    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53817341-d005-4c2f-b1f9-925dbc988568-maas-api-tls\") pod \"maas-api-55477bdbbc-c8swk\" (UID: \"53817341-d005-4c2f-b1f9-925dbc988568\") " pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"
Oct 30 23:35:07.959048 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.958984    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53817341-d005-4c2f-b1f9-925dbc988568-metrics-certs\") pod \"maas-api-55477bdbbc-c8swk\" (UID: \"53817341-d005-4c2f-b1f9-925dbc988568\") " pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"
Oct 30 23:35:07.959126 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.959112    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53817341-d005-4c2f-b1f9-925dbc988568-openshift-service-ca\") pod \"maas-api-55477bdbbc-c8swk\" (UID: \"53817341-d005-4c2f-b1f9-925dbc988568\") " pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"
Oct 30 23:35:07.959179 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.959135    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxhn5\" (UniqueName: \"kubernetes.io/projected/53817341-d005-4c2f-b1f9-925dbc988568-kube-api-access-vxhn5\") pod \"maas-api-55477bdbbc-c8swk\" (UID: \"53817341-d005-4c2f-b1f9-925dbc988568\") " pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"
Oct 30 23:35:07.961176 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.961148    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04fb3c48-9dbd-4495-8dce-ac5e0430fd2f-kube-api-access-m8gwc" pod "04fb3c48-9dbd-4495-8dce-ac5e0430fd2f" (UID: "04fb3c48-9dbd-4495-8dce-ac5e0430fd2f"). InnerVolumeSpecName "kube-api-access-m8gwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:07.961278 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.961181    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04fb3c48-9dbd-4495-8dce-ac5e0430fd2f-tls-cert" pod "04fb3c48-9dbd-4495-8dce-ac5e0430fd2f" (UID: "04fb3c48-9dbd-4495-8dce-ac5e0430fd2f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:35:07.970447 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:07.970428    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-9fnj6"
Oct 30 23:35:08.003454 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.003427    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-9fnj6"]
Oct 30 23:35:08.036735 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.036686    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d8565944c-plzh9"]
Oct 30 23:35:08.042120 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.042051    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d8565944c-plzh9"
Oct 30 23:35:08.051939 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.051759    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d8565944c-plzh9"]
Oct 30 23:35:08.060650 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.060495    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53817341-d005-4c2f-b1f9-925dbc988568-openshift-service-ca\") pod \"maas-api-55477bdbbc-c8swk\" (UID: \"53817341-d005-4c2f-b1f9-925dbc988568\") " pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"
Oct 30 23:35:08.060650 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.060524    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxhn5\" (UniqueName: \"kubernetes.io/projected/53817341-d005-4c2f-b1f9-925dbc988568-kube-api-access-vxhn5\") pod \"maas-api-55477bdbbc-c8swk\" (UID: \"53817341-d005-4c2f-b1f9-925dbc988568\") " pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"
Oct 30 23:35:08.060650 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.060568    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53817341-d005-4c2f-b1f9-925dbc988568-maas-api-tls\") pod \"maas-api-55477bdbbc-c8swk\" (UID: \"53817341-d005-4c2f-b1f9-925dbc988568\") " pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"
Oct 30 23:35:08.060825 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.060655    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53817341-d005-4c2f-b1f9-925dbc988568-metrics-certs\") pod \"maas-api-55477bdbbc-c8swk\" (UID: \"53817341-d005-4c2f-b1f9-925dbc988568\") " pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"
Oct 30 23:35:08.060825 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.060719    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8gwc\" (UniqueName: \"kubernetes.io/projected/04fb3c48-9dbd-4495-8dce-ac5e0430fd2f-kube-api-access-m8gwc\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:35:08.060825 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.060735    4921 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/04fb3c48-9dbd-4495-8dce-ac5e0430fd2f-tls-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:35:08.061231 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.061208    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53817341-d005-4c2f-b1f9-925dbc988568-openshift-service-ca\") pod \"maas-api-55477bdbbc-c8swk\" (UID: \"53817341-d005-4c2f-b1f9-925dbc988568\") " pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"
Oct 30 23:35:08.063367 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.063346    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53817341-d005-4c2f-b1f9-925dbc988568-metrics-certs\") pod \"maas-api-55477bdbbc-c8swk\" (UID: \"53817341-d005-4c2f-b1f9-925dbc988568\") " pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"
Oct 30 23:35:08.063722 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.063699    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53817341-d005-4c2f-b1f9-925dbc988568-maas-api-tls\") pod \"maas-api-55477bdbbc-c8swk\" (UID: \"53817341-d005-4c2f-b1f9-925dbc988568\") " pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"
Oct 30 23:35:08.074528 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.074505    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxhn5\" (UniqueName: \"kubernetes.io/projected/53817341-d005-4c2f-b1f9-925dbc988568-kube-api-access-vxhn5\") pod \"maas-api-55477bdbbc-c8swk\" (UID: \"53817341-d005-4c2f-b1f9-925dbc988568\") " pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"
Oct 30 23:35:08.149294 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.149267    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"
Oct 30 23:35:08.161725 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.161703    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/251b8a3f-c7a6-4dfd-9311-903f4eaeedec-tls-cert\") pod \"authorino-5d8565944c-plzh9\" (UID: \"251b8a3f-c7a6-4dfd-9311-903f4eaeedec\") " pod="kuadrant-system/authorino-5d8565944c-plzh9"
Oct 30 23:35:08.161817 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.161783    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwswl\" (UniqueName: \"kubernetes.io/projected/251b8a3f-c7a6-4dfd-9311-903f4eaeedec-kube-api-access-hwswl\") pod \"authorino-5d8565944c-plzh9\" (UID: \"251b8a3f-c7a6-4dfd-9311-903f4eaeedec\") " pod="kuadrant-system/authorino-5d8565944c-plzh9"
Oct 30 23:35:08.243847 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.243821    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-9fnj6"]
Oct 30 23:35:08.246282 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:35:08.246248    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod004a1bbe_431a_44c2_81fa_0213e7e02eb1.slice/crio-4d5558c2c2c28c4ad0f6d9e1e2aed7264871e58dbe844b549d1d352835a5ce9c WatchSource:0}: Error finding container 4d5558c2c2c28c4ad0f6d9e1e2aed7264871e58dbe844b549d1d352835a5ce9c: Status 404 returned error can't find the container with id 4d5558c2c2c28c4ad0f6d9e1e2aed7264871e58dbe844b549d1d352835a5ce9c
Oct 30 23:35:08.263180 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.263153    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/251b8a3f-c7a6-4dfd-9311-903f4eaeedec-tls-cert\") pod \"authorino-5d8565944c-plzh9\" (UID: \"251b8a3f-c7a6-4dfd-9311-903f4eaeedec\") " pod="kuadrant-system/authorino-5d8565944c-plzh9"
Oct 30 23:35:08.263285 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.263249    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwswl\" (UniqueName: \"kubernetes.io/projected/251b8a3f-c7a6-4dfd-9311-903f4eaeedec-kube-api-access-hwswl\") pod \"authorino-5d8565944c-plzh9\" (UID: \"251b8a3f-c7a6-4dfd-9311-903f4eaeedec\") " pod="kuadrant-system/authorino-5d8565944c-plzh9"
Oct 30 23:35:08.265833 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.265814    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/251b8a3f-c7a6-4dfd-9311-903f4eaeedec-tls-cert\") pod \"authorino-5d8565944c-plzh9\" (UID: \"251b8a3f-c7a6-4dfd-9311-903f4eaeedec\") " pod="kuadrant-system/authorino-5d8565944c-plzh9"
Oct 30 23:35:08.280566 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.280535    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwswl\" (UniqueName: \"kubernetes.io/projected/251b8a3f-c7a6-4dfd-9311-903f4eaeedec-kube-api-access-hwswl\") pod \"authorino-5d8565944c-plzh9\" (UID: \"251b8a3f-c7a6-4dfd-9311-903f4eaeedec\") " pod="kuadrant-system/authorino-5d8565944c-plzh9"
Oct 30 23:35:08.355540 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.355506    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d8565944c-plzh9"
Oct 30 23:35:08.424356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.424326    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"]
Oct 30 23:35:08.427202 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:35:08.427168    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53817341_d005_4c2f_b1f9_925dbc988568.slice/crio-f962b5d4da7c5546652ff19d0da133d3784025ee220e37f7576747e7ba193ae4 WatchSource:0}: Error finding container f962b5d4da7c5546652ff19d0da133d3784025ee220e37f7576747e7ba193ae4: Status 404 returned error can't find the container with id f962b5d4da7c5546652ff19d0da133d3784025ee220e37f7576747e7ba193ae4
Oct 30 23:35:08.635296 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.635272    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d8565944c-plzh9"]
Oct 30 23:35:08.637506 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:35:08.637474    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod251b8a3f_c7a6_4dfd_9311_903f4eaeedec.slice/crio-290112abe479ae856e758f9a0b161a4ca182991e4ed498507f9d25a26e36ac3b WatchSource:0}: Error finding container 290112abe479ae856e758f9a0b161a4ca182991e4ed498507f9d25a26e36ac3b: Status 404 returned error can't find the container with id 290112abe479ae856e758f9a0b161a4ca182991e4ed498507f9d25a26e36ac3b
Oct 30 23:35:08.844942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.844907    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-9fnj6" event={"ID":"004a1bbe-431a-44c2-81fa-0213e7e02eb1","Type":"ContainerStarted","Data":"4d5558c2c2c28c4ad0f6d9e1e2aed7264871e58dbe844b549d1d352835a5ce9c"}
Oct 30 23:35:08.846357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.846332    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d8565944c-plzh9" event={"ID":"251b8a3f-c7a6-4dfd-9311-903f4eaeedec","Type":"ContainerStarted","Data":"290112abe479ae856e758f9a0b161a4ca182991e4ed498507f9d25a26e36ac3b"}
Oct 30 23:35:08.847437 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.847416    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk" event={"ID":"53817341-d005-4c2f-b1f9-925dbc988568","Type":"ContainerStarted","Data":"f962b5d4da7c5546652ff19d0da133d3784025ee220e37f7576747e7ba193ae4"}
Oct 30 23:35:08.847437 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.847435    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-tkhgn"
Oct 30 23:35:08.884351 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.884324    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-tkhgn"]
Oct 30 23:35:08.891781 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:08.891757    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-tkhgn"]
Oct 30 23:35:09.045315 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.045288    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"]
Oct 30 23:35:09.050667 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.050646    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.068356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.067639    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"]
Oct 30 23:35:09.132588 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.132551    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rb9gl\""
Oct 30 23:35:09.171942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.171909    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a119696e-c906-4165-8ad5-c2564905dd39-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.172111 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.171961    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.172111 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.171992    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bndxv\" (UniqueName: \"kubernetes.io/projected/a119696e-c906-4165-8ad5-c2564905dd39-kube-api-access-bndxv\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.172229 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.172133    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a119696e-c906-4165-8ad5-c2564905dd39-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.172229 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.172178    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.172229 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.172198    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a119696e-c906-4165-8ad5-c2564905dd39-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.172229 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.172221    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.172406 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.172277    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.172406 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.172384    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.272961 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.272906    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.273257 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.273234    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a119696e-c906-4165-8ad5-c2564905dd39-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.273408 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.273382    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.273535 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.273427    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bndxv\" (UniqueName: \"kubernetes.io/projected/a119696e-c906-4165-8ad5-c2564905dd39-kube-api-access-bndxv\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.273535 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.273463    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.273535 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.273485    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a119696e-c906-4165-8ad5-c2564905dd39-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.273678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.273534    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.273678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.273563    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a119696e-c906-4165-8ad5-c2564905dd39-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.273678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.273619    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.273678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.273659    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.273948 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.273925    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.274156 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.274134    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.274932 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.274761    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.275039 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.274975    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a119696e-c906-4165-8ad5-c2564905dd39-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.277241 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.277222    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.277468 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.277449    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a119696e-c906-4165-8ad5-c2564905dd39-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.287575 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.287541    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bndxv\" (UniqueName: \"kubernetes.io/projected/a119696e-c906-4165-8ad5-c2564905dd39-kube-api-access-bndxv\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.287575 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.287569    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a119696e-c906-4165-8ad5-c2564905dd39-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-jxst9\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.389762 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.389728    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:09.703226 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.702667    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"]
Oct 30 23:35:09.708145 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:35:09.708094    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda119696e_c906_4165_8ad5_c2564905dd39.slice/crio-7e99de7ba3c88b11f304a8830186a0aee5c1858ab88250a6099bd975799ce964 WatchSource:0}: Error finding container 7e99de7ba3c88b11f304a8830186a0aee5c1858ab88250a6099bd975799ce964: Status 404 returned error can't find the container with id 7e99de7ba3c88b11f304a8830186a0aee5c1858ab88250a6099bd975799ce964
Oct 30 23:35:09.861066 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.861022    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6889cbd8c4-9fnj6" podUID="004a1bbe-431a-44c2-81fa-0213e7e02eb1" containerName="authorino" containerID="cri-o://27e36a27dc727d276a84a09b233ec273f560de84571442eae20766e5833acf69" gracePeriod=30
Oct 30 23:35:09.861572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.861401    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-9fnj6" event={"ID":"004a1bbe-431a-44c2-81fa-0213e7e02eb1","Type":"ContainerStarted","Data":"27e36a27dc727d276a84a09b233ec273f560de84571442eae20766e5833acf69"}
Oct 30 23:35:09.864190 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.864159    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d8565944c-plzh9" event={"ID":"251b8a3f-c7a6-4dfd-9311-903f4eaeedec","Type":"ContainerStarted","Data":"b342906c7e1539d14fa5e717b54a7fa27f702f55d1e372662f0f829da016bf46"}
Oct 30 23:35:09.866082 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.866044    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk" event={"ID":"53817341-d005-4c2f-b1f9-925dbc988568","Type":"ContainerStarted","Data":"04ae6325c6589eb413b63bda6a01cb0cadc23af200ec3030f04019de456ece42"}
Oct 30 23:35:09.866334 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.866315    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"
Oct 30 23:35:09.867950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.867914    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9" event={"ID":"a119696e-c906-4165-8ad5-c2564905dd39","Type":"ContainerStarted","Data":"7e99de7ba3c88b11f304a8830186a0aee5c1858ab88250a6099bd975799ce964"}
Oct 30 23:35:09.883834 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.883789    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6889cbd8c4-9fnj6" podStartSLOduration=2.108629879 podStartE2EDuration="2.883778604s" totalImagesPullingTime="775.148725ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:09.882533654 +0000 UTC m=+969.127389422" watchObservedRunningTime="2026-10-30 23:35:09.883778604 +0000 UTC m=+969.128634372"
Oct 30 23:35:09.903555 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.903511    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk" podStartSLOduration=2.501871278 podStartE2EDuration="2.903499861s" totalImagesPullingTime="401.628583ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:09.902769975 +0000 UTC m=+969.147625744" watchObservedRunningTime="2026-10-30 23:35:09.903499861 +0000 UTC m=+969.148355623"
Oct 30 23:35:09.921296 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:09.921253    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-5d8565944c-plzh9" podStartSLOduration=1.28402658 podStartE2EDuration="1.921242013s" totalImagesPullingTime="637.215433ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:09.920237321 +0000 UTC m=+969.165093091" watchObservedRunningTime="2026-10-30 23:35:09.921242013 +0000 UTC m=+969.166097829"
Oct 30 23:35:10.148587 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:10.148528    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-9fnj6"
Oct 30 23:35:10.288240 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:10.288167    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/004a1bbe-431a-44c2-81fa-0213e7e02eb1-tls-cert\" (UniqueName: \"kubernetes.io/secret/004a1bbe-431a-44c2-81fa-0213e7e02eb1-tls-cert\") pod \"004a1bbe-431a-44c2-81fa-0213e7e02eb1\" (UID: \"004a1bbe-431a-44c2-81fa-0213e7e02eb1\") "
Oct 30 23:35:10.288392 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:10.288264    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/004a1bbe-431a-44c2-81fa-0213e7e02eb1-kube-api-access-mmxxn\" (UniqueName: \"kubernetes.io/projected/004a1bbe-431a-44c2-81fa-0213e7e02eb1-kube-api-access-mmxxn\") pod \"004a1bbe-431a-44c2-81fa-0213e7e02eb1\" (UID: \"004a1bbe-431a-44c2-81fa-0213e7e02eb1\") "
Oct 30 23:35:10.290396 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:10.290370    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/004a1bbe-431a-44c2-81fa-0213e7e02eb1-kube-api-access-mmxxn" pod "004a1bbe-431a-44c2-81fa-0213e7e02eb1" (UID: "004a1bbe-431a-44c2-81fa-0213e7e02eb1"). InnerVolumeSpecName "kube-api-access-mmxxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:10.298843 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:10.298818    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/004a1bbe-431a-44c2-81fa-0213e7e02eb1-tls-cert" pod "004a1bbe-431a-44c2-81fa-0213e7e02eb1" (UID: "004a1bbe-431a-44c2-81fa-0213e7e02eb1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:35:10.389747 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:10.389714    4921 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/004a1bbe-431a-44c2-81fa-0213e7e02eb1-tls-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:35:10.389747 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:10.389744    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmxxn\" (UniqueName: \"kubernetes.io/projected/004a1bbe-431a-44c2-81fa-0213e7e02eb1-kube-api-access-mmxxn\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:35:10.873787 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:10.873754    4921 generic.go:356] "Generic (PLEG): container finished" podID="004a1bbe-431a-44c2-81fa-0213e7e02eb1" containerID="27e36a27dc727d276a84a09b233ec273f560de84571442eae20766e5833acf69" exitCode=0
Oct 30 23:35:10.874443 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:10.874425    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-9fnj6"
Oct 30 23:35:10.874694 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:10.874669    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-9fnj6" event={"ID":"004a1bbe-431a-44c2-81fa-0213e7e02eb1","Type":"ContainerDied","Data":"27e36a27dc727d276a84a09b233ec273f560de84571442eae20766e5833acf69"}
Oct 30 23:35:10.874792 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:10.874717    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-9fnj6" event={"ID":"004a1bbe-431a-44c2-81fa-0213e7e02eb1","Type":"ContainerDied","Data":"4d5558c2c2c28c4ad0f6d9e1e2aed7264871e58dbe844b549d1d352835a5ce9c"}
Oct 30 23:35:10.874792 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:10.874740    4921 scope.go:122] "RemoveContainer" containerID="27e36a27dc727d276a84a09b233ec273f560de84571442eae20766e5833acf69"
Oct 30 23:35:10.882385 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:10.882365    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="04fb3c48-9dbd-4495-8dce-ac5e0430fd2f" path="/var/lib/kubelet/pods/04fb3c48-9dbd-4495-8dce-ac5e0430fd2f/volumes"
Oct 30 23:35:10.885711 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:10.885620    4921 scope.go:122] "RemoveContainer" containerID="27e36a27dc727d276a84a09b233ec273f560de84571442eae20766e5833acf69"
Oct 30 23:35:10.886113 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:35:10.886076    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27e36a27dc727d276a84a09b233ec273f560de84571442eae20766e5833acf69\": container with ID starting with 27e36a27dc727d276a84a09b233ec273f560de84571442eae20766e5833acf69 not found: ID does not exist" containerID="27e36a27dc727d276a84a09b233ec273f560de84571442eae20766e5833acf69"
Oct 30 23:35:10.886223 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:10.886114    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27e36a27dc727d276a84a09b233ec273f560de84571442eae20766e5833acf69"} err="failed to get container status \"27e36a27dc727d276a84a09b233ec273f560de84571442eae20766e5833acf69\": rpc error: code = NotFound desc = could not find container \"27e36a27dc727d276a84a09b233ec273f560de84571442eae20766e5833acf69\": container with ID starting with 27e36a27dc727d276a84a09b233ec273f560de84571442eae20766e5833acf69 not found: ID does not exist"
Oct 30 23:35:10.906264 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:10.906242    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-9fnj6"]
Oct 30 23:35:10.910368 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:10.910324    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-9fnj6"]
Oct 30 23:35:11.405794 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:35:11.405756    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:35:12.880920 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:12.880888    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="004a1bbe-431a-44c2-81fa-0213e7e02eb1" path="/var/lib/kubelet/pods/004a1bbe-431a-44c2-81fa-0213e7e02eb1/volumes"
Oct 30 23:35:13.140831 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:13.140799    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:35:13.140936 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:13.140872    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:35:13.140936 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:13.140905    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:35:13.899450 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:13.899419    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9" event={"ID":"a119696e-c906-4165-8ad5-c2564905dd39","Type":"ContainerStarted","Data":"c5e86926effffda425e295d82e073d4dafd5df02fbaf34c2206b775ddeab0a23"}
Oct 30 23:35:13.926184 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:13.926139    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9" podStartSLOduration=1.498835076 podStartE2EDuration="4.926125546s" totalImagesPullingTime="3.42729047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:13.923793675 +0000 UTC m=+973.168649455" watchObservedRunningTime="2026-10-30 23:35:13.926125546 +0000 UTC m=+973.170981310"
Oct 30 23:35:14.391721 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:14.391680    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:14.391919 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:14.391748    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-jxst9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Oct 30 23:35:14.391919 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:14.391796    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9" podUID="a119696e-c906-4165-8ad5-c2564905dd39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Oct 30 23:35:15.391629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:15.391051    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-jxst9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Oct 30 23:35:15.391629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:15.391114    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9" podUID="a119696e-c906-4165-8ad5-c2564905dd39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Oct 30 23:35:15.893482 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:15.893448    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"
Oct 30 23:35:15.945850 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:15.945821    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"]
Oct 30 23:35:15.946029 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:15.945987    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr" podUID="ab2e875b-9131-427f-80d7-dfca22172df8" containerName="maas-api" containerID="cri-o://89eb698002b9f74269ffa7157442f54f008d0b48589dfb46ac9234d5d342eb93" gracePeriod=30
Oct 30 23:35:16.238195 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.238168    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"
Oct 30 23:35:16.343484 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.343448    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ab2e875b-9131-427f-80d7-dfca22172df8-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2e875b-9131-427f-80d7-dfca22172df8-metrics-certs\") pod \"ab2e875b-9131-427f-80d7-dfca22172df8\" (UID: \"ab2e875b-9131-427f-80d7-dfca22172df8\") "
Oct 30 23:35:16.343726 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.343508    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab2e875b-9131-427f-80d7-dfca22172df8-kube-api-access-klcwp\" (UniqueName: \"kubernetes.io/projected/ab2e875b-9131-427f-80d7-dfca22172df8-kube-api-access-klcwp\") pod \"ab2e875b-9131-427f-80d7-dfca22172df8\" (UID: \"ab2e875b-9131-427f-80d7-dfca22172df8\") "
Oct 30 23:35:16.343726 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.343537    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ab2e875b-9131-427f-80d7-dfca22172df8-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab2e875b-9131-427f-80d7-dfca22172df8-maas-api-tls\") pod \"ab2e875b-9131-427f-80d7-dfca22172df8\" (UID: \"ab2e875b-9131-427f-80d7-dfca22172df8\") "
Oct 30 23:35:16.343726 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.343568    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ab2e875b-9131-427f-80d7-dfca22172df8-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab2e875b-9131-427f-80d7-dfca22172df8-openshift-service-ca\") pod \"ab2e875b-9131-427f-80d7-dfca22172df8\" (UID: \"ab2e875b-9131-427f-80d7-dfca22172df8\") "
Oct 30 23:35:16.344015 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.343987    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab2e875b-9131-427f-80d7-dfca22172df8-openshift-service-ca" pod "ab2e875b-9131-427f-80d7-dfca22172df8" (UID: "ab2e875b-9131-427f-80d7-dfca22172df8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:35:16.345992 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.345963    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab2e875b-9131-427f-80d7-dfca22172df8-maas-api-tls" pod "ab2e875b-9131-427f-80d7-dfca22172df8" (UID: "ab2e875b-9131-427f-80d7-dfca22172df8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:35:16.345992 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.345967    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab2e875b-9131-427f-80d7-dfca22172df8-kube-api-access-klcwp" pod "ab2e875b-9131-427f-80d7-dfca22172df8" (UID: "ab2e875b-9131-427f-80d7-dfca22172df8"). InnerVolumeSpecName "kube-api-access-klcwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:35:16.346125 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.345989    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab2e875b-9131-427f-80d7-dfca22172df8-metrics-certs" pod "ab2e875b-9131-427f-80d7-dfca22172df8" (UID: "ab2e875b-9131-427f-80d7-dfca22172df8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:35:16.392039 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.391998    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-jxst9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Oct 30 23:35:16.392531 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.392063    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9" podUID="a119696e-c906-4165-8ad5-c2564905dd39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Oct 30 23:35:16.444395 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.444373    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2e875b-9131-427f-80d7-dfca22172df8-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:35:16.444395 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.444395    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klcwp\" (UniqueName: \"kubernetes.io/projected/ab2e875b-9131-427f-80d7-dfca22172df8-kube-api-access-klcwp\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:35:16.444559 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.444406    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab2e875b-9131-427f-80d7-dfca22172df8-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:35:16.444559 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.444415    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab2e875b-9131-427f-80d7-dfca22172df8-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:35:16.913284 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.913257    4921 generic.go:356] "Generic (PLEG): container finished" podID="ab2e875b-9131-427f-80d7-dfca22172df8" containerID="89eb698002b9f74269ffa7157442f54f008d0b48589dfb46ac9234d5d342eb93" exitCode=0
Oct 30 23:35:16.913451 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.913303    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"
Oct 30 23:35:16.913451 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.913341    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr" event={"ID":"ab2e875b-9131-427f-80d7-dfca22172df8","Type":"ContainerDied","Data":"89eb698002b9f74269ffa7157442f54f008d0b48589dfb46ac9234d5d342eb93"}
Oct 30 23:35:16.913451 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.913401    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr" event={"ID":"ab2e875b-9131-427f-80d7-dfca22172df8","Type":"ContainerDied","Data":"38f5dbf1c7ac4e4c323f4078b8276655aa99ca6ea13e92abe87a42e50fdba6a0"}
Oct 30 23:35:16.913451 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.913428    4921 scope.go:122] "RemoveContainer" containerID="89eb698002b9f74269ffa7157442f54f008d0b48589dfb46ac9234d5d342eb93"
Oct 30 23:35:16.922413 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.922398    4921 scope.go:122] "RemoveContainer" containerID="89eb698002b9f74269ffa7157442f54f008d0b48589dfb46ac9234d5d342eb93"
Oct 30 23:35:16.922715 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:35:16.922698    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89eb698002b9f74269ffa7157442f54f008d0b48589dfb46ac9234d5d342eb93\": container with ID starting with 89eb698002b9f74269ffa7157442f54f008d0b48589dfb46ac9234d5d342eb93 not found: ID does not exist" containerID="89eb698002b9f74269ffa7157442f54f008d0b48589dfb46ac9234d5d342eb93"
Oct 30 23:35:16.922759 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.922727    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89eb698002b9f74269ffa7157442f54f008d0b48589dfb46ac9234d5d342eb93"} err="failed to get container status \"89eb698002b9f74269ffa7157442f54f008d0b48589dfb46ac9234d5d342eb93\": rpc error: code = NotFound desc = could not find container \"89eb698002b9f74269ffa7157442f54f008d0b48589dfb46ac9234d5d342eb93\": container with ID starting with 89eb698002b9f74269ffa7157442f54f008d0b48589dfb46ac9234d5d342eb93 not found: ID does not exist"
Oct 30 23:35:16.930855 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.930837    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"]
Oct 30 23:35:16.936782 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:16.936759    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-wmfjr"]
Oct 30 23:35:17.392007 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:17.391973    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-jxst9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Oct 30 23:35:17.392178 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:17.392029    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9" podUID="a119696e-c906-4165-8ad5-c2564905dd39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Oct 30 23:35:18.391836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:18.391802    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-jxst9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Oct 30 23:35:18.392023 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:18.391857    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9" podUID="a119696e-c906-4165-8ad5-c2564905dd39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Oct 30 23:35:18.895770 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:18.895743    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ab2e875b-9131-427f-80d7-dfca22172df8" path="/var/lib/kubelet/pods/ab2e875b-9131-427f-80d7-dfca22172df8/volumes"
Oct 30 23:35:19.394887 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:19.394857    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:19.395200 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:19.395183    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:19.395934 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:19.395912    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:35:28.863788 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:28.863754    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:35:41.401994 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:35:41.401957    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:35:45.228646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:45.228573    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:35:45.359782 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:45.359747    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:35:51.652866 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:51.652818    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:35:54.097140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.097104    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"]
Oct 30 23:35:54.097514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.097442    4921 cpu_manager.go:414] "containerMap: removing container" podUID="ab2e875b-9131-427f-80d7-dfca22172df8" containerName="maas-api"
Oct 30 23:35:54.097514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.097452    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab2e875b-9131-427f-80d7-dfca22172df8" containerName="maas-api"
Oct 30 23:35:54.097514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.097470    4921 cpu_manager.go:414] "containerMap: removing container" podUID="004a1bbe-431a-44c2-81fa-0213e7e02eb1" containerName="authorino"
Oct 30 23:35:54.097514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.097475    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="004a1bbe-431a-44c2-81fa-0213e7e02eb1" containerName="authorino"
Oct 30 23:35:54.097671 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.097547    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab2e875b-9131-427f-80d7-dfca22172df8" containerName="maas-api"
Oct 30 23:35:54.097671 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.097555    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="004a1bbe-431a-44c2-81fa-0213e7e02eb1" containerName="authorino"
Oct 30 23:35:54.105209 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.105184    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.119693 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.119664    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"]
Oct 30 23:35:54.123838 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.123802    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"]
Oct 30 23:35:54.123968 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.123901    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.132502 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.132327    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"]
Oct 30 23:35:54.159291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.159266    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.159461 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.159294    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.159461 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.159317    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6053163-5f4f-4873-8a80-54343046bf85-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.159461 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.159334    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.159571 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.159461    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.159571 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.159487    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.159571 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.159509    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6053163-5f4f-4873-8a80-54343046bf85-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.159688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.159632    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.159688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.159667    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zj6h\" (UniqueName: \"kubernetes.io/projected/70a3825d-af1d-4af8-99c5-710c36d226f3-kube-api-access-4zj6h\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.159688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.159682    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6053163-5f4f-4873-8a80-54343046bf85-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.159800 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.159702    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqjls\" (UniqueName: \"kubernetes.io/projected/e6053163-5f4f-4873-8a80-54343046bf85-kube-api-access-lqjls\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.159800 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.159752    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6053163-5f4f-4873-8a80-54343046bf85-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.159800 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.159769    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6053163-5f4f-4873-8a80-54343046bf85-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.159916 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.159796    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6053163-5f4f-4873-8a80-54343046bf85-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.159916 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.159838    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6053163-5f4f-4873-8a80-54343046bf85-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.159916 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.159857    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70a3825d-af1d-4af8-99c5-710c36d226f3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.159916 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.159899    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6053163-5f4f-4873-8a80-54343046bf85-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.160040 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.159948    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.261108 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261075    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.261108 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261108    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.261326 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261135    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6053163-5f4f-4873-8a80-54343046bf85-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.261326 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261164    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.261326 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261202    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.261326 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261224    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.261326 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261258    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6053163-5f4f-4873-8a80-54343046bf85-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.261326 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261308    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.261681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261348    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zj6h\" (UniqueName: \"kubernetes.io/projected/70a3825d-af1d-4af8-99c5-710c36d226f3-kube-api-access-4zj6h\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.261681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261374    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6053163-5f4f-4873-8a80-54343046bf85-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.261681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261397    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqjls\" (UniqueName: \"kubernetes.io/projected/e6053163-5f4f-4873-8a80-54343046bf85-kube-api-access-lqjls\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.261681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261432    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6053163-5f4f-4873-8a80-54343046bf85-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.261681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261456    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6053163-5f4f-4873-8a80-54343046bf85-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.261681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261480    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6053163-5f4f-4873-8a80-54343046bf85-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.261681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261514    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6053163-5f4f-4873-8a80-54343046bf85-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.261681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261541    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.261681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261541    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70a3825d-af1d-4af8-99c5-710c36d226f3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.261681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261588    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6053163-5f4f-4873-8a80-54343046bf85-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.261681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261635    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6053163-5f4f-4873-8a80-54343046bf85-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.261681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261635    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6053163-5f4f-4873-8a80-54343046bf85-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.261681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261657    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.262325 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261922    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.262325 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261955    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.262325 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.261976    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6053163-5f4f-4873-8a80-54343046bf85-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.262325 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.262021    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.262325 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.262276    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6053163-5f4f-4873-8a80-54343046bf85-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.262649 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.262409    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70a3825d-af1d-4af8-99c5-710c36d226f3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.262649 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.262529    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6053163-5f4f-4873-8a80-54343046bf85-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.264507 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.264485    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.264620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.264531    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6053163-5f4f-4873-8a80-54343046bf85-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.264620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.264553    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6053163-5f4f-4873-8a80-54343046bf85-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.264765 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.264747    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.274078 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.274037    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6053163-5f4f-4873-8a80-54343046bf85-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.274312 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.274284    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.274390 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.274371    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqjls\" (UniqueName: \"kubernetes.io/projected/e6053163-5f4f-4873-8a80-54343046bf85-kube-api-access-lqjls\") pod \"maas-default-gateway-openshift-default-5df48fcc99-trpdx\" (UID: \"e6053163-5f4f-4873-8a80-54343046bf85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.274753 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.274715    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zj6h\" (UniqueName: \"kubernetes.io/projected/70a3825d-af1d-4af8-99c5-710c36d226f3-kube-api-access-4zj6h\") pod \"maas-default-gateway-openshift-default-5df48fcc99-842fq\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.421665 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.421638    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:54.440334 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.440315    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:54.707983 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.707960    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"]
Oct 30 23:35:54.710200 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:35:54.710174    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a3825d_af1d_4af8_99c5_710c36d226f3.slice/crio-53b5f09005485240f2fab2517defc0692584bce229f7e9fa0bc72f5e1d773c9d WatchSource:0}: Error finding container 53b5f09005485240f2fab2517defc0692584bce229f7e9fa0bc72f5e1d773c9d: Status 404 returned error can't find the container with id 53b5f09005485240f2fab2517defc0692584bce229f7e9fa0bc72f5e1d773c9d
Oct 30 23:35:54.712363 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.712334    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:35:54.712418 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.712399    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:35:54.712453 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.712428    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:35:54.728441 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.728418    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"]
Oct 30 23:35:54.746758 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:35:54.746729    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6053163_5f4f_4873_8a80_54343046bf85.slice/crio-9f192c77202ce6374cd43b80571cc2a590c166fd8e1ae364256ce68c53d6cbe1 WatchSource:0}: Error finding container 9f192c77202ce6374cd43b80571cc2a590c166fd8e1ae364256ce68c53d6cbe1: Status 404 returned error can't find the container with id 9f192c77202ce6374cd43b80571cc2a590c166fd8e1ae364256ce68c53d6cbe1
Oct 30 23:35:54.748847 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.748818    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:35:54.748920 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.748877    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:35:54.748920 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:54.748905    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:35:55.075272 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:55.075162    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx" event={"ID":"e6053163-5f4f-4873-8a80-54343046bf85","Type":"ContainerStarted","Data":"0aaebc48df4e5d8aaecb4ebb489663a47e0c285c1ea17c6d3ba004821a793444"}
Oct 30 23:35:55.075272 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:55.075233    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx" event={"ID":"e6053163-5f4f-4873-8a80-54343046bf85","Type":"ContainerStarted","Data":"9f192c77202ce6374cd43b80571cc2a590c166fd8e1ae364256ce68c53d6cbe1"}
Oct 30 23:35:55.077170 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:55.077138    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq" event={"ID":"70a3825d-af1d-4af8-99c5-710c36d226f3","Type":"ContainerStarted","Data":"d5cc7e5588fc99b608093bc7662e5d4c60e4ac51765c1e8bf1c4896fdfa8160d"}
Oct 30 23:35:55.077321 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:55.077185    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq" event={"ID":"70a3825d-af1d-4af8-99c5-710c36d226f3","Type":"ContainerStarted","Data":"53b5f09005485240f2fab2517defc0692584bce229f7e9fa0bc72f5e1d773c9d"}
Oct 30 23:35:55.103099 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:55.101067    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx" podStartSLOduration=1.101045838 podStartE2EDuration="1.101045838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:55.100148389 +0000 UTC m=+1014.345004178" watchObservedRunningTime="2026-10-30 23:35:55.101045838 +0000 UTC m=+1014.345901605"
Oct 30 23:35:55.134674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:55.133194    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq" podStartSLOduration=1.133174783 podStartE2EDuration="1.133174783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:55.132933473 +0000 UTC m=+1014.377789242" watchObservedRunningTime="2026-10-30 23:35:55.133174783 +0000 UTC m=+1014.378030552"
Oct 30 23:35:55.422360 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:55.422329    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:35:55.424118 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:55.424091    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-842fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Oct 30 23:35:55.424289 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:55.424271    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq" podUID="70a3825d-af1d-4af8-99c5-710c36d226f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Oct 30 23:35:55.440605 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:55.440569    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:35:55.441755 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:55.441732    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-trpdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Oct 30 23:35:55.441860 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:55.441775    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx" podUID="e6053163-5f4f-4873-8a80-54343046bf85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Oct 30 23:35:56.422523 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:56.422483    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-842fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Oct 30 23:35:56.422970 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:56.422538    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq" podUID="70a3825d-af1d-4af8-99c5-710c36d226f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Oct 30 23:35:56.440667 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:56.440642    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-trpdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Oct 30 23:35:56.440782 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:56.440683    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx" podUID="e6053163-5f4f-4873-8a80-54343046bf85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Oct 30 23:35:57.422737 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:57.422702    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-842fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Oct 30 23:35:57.423244 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:57.422770    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq" podUID="70a3825d-af1d-4af8-99c5-710c36d226f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Oct 30 23:35:57.441024 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:57.440999    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-trpdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Oct 30 23:35:57.441223 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:57.441205    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx" podUID="e6053163-5f4f-4873-8a80-54343046bf85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Oct 30 23:35:58.422244 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:58.422209    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-842fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Oct 30 23:35:58.422435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:58.422277    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq" podUID="70a3825d-af1d-4af8-99c5-710c36d226f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Oct 30 23:35:58.441647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:58.441620    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-trpdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Oct 30 23:35:58.442109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:58.442075    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx" podUID="e6053163-5f4f-4873-8a80-54343046bf85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Oct 30 23:35:59.422095 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:59.422048    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-842fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Oct 30 23:35:59.422318 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:59.422103    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq" podUID="70a3825d-af1d-4af8-99c5-710c36d226f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Oct 30 23:35:59.440863 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:59.440839    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-trpdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Oct 30 23:35:59.440992 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:35:59.440878    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx" podUID="e6053163-5f4f-4873-8a80-54343046bf85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Oct 30 23:36:00.423071 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:00.423036    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-842fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Oct 30 23:36:00.423471 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:00.423086    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq" podUID="70a3825d-af1d-4af8-99c5-710c36d226f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Oct 30 23:36:00.441130 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:00.441099    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-trpdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Oct 30 23:36:00.441291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:00.441145    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx" podUID="e6053163-5f4f-4873-8a80-54343046bf85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Oct 30 23:36:01.417042 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:01.417006    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:36:01.427222 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:01.427191    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:36:01.427611 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:01.427482    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:36:01.428087 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:01.428067    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:36:01.444697 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:01.444677    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:36:01.444951 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:01.444938    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:36:01.445571 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:01.445555    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-trpdx"
Oct 30 23:36:02.097523 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:02.097489    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:36:03.173820 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:03.173792    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:36:04.892358 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:04.892331    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-259tq"]
Oct 30 23:36:04.897678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:04.897657    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:04.906499 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:04.906231    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"echo-simulator-kserve-self-signed-certs\""
Oct 30 23:36:04.906499 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:04.906351    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-v5mxr\""
Oct 30 23:36:04.906499 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:04.906393    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-259tq"]
Oct 30 23:36:04.960873 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:04.960834    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:36:04.981021 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:04.981003    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 30 23:36:04.981021 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:04.981002    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 30 23:36:05.030425 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.030393    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21b8ce4a-9063-4336-a2c2-78d5554d40aa-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-259tq\" (UID: \"21b8ce4a-9063-4336-a2c2-78d5554d40aa\") " pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:05.030861 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.030839    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21b8ce4a-9063-4336-a2c2-78d5554d40aa-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-259tq\" (UID: \"21b8ce4a-9063-4336-a2c2-78d5554d40aa\") " pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:05.031109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.031082    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9jsf\" (UniqueName: \"kubernetes.io/projected/21b8ce4a-9063-4336-a2c2-78d5554d40aa-kube-api-access-m9jsf\") pod \"echo-simulator-kserve-64b6f8f96c-259tq\" (UID: \"21b8ce4a-9063-4336-a2c2-78d5554d40aa\") " pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:05.031408 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.031371    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21b8ce4a-9063-4336-a2c2-78d5554d40aa-home\") pod \"echo-simulator-kserve-64b6f8f96c-259tq\" (UID: \"21b8ce4a-9063-4336-a2c2-78d5554d40aa\") " pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:05.031639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.031620    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21b8ce4a-9063-4336-a2c2-78d5554d40aa-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-259tq\" (UID: \"21b8ce4a-9063-4336-a2c2-78d5554d40aa\") " pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:05.031860 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.031825    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21b8ce4a-9063-4336-a2c2-78d5554d40aa-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-259tq\" (UID: \"21b8ce4a-9063-4336-a2c2-78d5554d40aa\") " pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:05.132944 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.132910    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21b8ce4a-9063-4336-a2c2-78d5554d40aa-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-259tq\" (UID: \"21b8ce4a-9063-4336-a2c2-78d5554d40aa\") " pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:05.133145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.132960    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21b8ce4a-9063-4336-a2c2-78d5554d40aa-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-259tq\" (UID: \"21b8ce4a-9063-4336-a2c2-78d5554d40aa\") " pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:05.133145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.132986    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9jsf\" (UniqueName: \"kubernetes.io/projected/21b8ce4a-9063-4336-a2c2-78d5554d40aa-kube-api-access-m9jsf\") pod \"echo-simulator-kserve-64b6f8f96c-259tq\" (UID: \"21b8ce4a-9063-4336-a2c2-78d5554d40aa\") " pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:05.133145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.133036    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21b8ce4a-9063-4336-a2c2-78d5554d40aa-home\") pod \"echo-simulator-kserve-64b6f8f96c-259tq\" (UID: \"21b8ce4a-9063-4336-a2c2-78d5554d40aa\") " pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:05.133145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.133061    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21b8ce4a-9063-4336-a2c2-78d5554d40aa-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-259tq\" (UID: \"21b8ce4a-9063-4336-a2c2-78d5554d40aa\") " pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:05.133145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.133105    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21b8ce4a-9063-4336-a2c2-78d5554d40aa-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-259tq\" (UID: \"21b8ce4a-9063-4336-a2c2-78d5554d40aa\") " pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:05.133526 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.133499    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21b8ce4a-9063-4336-a2c2-78d5554d40aa-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-259tq\" (UID: \"21b8ce4a-9063-4336-a2c2-78d5554d40aa\") " pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:05.133626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.133556    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21b8ce4a-9063-4336-a2c2-78d5554d40aa-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-259tq\" (UID: \"21b8ce4a-9063-4336-a2c2-78d5554d40aa\") " pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:05.133689 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.133636    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21b8ce4a-9063-4336-a2c2-78d5554d40aa-home\") pod \"echo-simulator-kserve-64b6f8f96c-259tq\" (UID: \"21b8ce4a-9063-4336-a2c2-78d5554d40aa\") " pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:05.135370 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.135351    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21b8ce4a-9063-4336-a2c2-78d5554d40aa-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-259tq\" (UID: \"21b8ce4a-9063-4336-a2c2-78d5554d40aa\") " pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:05.135889 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.135870    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21b8ce4a-9063-4336-a2c2-78d5554d40aa-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-259tq\" (UID: \"21b8ce4a-9063-4336-a2c2-78d5554d40aa\") " pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:05.145489 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.145437    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9jsf\" (UniqueName: \"kubernetes.io/projected/21b8ce4a-9063-4336-a2c2-78d5554d40aa-kube-api-access-m9jsf\") pod \"echo-simulator-kserve-64b6f8f96c-259tq\" (UID: \"21b8ce4a-9063-4336-a2c2-78d5554d40aa\") " pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:05.212714 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.212678    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:05.411366 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.411290    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"]
Oct 30 23:36:05.415888 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.415868    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:05.420338 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.420320    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Oct 30 23:36:05.431647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.431620    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"]
Oct 30 23:36:05.508936 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.508912    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-259tq"]
Oct 30 23:36:05.511472 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:36:05.511435    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21b8ce4a_9063_4336_a2c2_78d5554d40aa.slice/crio-115837f962add5e1d38fe96134bb54189b723a18a579bd97b436d2607dd55030 WatchSource:0}: Error finding container 115837f962add5e1d38fe96134bb54189b723a18a579bd97b436d2607dd55030: Status 404 returned error can't find the container with id 115837f962add5e1d38fe96134bb54189b723a18a579bd97b436d2607dd55030
Oct 30 23:36:05.537012 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.536980    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mqq5\" (UniqueName: \"kubernetes.io/projected/38c70403-050b-4302-bba3-37fdec709026-kube-api-access-7mqq5\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7\" (UID: \"38c70403-050b-4302-bba3-37fdec709026\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:05.537119 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.537018    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38c70403-050b-4302-bba3-37fdec709026-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7\" (UID: \"38c70403-050b-4302-bba3-37fdec709026\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:05.537119 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.537057    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38c70403-050b-4302-bba3-37fdec709026-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7\" (UID: \"38c70403-050b-4302-bba3-37fdec709026\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:05.537237 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.537178    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38c70403-050b-4302-bba3-37fdec709026-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7\" (UID: \"38c70403-050b-4302-bba3-37fdec709026\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:05.537290 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.537240    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38c70403-050b-4302-bba3-37fdec709026-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7\" (UID: \"38c70403-050b-4302-bba3-37fdec709026\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:05.537290 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.537265    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38c70403-050b-4302-bba3-37fdec709026-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7\" (UID: \"38c70403-050b-4302-bba3-37fdec709026\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:05.565655 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.565585    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:36:05.638377 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.638350    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mqq5\" (UniqueName: \"kubernetes.io/projected/38c70403-050b-4302-bba3-37fdec709026-kube-api-access-7mqq5\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7\" (UID: \"38c70403-050b-4302-bba3-37fdec709026\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:05.638541 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.638386    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38c70403-050b-4302-bba3-37fdec709026-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7\" (UID: \"38c70403-050b-4302-bba3-37fdec709026\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:05.638541 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.638420    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38c70403-050b-4302-bba3-37fdec709026-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7\" (UID: \"38c70403-050b-4302-bba3-37fdec709026\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:05.638541 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.638448    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38c70403-050b-4302-bba3-37fdec709026-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7\" (UID: \"38c70403-050b-4302-bba3-37fdec709026\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:05.638541 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.638481    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38c70403-050b-4302-bba3-37fdec709026-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7\" (UID: \"38c70403-050b-4302-bba3-37fdec709026\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:05.638541 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.638500    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38c70403-050b-4302-bba3-37fdec709026-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7\" (UID: \"38c70403-050b-4302-bba3-37fdec709026\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:05.638952 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.638930    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38c70403-050b-4302-bba3-37fdec709026-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7\" (UID: \"38c70403-050b-4302-bba3-37fdec709026\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:05.639006 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.638962    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38c70403-050b-4302-bba3-37fdec709026-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7\" (UID: \"38c70403-050b-4302-bba3-37fdec709026\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:05.639101 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.639080    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38c70403-050b-4302-bba3-37fdec709026-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7\" (UID: \"38c70403-050b-4302-bba3-37fdec709026\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:05.640788 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.640772    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38c70403-050b-4302-bba3-37fdec709026-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7\" (UID: \"38c70403-050b-4302-bba3-37fdec709026\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:05.641216 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.641201    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38c70403-050b-4302-bba3-37fdec709026-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7\" (UID: \"38c70403-050b-4302-bba3-37fdec709026\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:05.650672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.650651    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mqq5\" (UniqueName: \"kubernetes.io/projected/38c70403-050b-4302-bba3-37fdec709026-kube-api-access-7mqq5\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7\" (UID: \"38c70403-050b-4302-bba3-37fdec709026\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:05.730557 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:05.730491    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:06.005417 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:06.005395    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"]
Oct 30 23:36:06.007314 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:36:06.007287    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38c70403_050b_4302_bba3_37fdec709026.slice/crio-e756f383781c0c6501897474e5bd2626ccdaed2d1d4805071e2ff6558398e9d0 WatchSource:0}: Error finding container e756f383781c0c6501897474e5bd2626ccdaed2d1d4805071e2ff6558398e9d0: Status 404 returned error can't find the container with id e756f383781c0c6501897474e5bd2626ccdaed2d1d4805071e2ff6558398e9d0
Oct 30 23:36:06.182328 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:06.182287    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7" event={"ID":"38c70403-050b-4302-bba3-37fdec709026","Type":"ContainerStarted","Data":"e756f383781c0c6501897474e5bd2626ccdaed2d1d4805071e2ff6558398e9d0"}
Oct 30 23:36:06.183625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:06.183575    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-259tq" event={"ID":"21b8ce4a-9063-4336-a2c2-78d5554d40aa","Type":"ContainerStarted","Data":"115837f962add5e1d38fe96134bb54189b723a18a579bd97b436d2607dd55030"}
Oct 30 23:36:06.614629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:06.597908    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:36:07.849618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:07.843660    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:36:07.875668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:07.866787    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"]
Oct 30 23:36:07.875668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:07.874229    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"]
Oct 30 23:36:07.875668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:07.874348    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:07.911931 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:07.911178    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Oct 30 23:36:08.043680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.042463    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/257ac775-bcbb-4e52-a0a5-d9325172f2e4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js\" (UID: \"257ac775-bcbb-4e52-a0a5-d9325172f2e4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:08.043680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.042681    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/257ac775-bcbb-4e52-a0a5-d9325172f2e4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js\" (UID: \"257ac775-bcbb-4e52-a0a5-d9325172f2e4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:08.043680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.042759    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/257ac775-bcbb-4e52-a0a5-d9325172f2e4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js\" (UID: \"257ac775-bcbb-4e52-a0a5-d9325172f2e4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:08.043680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.043200    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/257ac775-bcbb-4e52-a0a5-d9325172f2e4-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js\" (UID: \"257ac775-bcbb-4e52-a0a5-d9325172f2e4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:08.043680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.043262    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/257ac775-bcbb-4e52-a0a5-d9325172f2e4-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js\" (UID: \"257ac775-bcbb-4e52-a0a5-d9325172f2e4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:08.043680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.043375    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcxhv\" (UniqueName: \"kubernetes.io/projected/257ac775-bcbb-4e52-a0a5-d9325172f2e4-kube-api-access-mcxhv\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js\" (UID: \"257ac775-bcbb-4e52-a0a5-d9325172f2e4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:08.145207 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.144714    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/257ac775-bcbb-4e52-a0a5-d9325172f2e4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js\" (UID: \"257ac775-bcbb-4e52-a0a5-d9325172f2e4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:08.145207 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.144931    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/257ac775-bcbb-4e52-a0a5-d9325172f2e4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js\" (UID: \"257ac775-bcbb-4e52-a0a5-d9325172f2e4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:08.145207 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.144967    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/257ac775-bcbb-4e52-a0a5-d9325172f2e4-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js\" (UID: \"257ac775-bcbb-4e52-a0a5-d9325172f2e4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:08.145207 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.145001    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/257ac775-bcbb-4e52-a0a5-d9325172f2e4-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js\" (UID: \"257ac775-bcbb-4e52-a0a5-d9325172f2e4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:08.145207 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.145031    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcxhv\" (UniqueName: \"kubernetes.io/projected/257ac775-bcbb-4e52-a0a5-d9325172f2e4-kube-api-access-mcxhv\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js\" (UID: \"257ac775-bcbb-4e52-a0a5-d9325172f2e4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:08.145207 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.145066    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/257ac775-bcbb-4e52-a0a5-d9325172f2e4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js\" (UID: \"257ac775-bcbb-4e52-a0a5-d9325172f2e4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:08.145207 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.145166    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/257ac775-bcbb-4e52-a0a5-d9325172f2e4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js\" (UID: \"257ac775-bcbb-4e52-a0a5-d9325172f2e4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:08.145661 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.145399    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/257ac775-bcbb-4e52-a0a5-d9325172f2e4-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js\" (UID: \"257ac775-bcbb-4e52-a0a5-d9325172f2e4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:08.145661 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.145424    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/257ac775-bcbb-4e52-a0a5-d9325172f2e4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js\" (UID: \"257ac775-bcbb-4e52-a0a5-d9325172f2e4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:08.148371 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.148343    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/257ac775-bcbb-4e52-a0a5-d9325172f2e4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js\" (UID: \"257ac775-bcbb-4e52-a0a5-d9325172f2e4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:08.149160 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.149133    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/257ac775-bcbb-4e52-a0a5-d9325172f2e4-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js\" (UID: \"257ac775-bcbb-4e52-a0a5-d9325172f2e4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:08.160853 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.160803    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcxhv\" (UniqueName: \"kubernetes.io/projected/257ac775-bcbb-4e52-a0a5-d9325172f2e4-kube-api-access-mcxhv\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js\" (UID: \"257ac775-bcbb-4e52-a0a5-d9325172f2e4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:08.272257 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.272222    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:08.587248 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:08.587155    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"]
Oct 30 23:36:08.598622 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:36:08.591980    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod257ac775_bcbb_4e52_a0a5_d9325172f2e4.slice/crio-2f561a3825c0d2af57ca409dc11cdf34507403dd53e25fdf96731727628d6de5 WatchSource:0}: Error finding container 2f561a3825c0d2af57ca409dc11cdf34507403dd53e25fdf96731727628d6de5: Status 404 returned error can't find the container with id 2f561a3825c0d2af57ca409dc11cdf34507403dd53e25fdf96731727628d6de5
Oct 30 23:36:09.267640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:09.267512    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7" event={"ID":"38c70403-050b-4302-bba3-37fdec709026","Type":"ContainerStarted","Data":"b5236f4dea6be0421f386fbaa0fce1c7d050fed3b3057b7b1c7ed3d3fe628a8f"}
Oct 30 23:36:09.281014 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:09.280407    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-259tq" event={"ID":"21b8ce4a-9063-4336-a2c2-78d5554d40aa","Type":"ContainerStarted","Data":"e10d6eadb1de4b2584bb1ca42b87c3054e11d862d3b455232bf11738108fda13"}
Oct 30 23:36:09.283983 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:09.283955    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js" event={"ID":"257ac775-bcbb-4e52-a0a5-d9325172f2e4","Type":"ContainerStarted","Data":"2f561a3825c0d2af57ca409dc11cdf34507403dd53e25fdf96731727628d6de5"}
Oct 30 23:36:09.298278 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:09.298210    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7" podStartSLOduration=1.317519202 podStartE2EDuration="4.298191648s" totalImagesPullingTime="2.980672446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:36:09.296458395 +0000 UTC m=+1028.541314163" watchObservedRunningTime="2026-10-30 23:36:09.298191648 +0000 UTC m=+1028.543047417"
Oct 30 23:36:09.336869 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:09.336801    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/echo-simulator-kserve-64b6f8f96c-259tq" podStartSLOduration=1.911541788 podStartE2EDuration="5.336780631s" totalImagesPullingTime="3.425238843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:36:09.33497635 +0000 UTC m=+1028.579832122" watchObservedRunningTime="2026-10-30 23:36:09.336780631 +0000 UTC m=+1028.581636407"
Oct 30 23:36:09.731043 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:09.731000    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:10.215776 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:10.215681    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:10.318180 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:10.317664    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js" event={"ID":"257ac775-bcbb-4e52-a0a5-d9325172f2e4","Type":"ContainerStarted","Data":"072eec482298a17ba93bf7626ef100bd821cc78627a1433221d25575c7de12f4"}
Oct 30 23:36:11.273402 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:11.273369    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:11.411878 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:36:11.411842    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:36:11.482103 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:11.482001    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:36:12.842025 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:12.841974    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js" podStartSLOduration=4.588023013 podStartE2EDuration="5.841950878s" totalImagesPullingTime="1.253927865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:36:10.343845106 +0000 UTC m=+1029.588700875" watchObservedRunningTime="2026-10-30 23:36:12.841950878 +0000 UTC m=+1032.086806664"
Oct 30 23:36:12.843719 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:12.843672    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"]
Oct 30 23:36:12.847371 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:12.847350    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:12.853907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:12.853885    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Oct 30 23:36:12.859354 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:12.859329    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"]
Oct 30 23:36:12.929529 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:12.929493    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:36:12.938774 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:12.938693    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09131a8c-6b33-4793-b624-24489d63e66a-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fgrs2\" (UID: \"09131a8c-6b33-4793-b624-24489d63e66a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:12.938774 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:12.938733    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09131a8c-6b33-4793-b624-24489d63e66a-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fgrs2\" (UID: \"09131a8c-6b33-4793-b624-24489d63e66a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:12.938774 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:12.938768    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r29qj\" (UniqueName: \"kubernetes.io/projected/09131a8c-6b33-4793-b624-24489d63e66a-kube-api-access-r29qj\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fgrs2\" (UID: \"09131a8c-6b33-4793-b624-24489d63e66a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:12.939056 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:12.938883    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09131a8c-6b33-4793-b624-24489d63e66a-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fgrs2\" (UID: \"09131a8c-6b33-4793-b624-24489d63e66a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:12.939056 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:12.938940    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09131a8c-6b33-4793-b624-24489d63e66a-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fgrs2\" (UID: \"09131a8c-6b33-4793-b624-24489d63e66a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:12.939056 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:12.938955    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09131a8c-6b33-4793-b624-24489d63e66a-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fgrs2\" (UID: \"09131a8c-6b33-4793-b624-24489d63e66a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:13.039822 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:13.039786    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09131a8c-6b33-4793-b624-24489d63e66a-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fgrs2\" (UID: \"09131a8c-6b33-4793-b624-24489d63e66a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:13.039985 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:13.039875    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09131a8c-6b33-4793-b624-24489d63e66a-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fgrs2\" (UID: \"09131a8c-6b33-4793-b624-24489d63e66a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:13.039985 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:13.039901    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09131a8c-6b33-4793-b624-24489d63e66a-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fgrs2\" (UID: \"09131a8c-6b33-4793-b624-24489d63e66a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:13.039985 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:13.039946    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09131a8c-6b33-4793-b624-24489d63e66a-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fgrs2\" (UID: \"09131a8c-6b33-4793-b624-24489d63e66a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:13.040173 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:13.039986    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09131a8c-6b33-4793-b624-24489d63e66a-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fgrs2\" (UID: \"09131a8c-6b33-4793-b624-24489d63e66a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:13.040173 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:13.040021    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r29qj\" (UniqueName: \"kubernetes.io/projected/09131a8c-6b33-4793-b624-24489d63e66a-kube-api-access-r29qj\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fgrs2\" (UID: \"09131a8c-6b33-4793-b624-24489d63e66a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:13.040342 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:13.040315    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09131a8c-6b33-4793-b624-24489d63e66a-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fgrs2\" (UID: \"09131a8c-6b33-4793-b624-24489d63e66a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:13.040397 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:13.040324    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09131a8c-6b33-4793-b624-24489d63e66a-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fgrs2\" (UID: \"09131a8c-6b33-4793-b624-24489d63e66a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:13.040777 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:13.040749    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09131a8c-6b33-4793-b624-24489d63e66a-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fgrs2\" (UID: \"09131a8c-6b33-4793-b624-24489d63e66a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:13.042702 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:13.042678    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09131a8c-6b33-4793-b624-24489d63e66a-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fgrs2\" (UID: \"09131a8c-6b33-4793-b624-24489d63e66a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:13.042813 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:13.042794    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09131a8c-6b33-4793-b624-24489d63e66a-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fgrs2\" (UID: \"09131a8c-6b33-4793-b624-24489d63e66a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:13.056816 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:13.056797    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r29qj\" (UniqueName: \"kubernetes.io/projected/09131a8c-6b33-4793-b624-24489d63e66a-kube-api-access-r29qj\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fgrs2\" (UID: \"09131a8c-6b33-4793-b624-24489d63e66a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:13.166709 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:13.166671    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:13.455461 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:13.455428    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"]
Oct 30 23:36:13.458477 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:36:13.458423    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09131a8c_6b33_4793_b624_24489d63e66a.slice/crio-e1a4349f023705d067a1bf074cb3618407541fecc871382ec4bb4f681c867627 WatchSource:0}: Error finding container e1a4349f023705d067a1bf074cb3618407541fecc871382ec4bb4f681c867627: Status 404 returned error can't find the container with id e1a4349f023705d067a1bf074cb3618407541fecc871382ec4bb4f681c867627
Oct 30 23:36:14.356923 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:14.356890    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2" event={"ID":"09131a8c-6b33-4793-b624-24489d63e66a","Type":"ContainerStarted","Data":"3af479a58b580e5b32586e7076960871e3acd6669cee11ed1545d74fb8992d2e"}
Oct 30 23:36:14.357429 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:14.356945    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2" event={"ID":"09131a8c-6b33-4793-b624-24489d63e66a","Type":"ContainerStarted","Data":"e1a4349f023705d067a1bf074cb3618407541fecc871382ec4bb4f681c867627"}
Oct 30 23:36:14.386618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:14.384990    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2" podStartSLOduration=2.103313928 podStartE2EDuration="2.384971961s" totalImagesPullingTime="281.658033ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:36:14.379024027 +0000 UTC m=+1033.623879806" watchObservedRunningTime="2026-10-30 23:36:14.384971961 +0000 UTC m=+1033.629827732"
Oct 30 23:36:15.173620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:15.170689    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:15.217762 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:15.216980    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:15.244099 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:15.244070    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:15.391621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:15.390900    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/echo-simulator-kserve-64b6f8f96c-259tq"
Oct 30 23:36:15.730875 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:15.730843    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:15.743756 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:15.743734    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:16.382089 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:16.382063    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7"
Oct 30 23:36:18.285628 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:18.284671    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:18.334617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:18.331975    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:18.436927 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:18.436893    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js"
Oct 30 23:36:23.167209 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:23.167161    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:23.180019 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:23.179993    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:23.465203 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:23.465122    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2"
Oct 30 23:36:26.198954 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.198910    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d8565944c-plzh9"]
Oct 30 23:36:26.199462 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.199127    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-5d8565944c-plzh9" podUID="251b8a3f-c7a6-4dfd-9311-903f4eaeedec" containerName="authorino" containerID="cri-o://b342906c7e1539d14fa5e717b54a7fa27f702f55d1e372662f0f829da016bf46" gracePeriod=30
Oct 30 23:36:26.463486 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.463429    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d8565944c-plzh9"
Oct 30 23:36:26.469085 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.469060    4921 generic.go:356] "Generic (PLEG): container finished" podID="251b8a3f-c7a6-4dfd-9311-903f4eaeedec" containerID="b342906c7e1539d14fa5e717b54a7fa27f702f55d1e372662f0f829da016bf46" exitCode=0
Oct 30 23:36:26.469199 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.469099    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d8565944c-plzh9"
Oct 30 23:36:26.469199 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.469119    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d8565944c-plzh9" event={"ID":"251b8a3f-c7a6-4dfd-9311-903f4eaeedec","Type":"ContainerDied","Data":"b342906c7e1539d14fa5e717b54a7fa27f702f55d1e372662f0f829da016bf46"}
Oct 30 23:36:26.469199 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.469158    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d8565944c-plzh9" event={"ID":"251b8a3f-c7a6-4dfd-9311-903f4eaeedec","Type":"ContainerDied","Data":"290112abe479ae856e758f9a0b161a4ca182991e4ed498507f9d25a26e36ac3b"}
Oct 30 23:36:26.469199 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.469175    4921 scope.go:122] "RemoveContainer" containerID="b342906c7e1539d14fa5e717b54a7fa27f702f55d1e372662f0f829da016bf46"
Oct 30 23:36:26.477412 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.477398    4921 scope.go:122] "RemoveContainer" containerID="b342906c7e1539d14fa5e717b54a7fa27f702f55d1e372662f0f829da016bf46"
Oct 30 23:36:26.477697 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:36:26.477679    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b342906c7e1539d14fa5e717b54a7fa27f702f55d1e372662f0f829da016bf46\": container with ID starting with b342906c7e1539d14fa5e717b54a7fa27f702f55d1e372662f0f829da016bf46 not found: ID does not exist" containerID="b342906c7e1539d14fa5e717b54a7fa27f702f55d1e372662f0f829da016bf46"
Oct 30 23:36:26.477749 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.477705    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b342906c7e1539d14fa5e717b54a7fa27f702f55d1e372662f0f829da016bf46"} err="failed to get container status \"b342906c7e1539d14fa5e717b54a7fa27f702f55d1e372662f0f829da016bf46\": rpc error: code = NotFound desc = could not find container \"b342906c7e1539d14fa5e717b54a7fa27f702f55d1e372662f0f829da016bf46\": container with ID starting with b342906c7e1539d14fa5e717b54a7fa27f702f55d1e372662f0f829da016bf46 not found: ID does not exist"
Oct 30 23:36:26.622842 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.622813    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/251b8a3f-c7a6-4dfd-9311-903f4eaeedec-tls-cert\" (UniqueName: \"kubernetes.io/secret/251b8a3f-c7a6-4dfd-9311-903f4eaeedec-tls-cert\") pod \"251b8a3f-c7a6-4dfd-9311-903f4eaeedec\" (UID: \"251b8a3f-c7a6-4dfd-9311-903f4eaeedec\") "
Oct 30 23:36:26.623026 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.622933    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/251b8a3f-c7a6-4dfd-9311-903f4eaeedec-kube-api-access-hwswl\" (UniqueName: \"kubernetes.io/projected/251b8a3f-c7a6-4dfd-9311-903f4eaeedec-kube-api-access-hwswl\") pod \"251b8a3f-c7a6-4dfd-9311-903f4eaeedec\" (UID: \"251b8a3f-c7a6-4dfd-9311-903f4eaeedec\") "
Oct 30 23:36:26.625043 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.625009    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/251b8a3f-c7a6-4dfd-9311-903f4eaeedec-kube-api-access-hwswl" pod "251b8a3f-c7a6-4dfd-9311-903f4eaeedec" (UID: "251b8a3f-c7a6-4dfd-9311-903f4eaeedec"). InnerVolumeSpecName "kube-api-access-hwswl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:36:26.633770 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.633745    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/251b8a3f-c7a6-4dfd-9311-903f4eaeedec-tls-cert" pod "251b8a3f-c7a6-4dfd-9311-903f4eaeedec" (UID: "251b8a3f-c7a6-4dfd-9311-903f4eaeedec"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:36:26.723588 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.723514    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwswl\" (UniqueName: \"kubernetes.io/projected/251b8a3f-c7a6-4dfd-9311-903f4eaeedec-kube-api-access-hwswl\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:36:26.723588 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.723540    4921 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/251b8a3f-c7a6-4dfd-9311-903f4eaeedec-tls-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:36:26.764728 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.764698    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-655fc879db-5vqfn"]
Oct 30 23:36:26.765103 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.765089    4921 cpu_manager.go:414] "containerMap: removing container" podUID="251b8a3f-c7a6-4dfd-9311-903f4eaeedec" containerName="authorino"
Oct 30 23:36:26.765149 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.765105    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="251b8a3f-c7a6-4dfd-9311-903f4eaeedec" containerName="authorino"
Oct 30 23:36:26.765201 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.765192    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="251b8a3f-c7a6-4dfd-9311-903f4eaeedec" containerName="authorino"
Oct 30 23:36:26.771250 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.771217    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-655fc879db-5vqfn"
Oct 30 23:36:26.788483 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.788452    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-655fc879db-5vqfn"]
Oct 30 23:36:26.805869 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.792429    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Oct 30 23:36:26.805869 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.793378    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-crp9q\""
Oct 30 23:36:26.805869 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.793427    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\""
Oct 30 23:36:26.805869 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.805056    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:36:26.829164 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.829139    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d8565944c-plzh9"]
Oct 30 23:36:26.838114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.838091    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d8565944c-plzh9"]
Oct 30 23:36:26.882082 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.882053    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="251b8a3f-c7a6-4dfd-9311-903f4eaeedec" path="/var/lib/kubelet/pods/251b8a3f-c7a6-4dfd-9311-903f4eaeedec/volumes"
Oct 30 23:36:26.924387 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.924357    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvs2w\" (UniqueName: \"kubernetes.io/projected/9c1dea42-9d2e-4fb2-91d3-99d06fb55744-kube-api-access-pvs2w\") pod \"ai-gateway-controller-655fc879db-5vqfn\" (UID: \"9c1dea42-9d2e-4fb2-91d3-99d06fb55744\") " pod="opendatahub/ai-gateway-controller-655fc879db-5vqfn"
Oct 30 23:36:26.924511 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.924394    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c1dea42-9d2e-4fb2-91d3-99d06fb55744-metrics-certs\") pod \"ai-gateway-controller-655fc879db-5vqfn\" (UID: \"9c1dea42-9d2e-4fb2-91d3-99d06fb55744\") " pod="opendatahub/ai-gateway-controller-655fc879db-5vqfn"
Oct 30 23:36:26.959450 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:26.959425    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:36:27.025423 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:27.025366    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvs2w\" (UniqueName: \"kubernetes.io/projected/9c1dea42-9d2e-4fb2-91d3-99d06fb55744-kube-api-access-pvs2w\") pod \"ai-gateway-controller-655fc879db-5vqfn\" (UID: \"9c1dea42-9d2e-4fb2-91d3-99d06fb55744\") " pod="opendatahub/ai-gateway-controller-655fc879db-5vqfn"
Oct 30 23:36:27.025423 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:27.025399    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c1dea42-9d2e-4fb2-91d3-99d06fb55744-metrics-certs\") pod \"ai-gateway-controller-655fc879db-5vqfn\" (UID: \"9c1dea42-9d2e-4fb2-91d3-99d06fb55744\") " pod="opendatahub/ai-gateway-controller-655fc879db-5vqfn"
Oct 30 23:36:27.027900 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:27.027882    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c1dea42-9d2e-4fb2-91d3-99d06fb55744-metrics-certs\") pod \"ai-gateway-controller-655fc879db-5vqfn\" (UID: \"9c1dea42-9d2e-4fb2-91d3-99d06fb55744\") " pod="opendatahub/ai-gateway-controller-655fc879db-5vqfn"
Oct 30 23:36:27.038629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:27.038582    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvs2w\" (UniqueName: \"kubernetes.io/projected/9c1dea42-9d2e-4fb2-91d3-99d06fb55744-kube-api-access-pvs2w\") pod \"ai-gateway-controller-655fc879db-5vqfn\" (UID: \"9c1dea42-9d2e-4fb2-91d3-99d06fb55744\") " pod="opendatahub/ai-gateway-controller-655fc879db-5vqfn"
Oct 30 23:36:27.115168 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:27.115143    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-655fc879db-5vqfn"
Oct 30 23:36:27.388702 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:27.388668    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-655fc879db-5vqfn"]
Oct 30 23:36:27.391257 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:36:27.391232    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c1dea42_9d2e_4fb2_91d3_99d06fb55744.slice/crio-27bd1d8bb15b10784ef09518d7511a340d78e0354c8ab888a478b8b7cb6163b8 WatchSource:0}: Error finding container 27bd1d8bb15b10784ef09518d7511a340d78e0354c8ab888a478b8b7cb6163b8: Status 404 returned error can't find the container with id 27bd1d8bb15b10784ef09518d7511a340d78e0354c8ab888a478b8b7cb6163b8
Oct 30 23:36:27.475723 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:27.475689    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-655fc879db-5vqfn" event={"ID":"9c1dea42-9d2e-4fb2-91d3-99d06fb55744","Type":"ContainerStarted","Data":"27bd1d8bb15b10784ef09518d7511a340d78e0354c8ab888a478b8b7cb6163b8"}
Oct 30 23:36:32.502950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:32.502912    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-655fc879db-5vqfn" event={"ID":"9c1dea42-9d2e-4fb2-91d3-99d06fb55744","Type":"ContainerStarted","Data":"ab75f2ec1fbfe28a9d5f60425fc2aad6b63a4c7da1b7a0eec2c9124e074e4cb0"}
Oct 30 23:36:32.503399 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:32.503045    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-655fc879db-5vqfn"
Oct 30 23:36:32.522264 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:32.522218    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-655fc879db-5vqfn" podStartSLOduration=2.477948562 podStartE2EDuration="6.52220598s" totalImagesPullingTime="4.044257418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:36:32.521222138 +0000 UTC m=+1051.766077905" watchObservedRunningTime="2026-10-30 23:36:32.52220598 +0000 UTC m=+1051.767061758"
Oct 30 23:36:33.236016 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.235979    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-55fbbbf9dc-p2vlz"]
Oct 30 23:36:33.239760 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.239726    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-55fbbbf9dc-p2vlz"
Oct 30 23:36:33.242343 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.242314    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:36:33.248249 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.248223    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Oct 30 23:36:33.250356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.250331    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-55fbbbf9dc-p2vlz"]
Oct 30 23:36:33.273832 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.273799    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-kw26z"]
Oct 30 23:36:33.278112 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.278090    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-kw26z"
Oct 30 23:36:33.281431 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.281402    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttb9j\" (UniqueName: \"kubernetes.io/projected/44393c6e-944b-47ab-b016-f6900a69d271-kube-api-access-ttb9j\") pod \"payload-processing-55fbbbf9dc-p2vlz\" (UID: \"44393c6e-944b-47ab-b016-f6900a69d271\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-p2vlz"
Oct 30 23:36:33.281676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.281650    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44393c6e-944b-47ab-b016-f6900a69d271-plugins-config-volume\") pod \"payload-processing-55fbbbf9dc-p2vlz\" (UID: \"44393c6e-944b-47ab-b016-f6900a69d271\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-p2vlz"
Oct 30 23:36:33.285559 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.285462    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-b4c22\""
Oct 30 23:36:33.291360 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.291334    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-kw26z"]
Oct 30 23:36:33.387439 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.387408    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:36:33.411624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.402089    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m6fz\" (UniqueName: \"kubernetes.io/projected/965ec8d0-31b7-4905-8a16-30a6a3e39f69-kube-api-access-6m6fz\") pod \"payload-pre-processing-7b98bb678c-kw26z\" (UID: \"965ec8d0-31b7-4905-8a16-30a6a3e39f69\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-kw26z"
Oct 30 23:36:33.411624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.402266    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/965ec8d0-31b7-4905-8a16-30a6a3e39f69-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-kw26z\" (UID: \"965ec8d0-31b7-4905-8a16-30a6a3e39f69\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-kw26z"
Oct 30 23:36:33.411624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.402315    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttb9j\" (UniqueName: \"kubernetes.io/projected/44393c6e-944b-47ab-b016-f6900a69d271-kube-api-access-ttb9j\") pod \"payload-processing-55fbbbf9dc-p2vlz\" (UID: \"44393c6e-944b-47ab-b016-f6900a69d271\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-p2vlz"
Oct 30 23:36:33.411624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.402379    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44393c6e-944b-47ab-b016-f6900a69d271-plugins-config-volume\") pod \"payload-processing-55fbbbf9dc-p2vlz\" (UID: \"44393c6e-944b-47ab-b016-f6900a69d271\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-p2vlz"
Oct 30 23:36:33.411624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.403340    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44393c6e-944b-47ab-b016-f6900a69d271-plugins-config-volume\") pod \"payload-processing-55fbbbf9dc-p2vlz\" (UID: \"44393c6e-944b-47ab-b016-f6900a69d271\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-p2vlz"
Oct 30 23:36:33.436290 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.436264    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttb9j\" (UniqueName: \"kubernetes.io/projected/44393c6e-944b-47ab-b016-f6900a69d271-kube-api-access-ttb9j\") pod \"payload-processing-55fbbbf9dc-p2vlz\" (UID: \"44393c6e-944b-47ab-b016-f6900a69d271\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-p2vlz"
Oct 30 23:36:33.505215 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.504495    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m6fz\" (UniqueName: \"kubernetes.io/projected/965ec8d0-31b7-4905-8a16-30a6a3e39f69-kube-api-access-6m6fz\") pod \"payload-pre-processing-7b98bb678c-kw26z\" (UID: \"965ec8d0-31b7-4905-8a16-30a6a3e39f69\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-kw26z"
Oct 30 23:36:33.505215 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.504646    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/965ec8d0-31b7-4905-8a16-30a6a3e39f69-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-kw26z\" (UID: \"965ec8d0-31b7-4905-8a16-30a6a3e39f69\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-kw26z"
Oct 30 23:36:33.505732 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.505372    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/965ec8d0-31b7-4905-8a16-30a6a3e39f69-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-kw26z\" (UID: \"965ec8d0-31b7-4905-8a16-30a6a3e39f69\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-kw26z"
Oct 30 23:36:33.518324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.518292    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m6fz\" (UniqueName: \"kubernetes.io/projected/965ec8d0-31b7-4905-8a16-30a6a3e39f69-kube-api-access-6m6fz\") pod \"payload-pre-processing-7b98bb678c-kw26z\" (UID: \"965ec8d0-31b7-4905-8a16-30a6a3e39f69\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-kw26z"
Oct 30 23:36:33.554070 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.554038    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-55fbbbf9dc-p2vlz"
Oct 30 23:36:33.597720 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.597680    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-kw26z"
Oct 30 23:36:33.831920 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.831897    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-55fbbbf9dc-p2vlz"]
Oct 30 23:36:33.834129 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:36:33.834101    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44393c6e_944b_47ab_b016_f6900a69d271.slice/crio-e115b8dc545cf69f184d0fcc16a3f31eaabedcab1467224482cdaf251ecc387d WatchSource:0}: Error finding container e115b8dc545cf69f184d0fcc16a3f31eaabedcab1467224482cdaf251ecc387d: Status 404 returned error can't find the container with id e115b8dc545cf69f184d0fcc16a3f31eaabedcab1467224482cdaf251ecc387d
Oct 30 23:36:33.894790 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:33.894710    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-kw26z"]
Oct 30 23:36:33.897055 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:36:33.897029    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod965ec8d0_31b7_4905_8a16_30a6a3e39f69.slice/crio-e9c0815adc9f43daf67639ee9adbad9fe9308e7c241c6f9ecfa16c869a9b650b WatchSource:0}: Error finding container e9c0815adc9f43daf67639ee9adbad9fe9308e7c241c6f9ecfa16c869a9b650b: Status 404 returned error can't find the container with id e9c0815adc9f43daf67639ee9adbad9fe9308e7c241c6f9ecfa16c869a9b650b
Oct 30 23:36:34.515785 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:34.515744    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-55fbbbf9dc-p2vlz" event={"ID":"44393c6e-944b-47ab-b016-f6900a69d271","Type":"ContainerStarted","Data":"e115b8dc545cf69f184d0fcc16a3f31eaabedcab1467224482cdaf251ecc387d"}
Oct 30 23:36:34.516893 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:34.516870    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-kw26z" event={"ID":"965ec8d0-31b7-4905-8a16-30a6a3e39f69","Type":"ContainerStarted","Data":"e9c0815adc9f43daf67639ee9adbad9fe9308e7c241c6f9ecfa16c869a9b650b"}
Oct 30 23:36:36.528148 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:36.528111    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-55fbbbf9dc-p2vlz" event={"ID":"44393c6e-944b-47ab-b016-f6900a69d271","Type":"ContainerStarted","Data":"bb702ddba8eec33870fc985db590b627bbb7a4147754a0438e65f57a560e4892"}
Oct 30 23:36:36.528639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:36.528297    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-55fbbbf9dc-p2vlz"
Oct 30 23:36:36.529667 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:36.529642    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-kw26z" event={"ID":"965ec8d0-31b7-4905-8a16-30a6a3e39f69","Type":"ContainerStarted","Data":"5da3e5dbf3b923373e72120720e68d7cb49ae2a937809b8e98065964453d9fe5"}
Oct 30 23:36:36.529771 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:36.529691    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-kw26z"
Oct 30 23:36:36.548441 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:36.548397    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-55fbbbf9dc-p2vlz" podStartSLOduration=1.044661695 podStartE2EDuration="3.548386604s" totalImagesPullingTime="2.503724909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:36:36.546800171 +0000 UTC m=+1055.791655939" watchObservedRunningTime="2026-10-30 23:36:36.548386604 +0000 UTC m=+1055.793242369"
Oct 30 23:36:36.565985 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:36.565942    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-kw26z" podStartSLOduration=1.115607463 podStartE2EDuration="3.565929755s" totalImagesPullingTime="2.450322292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:36:36.564797582 +0000 UTC m=+1055.809653363" watchObservedRunningTime="2026-10-30 23:36:36.565929755 +0000 UTC m=+1055.810785523"
Oct 30 23:36:41.401458 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:36:41.401419    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:36:43.512190 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:43.512160    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-655fc879db-5vqfn"
Oct 30 23:36:43.767577 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:43.767498    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-58f8946bc6-2bcnq"]
Oct 30 23:36:43.775847 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:43.775829    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-58f8946bc6-2bcnq"
Oct 30 23:36:43.781466 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:43.781442    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-58f8946bc6-2bcnq"]
Oct 30 23:36:43.791986 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:43.791959    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/838df128-c220-46d4-8fd7-a510fbcf34d8-metrics-certs\") pod \"ai-gateway-controller-58f8946bc6-2bcnq\" (UID: \"838df128-c220-46d4-8fd7-a510fbcf34d8\") " pod="opendatahub/ai-gateway-controller-58f8946bc6-2bcnq"
Oct 30 23:36:43.792125 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:43.792108    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtz4x\" (UniqueName: \"kubernetes.io/projected/838df128-c220-46d4-8fd7-a510fbcf34d8-kube-api-access-xtz4x\") pod \"ai-gateway-controller-58f8946bc6-2bcnq\" (UID: \"838df128-c220-46d4-8fd7-a510fbcf34d8\") " pod="opendatahub/ai-gateway-controller-58f8946bc6-2bcnq"
Oct 30 23:36:43.892747 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:43.892687    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtz4x\" (UniqueName: \"kubernetes.io/projected/838df128-c220-46d4-8fd7-a510fbcf34d8-kube-api-access-xtz4x\") pod \"ai-gateway-controller-58f8946bc6-2bcnq\" (UID: \"838df128-c220-46d4-8fd7-a510fbcf34d8\") " pod="opendatahub/ai-gateway-controller-58f8946bc6-2bcnq"
Oct 30 23:36:43.892747 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:43.892722    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/838df128-c220-46d4-8fd7-a510fbcf34d8-metrics-certs\") pod \"ai-gateway-controller-58f8946bc6-2bcnq\" (UID: \"838df128-c220-46d4-8fd7-a510fbcf34d8\") " pod="opendatahub/ai-gateway-controller-58f8946bc6-2bcnq"
Oct 30 23:36:43.895221 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:43.895196    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/838df128-c220-46d4-8fd7-a510fbcf34d8-metrics-certs\") pod \"ai-gateway-controller-58f8946bc6-2bcnq\" (UID: \"838df128-c220-46d4-8fd7-a510fbcf34d8\") " pod="opendatahub/ai-gateway-controller-58f8946bc6-2bcnq"
Oct 30 23:36:43.923730 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:43.923704    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtz4x\" (UniqueName: \"kubernetes.io/projected/838df128-c220-46d4-8fd7-a510fbcf34d8-kube-api-access-xtz4x\") pod \"ai-gateway-controller-58f8946bc6-2bcnq\" (UID: \"838df128-c220-46d4-8fd7-a510fbcf34d8\") " pod="opendatahub/ai-gateway-controller-58f8946bc6-2bcnq"
Oct 30 23:36:44.094437 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:44.094355    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-58f8946bc6-2bcnq"
Oct 30 23:36:44.379024 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:44.378999    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-58f8946bc6-2bcnq"]
Oct 30 23:36:44.380815 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:36:44.380788    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod838df128_c220_46d4_8fd7_a510fbcf34d8.slice/crio-2692f825a5d170dbd5e2859f55bd0396d6ac2ab4d4cbfff10b4907498d0ee98d WatchSource:0}: Error finding container 2692f825a5d170dbd5e2859f55bd0396d6ac2ab4d4cbfff10b4907498d0ee98d: Status 404 returned error can't find the container with id 2692f825a5d170dbd5e2859f55bd0396d6ac2ab4d4cbfff10b4907498d0ee98d
Oct 30 23:36:44.567582 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:44.567535    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-58f8946bc6-2bcnq" event={"ID":"838df128-c220-46d4-8fd7-a510fbcf34d8","Type":"ContainerStarted","Data":"2692f825a5d170dbd5e2859f55bd0396d6ac2ab4d4cbfff10b4907498d0ee98d"}
Oct 30 23:36:45.574355 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:45.574323    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-58f8946bc6-2bcnq" event={"ID":"838df128-c220-46d4-8fd7-a510fbcf34d8","Type":"ContainerStarted","Data":"52aea1e756740949536cd3e23a7bca3904781f790e9977f0a8b3de163aeecb3a"}
Oct 30 23:36:45.574860 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:45.574447    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-58f8946bc6-2bcnq"
Oct 30 23:36:45.594370 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:45.594325    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-58f8946bc6-2bcnq" podStartSLOduration=2.215648967 podStartE2EDuration="2.594314584s" totalImagesPullingTime="378.665617ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:36:45.593744251 +0000 UTC m=+1064.838600018" watchObservedRunningTime="2026-10-30 23:36:45.594314584 +0000 UTC m=+1064.839170351"
Oct 30 23:36:47.537615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:47.537570    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-kw26z"
Oct 30 23:36:47.538143 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:47.537780    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-55fbbbf9dc-p2vlz"
Oct 30 23:36:51.527993 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:51.527964    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:36:51.687413 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:51.687376    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:36:56.581626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:56.581584    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-58f8946bc6-2bcnq"
Oct 30 23:36:56.628568 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:56.628538    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-655fc879db-5vqfn"]
Oct 30 23:36:56.628824 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:56.628771    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-655fc879db-5vqfn" podUID="9c1dea42-9d2e-4fb2-91d3-99d06fb55744" containerName="manager" containerID="cri-o://ab75f2ec1fbfe28a9d5f60425fc2aad6b63a4c7da1b7a0eec2c9124e074e4cb0" gracePeriod=30
Oct 30 23:36:56.876033 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:56.876004    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-655fc879db-5vqfn"
Oct 30 23:36:56.919699 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:56.919667    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9c1dea42-9d2e-4fb2-91d3-99d06fb55744-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c1dea42-9d2e-4fb2-91d3-99d06fb55744-metrics-certs\") pod \"9c1dea42-9d2e-4fb2-91d3-99d06fb55744\" (UID: \"9c1dea42-9d2e-4fb2-91d3-99d06fb55744\") "
Oct 30 23:36:56.919860 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:56.919798    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9c1dea42-9d2e-4fb2-91d3-99d06fb55744-kube-api-access-pvs2w\" (UniqueName: \"kubernetes.io/projected/9c1dea42-9d2e-4fb2-91d3-99d06fb55744-kube-api-access-pvs2w\") pod \"9c1dea42-9d2e-4fb2-91d3-99d06fb55744\" (UID: \"9c1dea42-9d2e-4fb2-91d3-99d06fb55744\") "
Oct 30 23:36:56.921889 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:56.921860    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c1dea42-9d2e-4fb2-91d3-99d06fb55744-metrics-certs" pod "9c1dea42-9d2e-4fb2-91d3-99d06fb55744" (UID: "9c1dea42-9d2e-4fb2-91d3-99d06fb55744"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:36:56.922022 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:56.921998    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c1dea42-9d2e-4fb2-91d3-99d06fb55744-kube-api-access-pvs2w" pod "9c1dea42-9d2e-4fb2-91d3-99d06fb55744" (UID: "9c1dea42-9d2e-4fb2-91d3-99d06fb55744"). InnerVolumeSpecName "kube-api-access-pvs2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:36:57.020491 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:57.020460    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c1dea42-9d2e-4fb2-91d3-99d06fb55744-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:36:57.020491 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:57.020486    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvs2w\" (UniqueName: \"kubernetes.io/projected/9c1dea42-9d2e-4fb2-91d3-99d06fb55744-kube-api-access-pvs2w\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:36:57.635520 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:57.635486    4921 generic.go:356] "Generic (PLEG): container finished" podID="9c1dea42-9d2e-4fb2-91d3-99d06fb55744" containerID="ab75f2ec1fbfe28a9d5f60425fc2aad6b63a4c7da1b7a0eec2c9124e074e4cb0" exitCode=0
Oct 30 23:36:57.636065 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:57.635538    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-655fc879db-5vqfn"
Oct 30 23:36:57.636065 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:57.635569    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-655fc879db-5vqfn" event={"ID":"9c1dea42-9d2e-4fb2-91d3-99d06fb55744","Type":"ContainerDied","Data":"ab75f2ec1fbfe28a9d5f60425fc2aad6b63a4c7da1b7a0eec2c9124e074e4cb0"}
Oct 30 23:36:57.636065 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:57.635646    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-655fc879db-5vqfn" event={"ID":"9c1dea42-9d2e-4fb2-91d3-99d06fb55744","Type":"ContainerDied","Data":"27bd1d8bb15b10784ef09518d7511a340d78e0354c8ab888a478b8b7cb6163b8"}
Oct 30 23:36:57.636065 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:57.635670    4921 scope.go:122] "RemoveContainer" containerID="ab75f2ec1fbfe28a9d5f60425fc2aad6b63a4c7da1b7a0eec2c9124e074e4cb0"
Oct 30 23:36:57.645023 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:57.645006    4921 scope.go:122] "RemoveContainer" containerID="ab75f2ec1fbfe28a9d5f60425fc2aad6b63a4c7da1b7a0eec2c9124e074e4cb0"
Oct 30 23:36:57.645282 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:36:57.645255    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab75f2ec1fbfe28a9d5f60425fc2aad6b63a4c7da1b7a0eec2c9124e074e4cb0\": container with ID starting with ab75f2ec1fbfe28a9d5f60425fc2aad6b63a4c7da1b7a0eec2c9124e074e4cb0 not found: ID does not exist" containerID="ab75f2ec1fbfe28a9d5f60425fc2aad6b63a4c7da1b7a0eec2c9124e074e4cb0"
Oct 30 23:36:57.645341 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:57.645281    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab75f2ec1fbfe28a9d5f60425fc2aad6b63a4c7da1b7a0eec2c9124e074e4cb0"} err="failed to get container status \"ab75f2ec1fbfe28a9d5f60425fc2aad6b63a4c7da1b7a0eec2c9124e074e4cb0\": rpc error: code = NotFound desc = could not find container \"ab75f2ec1fbfe28a9d5f60425fc2aad6b63a4c7da1b7a0eec2c9124e074e4cb0\": container with ID starting with ab75f2ec1fbfe28a9d5f60425fc2aad6b63a4c7da1b7a0eec2c9124e074e4cb0 not found: ID does not exist"
Oct 30 23:36:57.658603 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:57.658562    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-655fc879db-5vqfn"]
Oct 30 23:36:57.665357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:57.665337    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-655fc879db-5vqfn"]
Oct 30 23:36:58.332466 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:58.332435    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:36:58.841351 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:58.841320    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:36:58.881012 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:36:58.880987    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9c1dea42-9d2e-4fb2-91d3-99d06fb55744" path="/var/lib/kubelet/pods/9c1dea42-9d2e-4fb2-91d3-99d06fb55744/volumes"
Oct 30 23:37:00.451035 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:00.451007    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:00.580457 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:00.580428    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:01.908570 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:01.908528    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:02.044910 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:02.044875    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:11.402705 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:37:11.402666    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:37:24.874433 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:24.874395    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:25.029006 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.028973    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:25.283728 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.283692    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"]
Oct 30 23:37:25.284322 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.284306    4921 cpu_manager.go:414] "containerMap: removing container" podUID="9c1dea42-9d2e-4fb2-91d3-99d06fb55744" containerName="manager"
Oct 30 23:37:25.284370 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.284326    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9c1dea42-9d2e-4fb2-91d3-99d06fb55744" containerName="manager"
Oct 30 23:37:25.284477 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.284467    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="9c1dea42-9d2e-4fb2-91d3-99d06fb55744" containerName="manager"
Oct 30 23:37:25.287960 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.287938    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.297944 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.297101    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-9ef03a-openshift-default-dockercfg-mf4wj\""
Oct 30 23:37:25.306027 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.305998    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"]
Oct 30 23:37:25.371051 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.371018    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:25.380031 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.380006    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-data\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.380170 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.380048    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-credential-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.380170 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.380128    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zw55\" (UniqueName: \"kubernetes.io/projected/b14e7bdd-df95-4c34-958c-3b023b9596fa-kube-api-access-5zw55\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.380170 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.380150    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-envoy\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.380170 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.380167    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-token\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.380334 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.380189    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-workload-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.380334 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.380308    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-podinfo\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.380401 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.380353    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-workload-certs\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.380440 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.380417    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b14e7bdd-df95-4c34-958c-3b023b9596fa-istiod-ca-cert\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.385267 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.385247    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"]
Oct 30 23:37:25.388804 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.388785    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.395859 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.395838    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-843d8c-openshift-default-dockercfg-l4st5\""
Oct 30 23:37:25.403633 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.403581    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"]
Oct 30 23:37:25.481690 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.481656    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-workload-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.481875 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.481705    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-podinfo\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.481875 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.481741    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-workload-certs\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.481875 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.481772    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b14e7bdd-df95-4c34-958c-3b023b9596fa-istiod-ca-cert\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.481875 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.481838    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-credential-socket\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.481875 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.481864    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-envoy\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.482153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.481897    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-data\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.482153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.481926    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-workload-socket\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.482153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.482111    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-workload-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.482153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.482127    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-data\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.482333 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.482213    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-workload-certs\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.482333 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.482252    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-credential-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.482333 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.482271    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istiod-ca-cert\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.482333 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.482294    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-podinfo\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.482333 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.482327    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zw55\" (UniqueName: \"kubernetes.io/projected/b14e7bdd-df95-4c34-958c-3b023b9596fa-kube-api-access-5zw55\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.482530 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.482344    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-token\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.482530 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.482355    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-data\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.482530 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.482362    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-envoy\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.482530 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.482417    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-token\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.482530 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.482461    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnt7r\" (UniqueName: \"kubernetes.io/projected/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-kube-api-access-gnt7r\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.483079 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.483053    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-credential-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.483483 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.483455    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b14e7bdd-df95-4c34-958c-3b023b9596fa-istiod-ca-cert\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.483757 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.483736    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-workload-certs\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.484530 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.484509    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-podinfo\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.484700 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.484658    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-envoy\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.500951 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.500926    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-token\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.501070 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.501050    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zw55\" (UniqueName: \"kubernetes.io/projected/b14e7bdd-df95-4c34-958c-3b023b9596fa-kube-api-access-5zw55\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.539380 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.539313    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:25.583135 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.583103    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-credential-socket\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.583312 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.583142    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-envoy\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.583312 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.583269    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-workload-socket\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.583433 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.583316    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-data\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.583433 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.583342    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-workload-certs\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.583433 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.583362    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istiod-ca-cert\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.583433 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.583392    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-podinfo\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.583678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.583438    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-token\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.583678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.583476    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-credential-socket\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.583678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.583484    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnt7r\" (UniqueName: \"kubernetes.io/projected/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-kube-api-access-gnt7r\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.583830 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.583690    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-workload-socket\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.583830 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.583690    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-data\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.583830 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.583740    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-workload-certs\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.584153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.584085    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istiod-ca-cert\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.585727 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.585701    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-envoy\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.586213 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.586193    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-podinfo\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.606953 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.606464    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-token\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.608926 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.608903    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnt7r\" (UniqueName: \"kubernetes.io/projected/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-kube-api-access-gnt7r\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.611755 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.611735    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:25.665849 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.665818    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"]
Oct 30 23:37:25.669807 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.669787    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.689619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.688956    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-e15304-openshift-default-dockercfg-qbhbd\""
Oct 30 23:37:25.689619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.689056    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"]
Oct 30 23:37:25.692638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.691288    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-credential-socket\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.692638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.691323    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-workload-certs\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.692638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.691365    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9927a847-b4b7-4c22-a3df-3ac672c98c80-istiod-ca-cert\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.692638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.691404    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-token\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.692638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.691454    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-podinfo\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.692638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.691489    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-envoy\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.692638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.691524    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdvcl\" (UniqueName: \"kubernetes.io/projected/9927a847-b4b7-4c22-a3df-3ac672c98c80-kube-api-access-mdvcl\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.692638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.691674    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-data\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.692638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.691735    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-workload-socket\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.692638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.691743    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:25.703132 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.702910    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:25.769031 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.767948    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"]
Oct 30 23:37:25.773663 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.773191    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.784747 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.780805    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-d3dcca-openshift-default-dockercfg-mtkk6\""
Oct 30 23:37:25.784747 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.784682    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"]
Oct 30 23:37:25.792911 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.792854    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-token\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.792911 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.792896    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-podinfo\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.793084 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.792916    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-envoy\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.793084 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.792938    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdvcl\" (UniqueName: \"kubernetes.io/projected/9927a847-b4b7-4c22-a3df-3ac672c98c80-kube-api-access-mdvcl\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.793084 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.792958    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-workload-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.793084 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.792980    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-istio-envoy\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.793084 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.793003    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dks9n\" (UniqueName: \"kubernetes.io/projected/ac24a789-f285-4a46-8121-579b4b3bd264-kube-api-access-dks9n\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.793084 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.793022    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac24a789-f285-4a46-8121-579b4b3bd264-istio-token\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.793084 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.793039    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-data\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.793084 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.793053    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-credential-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.793084 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.793074    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-workload-socket\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.793539 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.793098    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac24a789-f285-4a46-8121-579b4b3bd264-istio-podinfo\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.793539 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.793114    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac24a789-f285-4a46-8121-579b4b3bd264-istiod-ca-cert\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.793539 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.793146    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-istio-data\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.793539 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.793166    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-credential-socket\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.793539 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.793181    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-workload-certs\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.793539 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.793199    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-workload-certs\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.793539 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.793221    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9927a847-b4b7-4c22-a3df-3ac672c98c80-istiod-ca-cert\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.793984 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.793960    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9927a847-b4b7-4c22-a3df-3ac672c98c80-istiod-ca-cert\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.794045 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.793966    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-credential-socket\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.794100 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.794037    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-workload-socket\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.794192 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.794173    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-data\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.794756 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.794733    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-workload-certs\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.798055 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.798029    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-envoy\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.798875 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.798853    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-podinfo\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.810103 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.810058    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-token\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.811518 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.811497    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdvcl\" (UniqueName: \"kubernetes.io/projected/9927a847-b4b7-4c22-a3df-3ac672c98c80-kube-api-access-mdvcl\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.835997 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.835969    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:25.894506 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.894474    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-workload-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.895145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.894514    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-istio-envoy\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.895145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.894649    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dks9n\" (UniqueName: \"kubernetes.io/projected/ac24a789-f285-4a46-8121-579b4b3bd264-kube-api-access-dks9n\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.895145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.894699    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac24a789-f285-4a46-8121-579b4b3bd264-istio-token\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.895145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.894740    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-credential-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.895145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.894807    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac24a789-f285-4a46-8121-579b4b3bd264-istio-podinfo\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.895145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.894832    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac24a789-f285-4a46-8121-579b4b3bd264-istiod-ca-cert\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.895145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.894927    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-istio-data\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.895145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.895010    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-workload-certs\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.895145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.895038    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-credential-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.895145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.894947    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-workload-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.895805 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.895491    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-workload-certs\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.895805 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.895712    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-istio-data\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.896011 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.895989    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac24a789-f285-4a46-8121-579b4b3bd264-istiod-ca-cert\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.897483 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.897461    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-istio-envoy\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.897947 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.897931    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac24a789-f285-4a46-8121-579b4b3bd264-istio-podinfo\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.911744 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.911721    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"]
Oct 30 23:37:25.913733 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:37:25.913709    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14e7bdd_df95_4c34_958c_3b023b9596fa.slice/crio-450615f4f6cd07da1e8021ed19a464a526df85790f6b927d1304685a82a3c6cf WatchSource:0}: Error finding container 450615f4f6cd07da1e8021ed19a464a526df85790f6b927d1304685a82a3c6cf: Status 404 returned error can't find the container with id 450615f4f6cd07da1e8021ed19a464a526df85790f6b927d1304685a82a3c6cf
Oct 30 23:37:25.915942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.915913    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:25.916015 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.915975    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:25.916053 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.916026    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:25.923788 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.923764    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac24a789-f285-4a46-8121-579b4b3bd264-istio-token\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.926132 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.926112    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dks9n\" (UniqueName: \"kubernetes.io/projected/ac24a789-f285-4a46-8121-579b4b3bd264-kube-api-access-dks9n\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:25.977269 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.977241    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:25.994656 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.994632    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:25.996365 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:25.996339    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"]
Oct 30 23:37:25.999807 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:37:25.999770    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22dee8ec_69c0_4889_adb1_8ecde0d7b66a.slice/crio-e10e0f29990efb7e328f5f091bfd27b7870e4c4a4ffb847fc3922fa3cd7634d9 WatchSource:0}: Error finding container e10e0f29990efb7e328f5f091bfd27b7870e4c4a4ffb847fc3922fa3cd7634d9: Status 404 returned error can't find the container with id e10e0f29990efb7e328f5f091bfd27b7870e4c4a4ffb847fc3922fa3cd7634d9
Oct 30 23:37:26.006538 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.006500    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:26.006654 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.006634    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:26.006705 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.006685    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:26.089962 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.089770    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:26.118980 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.117240    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:26.261861 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.261700    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:26.318699 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.318659    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"]
Oct 30 23:37:26.321072 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:37:26.321047    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9927a847_b4b7_4c22_a3df_3ac672c98c80.slice/crio-f5b81000f58f7e8f3242b8365eee5f3414f21e5cdc7670764f22061cdbc602b6 WatchSource:0}: Error finding container f5b81000f58f7e8f3242b8365eee5f3414f21e5cdc7670764f22061cdbc602b6: Status 404 returned error can't find the container with id f5b81000f58f7e8f3242b8365eee5f3414f21e5cdc7670764f22061cdbc602b6
Oct 30 23:37:26.324124 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.324086    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:26.324215 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.324175    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:26.324274 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.324222    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:26.404045 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.404021    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"]
Oct 30 23:37:26.406415 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:37:26.406390    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac24a789_f285_4a46_8121_579b4b3bd264.slice/crio-82ebfdf8117e9e4a72c1629133a867970c90f94e73ef52b981a59d1be9334b09 WatchSource:0}: Error finding container 82ebfdf8117e9e4a72c1629133a867970c90f94e73ef52b981a59d1be9334b09: Status 404 returned error can't find the container with id 82ebfdf8117e9e4a72c1629133a867970c90f94e73ef52b981a59d1be9334b09
Oct 30 23:37:26.409514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.409463    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:26.409649 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.409553    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:26.409649 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.409629    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:26.782538 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.782502    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f" event={"ID":"9927a847-b4b7-4c22-a3df-3ac672c98c80","Type":"ContainerStarted","Data":"bb8e9bd8927cb8f947c376734c7b9fa9e463996704822f2ffe35ddbc870ea681"}
Oct 30 23:37:26.782741 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.782568    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f" event={"ID":"9927a847-b4b7-4c22-a3df-3ac672c98c80","Type":"ContainerStarted","Data":"f5b81000f58f7e8f3242b8365eee5f3414f21e5cdc7670764f22061cdbc602b6"}
Oct 30 23:37:26.784148 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.784115    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td" event={"ID":"22dee8ec-69c0-4889-adb1-8ecde0d7b66a","Type":"ContainerStarted","Data":"7aec0905983c2beab328983940a6b63cf5af50eb687ae8243ea62949632366f2"}
Oct 30 23:37:26.784278 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.784152    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td" event={"ID":"22dee8ec-69c0-4889-adb1-8ecde0d7b66a","Type":"ContainerStarted","Data":"e10e0f29990efb7e328f5f091bfd27b7870e4c4a4ffb847fc3922fa3cd7634d9"}
Oct 30 23:37:26.785770 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.785737    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j" event={"ID":"b14e7bdd-df95-4c34-958c-3b023b9596fa","Type":"ContainerStarted","Data":"155ae7b14a7fbbcfce77b8477fbc890696ca53c7621572c4f25b970678bcbe74"}
Oct 30 23:37:26.785876 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.785789    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j" event={"ID":"b14e7bdd-df95-4c34-958c-3b023b9596fa","Type":"ContainerStarted","Data":"450615f4f6cd07da1e8021ed19a464a526df85790f6b927d1304685a82a3c6cf"}
Oct 30 23:37:26.787639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.787611    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q" event={"ID":"ac24a789-f285-4a46-8121-579b4b3bd264","Type":"ContainerStarted","Data":"2a2ee75c000b3efb7bb9999d43fa38bb14fa1affc510cdefa2362eb6f05034fe"}
Oct 30 23:37:26.787739 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.787662    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q" event={"ID":"ac24a789-f285-4a46-8121-579b4b3bd264","Type":"ContainerStarted","Data":"82ebfdf8117e9e4a72c1629133a867970c90f94e73ef52b981a59d1be9334b09"}
Oct 30 23:37:26.810717 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.810659    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f" podStartSLOduration=1.810642771 podStartE2EDuration="1.810642771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:37:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:26.809208362 +0000 UTC m=+1106.054064131" watchObservedRunningTime="2026-10-30 23:37:26.810642771 +0000 UTC m=+1106.055498541"
Oct 30 23:37:26.857499 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.857447    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td" podStartSLOduration=1.8574274480000001 podStartE2EDuration="1.857427448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:37:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:26.857197155 +0000 UTC m=+1106.102052923" watchObservedRunningTime="2026-10-30 23:37:26.857427448 +0000 UTC m=+1106.102283217"
Oct 30 23:37:26.859023 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.858986    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j" podStartSLOduration=1.858974338 podStartE2EDuration="1.858974338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:37:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:26.832762853 +0000 UTC m=+1106.077618621" watchObservedRunningTime="2026-10-30 23:37:26.858974338 +0000 UTC m=+1106.103830106"
Oct 30 23:37:26.881474 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:26.881434    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q" podStartSLOduration=1.8814215989999998 podStartE2EDuration="1.881421599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:37:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:26.880347981 +0000 UTC m=+1106.125203750" watchObservedRunningTime="2026-10-30 23:37:26.881421599 +0000 UTC m=+1106.126277366"
Oct 30 23:37:27.002131 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:27.002049    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:27.025622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:27.025272    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:27.090659 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:27.090559    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:27.095543 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:27.095521    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:27.613066 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:27.612996    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:27.630891 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:27.630655    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:27.704146 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:27.704113    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:27.709659 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:27.709633    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:27.793159 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:27.793068    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:27.793159 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:27.793119    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:27.793159 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:27.793143    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:27.793159 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:27.793164    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:27.794064 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:27.794041    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:27.794232 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:27.794109    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:27.794297 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:27.794280    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:37:27.794334 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:27.794325    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:28.831470 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:28.831440    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:28.972237 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:28.972201    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:29.422238 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:29.422207    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:29.591358 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:29.591316    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:29.811269 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:29.811188    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:29.966481 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:29.966452    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:30.488678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.488649    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:30.628622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.628577    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7"]
Oct 30 23:37:30.632424 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.632409    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7"
Oct 30 23:37:30.643169 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.643148    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w5-dd3a15\""
Oct 30 23:37:30.644623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.643870    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w5-dd3a15-dockercfg-7qjpp\""
Oct 30 23:37:30.654866 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.654840    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7"]
Oct 30 23:37:30.664907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.664877    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:30.674184 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.674161    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b"]
Oct 30 23:37:30.678020 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.678001    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b"
Oct 30 23:37:30.686888 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.686859    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53df0b12-f9f8-496b-89b7-74ab374eedda-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7\" (UID: \"53df0b12-f9f8-496b-89b7-74ab374eedda\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7"
Oct 30 23:37:30.687121 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.687099    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sslq4\" (UniqueName: \"kubernetes.io/projected/53df0b12-f9f8-496b-89b7-74ab374eedda-kube-api-access-sslq4\") pod \"payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7\" (UID: \"53df0b12-f9f8-496b-89b7-74ab374eedda\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7"
Oct 30 23:37:30.712216 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.712180    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b"]
Oct 30 23:37:30.799926 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.788217    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kddwp\" (UniqueName: \"kubernetes.io/projected/6ac65d9a-6c8f-43c9-aa20-caca662961f5-kube-api-access-kddwp\") pod \"payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b\" (UID: \"6ac65d9a-6c8f-43c9-aa20-caca662961f5\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b"
Oct 30 23:37:30.800283 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.800255    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53df0b12-f9f8-496b-89b7-74ab374eedda-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7\" (UID: \"53df0b12-f9f8-496b-89b7-74ab374eedda\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7"
Oct 30 23:37:30.800484 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.800465    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sslq4\" (UniqueName: \"kubernetes.io/projected/53df0b12-f9f8-496b-89b7-74ab374eedda-kube-api-access-sslq4\") pod \"payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7\" (UID: \"53df0b12-f9f8-496b-89b7-74ab374eedda\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7"
Oct 30 23:37:30.800829 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.800803    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ac65d9a-6c8f-43c9-aa20-caca662961f5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b\" (UID: \"6ac65d9a-6c8f-43c9-aa20-caca662961f5\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b"
Oct 30 23:37:30.801728 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.801661    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53df0b12-f9f8-496b-89b7-74ab374eedda-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7\" (UID: \"53df0b12-f9f8-496b-89b7-74ab374eedda\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7"
Oct 30 23:37:30.813864 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.813840    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sslq4\" (UniqueName: \"kubernetes.io/projected/53df0b12-f9f8-496b-89b7-74ab374eedda-kube-api-access-sslq4\") pod \"payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7\" (UID: \"53df0b12-f9f8-496b-89b7-74ab374eedda\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7"
Oct 30 23:37:30.901745 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.901706    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ac65d9a-6c8f-43c9-aa20-caca662961f5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b\" (UID: \"6ac65d9a-6c8f-43c9-aa20-caca662961f5\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b"
Oct 30 23:37:30.901894 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.901819    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kddwp\" (UniqueName: \"kubernetes.io/projected/6ac65d9a-6c8f-43c9-aa20-caca662961f5-kube-api-access-kddwp\") pod \"payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b\" (UID: \"6ac65d9a-6c8f-43c9-aa20-caca662961f5\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b"
Oct 30 23:37:30.902672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.902647    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ac65d9a-6c8f-43c9-aa20-caca662961f5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b\" (UID: \"6ac65d9a-6c8f-43c9-aa20-caca662961f5\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b"
Oct 30 23:37:30.916158 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.916124    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kddwp\" (UniqueName: \"kubernetes.io/projected/6ac65d9a-6c8f-43c9-aa20-caca662961f5-kube-api-access-kddwp\") pod \"payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b\" (UID: \"6ac65d9a-6c8f-43c9-aa20-caca662961f5\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b"
Oct 30 23:37:30.947234 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:30.947204    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7"
Oct 30 23:37:31.015076 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.015042    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b"
Oct 30 23:37:31.235686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.235521    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7"]
Oct 30 23:37:31.239002 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:37:31.238968    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53df0b12_f9f8_496b_89b7_74ab374eedda.slice/crio-541484f6341bd81f52a9d023766792c70b622617d8b1c0dbd045e6769bf51093 WatchSource:0}: Error finding container 541484f6341bd81f52a9d023766792c70b622617d8b1c0dbd045e6769bf51093: Status 404 returned error can't find the container with id 541484f6341bd81f52a9d023766792c70b622617d8b1c0dbd045e6769bf51093
Oct 30 23:37:31.309163 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.309068    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b"]
Oct 30 23:37:31.311195 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:37:31.311164    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ac65d9a_6c8f_43c9_aa20_caca662961f5.slice/crio-b139d3c0ddfa74c8b43f4382c92394bb130ad26b10a0b506bc729d73ba0e534b WatchSource:0}: Error finding container b139d3c0ddfa74c8b43f4382c92394bb130ad26b10a0b506bc729d73ba0e534b: Status 404 returned error can't find the container with id b139d3c0ddfa74c8b43f4382c92394bb130ad26b10a0b506bc729d73ba0e534b
Oct 30 23:37:31.331891 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.331866    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:31.356429 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.356401    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"]
Oct 30 23:37:31.363148 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.363127    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"
Oct 30 23:37:31.377147 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.376404    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"]
Oct 30 23:37:31.384181 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.384152    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-dd3a15-serving-cert\""
Oct 30 23:37:31.509266 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.509225    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htl22\" (UniqueName: \"kubernetes.io/projected/ce487838-fd5e-45c8-9cb9-b29e538ef744-kube-api-access-htl22\") pod \"maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf\" (UID: \"ce487838-fd5e-45c8-9cb9-b29e538ef744\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"
Oct 30 23:37:31.509266 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.509266    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce487838-fd5e-45c8-9cb9-b29e538ef744-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf\" (UID: \"ce487838-fd5e-45c8-9cb9-b29e538ef744\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"
Oct 30 23:37:31.509466 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.509294    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce487838-fd5e-45c8-9cb9-b29e538ef744-maas-api-tls\") pod \"maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf\" (UID: \"ce487838-fd5e-45c8-9cb9-b29e538ef744\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"
Oct 30 23:37:31.509504 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.509473    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce487838-fd5e-45c8-9cb9-b29e538ef744-metrics-certs\") pod \"maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf\" (UID: \"ce487838-fd5e-45c8-9cb9-b29e538ef744\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"
Oct 30 23:37:31.509565 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.509544    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:31.615677 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.615300    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce487838-fd5e-45c8-9cb9-b29e538ef744-metrics-certs\") pod \"maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf\" (UID: \"ce487838-fd5e-45c8-9cb9-b29e538ef744\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"
Oct 30 23:37:31.615677 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.615419    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htl22\" (UniqueName: \"kubernetes.io/projected/ce487838-fd5e-45c8-9cb9-b29e538ef744-kube-api-access-htl22\") pod \"maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf\" (UID: \"ce487838-fd5e-45c8-9cb9-b29e538ef744\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"
Oct 30 23:37:31.615677 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.615453    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce487838-fd5e-45c8-9cb9-b29e538ef744-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf\" (UID: \"ce487838-fd5e-45c8-9cb9-b29e538ef744\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"
Oct 30 23:37:31.615677 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.615501    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce487838-fd5e-45c8-9cb9-b29e538ef744-maas-api-tls\") pod \"maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf\" (UID: \"ce487838-fd5e-45c8-9cb9-b29e538ef744\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"
Oct 30 23:37:31.619445 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.619413    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce487838-fd5e-45c8-9cb9-b29e538ef744-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf\" (UID: \"ce487838-fd5e-45c8-9cb9-b29e538ef744\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"
Oct 30 23:37:31.621646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.621134    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce487838-fd5e-45c8-9cb9-b29e538ef744-metrics-certs\") pod \"maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf\" (UID: \"ce487838-fd5e-45c8-9cb9-b29e538ef744\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"
Oct 30 23:37:31.625417 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.624653    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce487838-fd5e-45c8-9cb9-b29e538ef744-maas-api-tls\") pod \"maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf\" (UID: \"ce487838-fd5e-45c8-9cb9-b29e538ef744\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"
Oct 30 23:37:31.633049 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.633017    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htl22\" (UniqueName: \"kubernetes.io/projected/ce487838-fd5e-45c8-9cb9-b29e538ef744-kube-api-access-htl22\") pod \"maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf\" (UID: \"ce487838-fd5e-45c8-9cb9-b29e538ef744\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"
Oct 30 23:37:31.634254 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.634230    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:31.696412 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.696382    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"
Oct 30 23:37:31.818165 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.818117    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b" event={"ID":"6ac65d9a-6c8f-43c9-aa20-caca662961f5","Type":"ContainerStarted","Data":"5854633c74998edac768a608bb2c33ad52f5994a6b91a506bf6f0bad5a7d3435"}
Oct 30 23:37:31.818363 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.818182    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b" event={"ID":"6ac65d9a-6c8f-43c9-aa20-caca662961f5","Type":"ContainerStarted","Data":"b139d3c0ddfa74c8b43f4382c92394bb130ad26b10a0b506bc729d73ba0e534b"}
Oct 30 23:37:31.818363 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.818293    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b"
Oct 30 23:37:31.819846 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.819783    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7" event={"ID":"53df0b12-f9f8-496b-89b7-74ab374eedda","Type":"ContainerStarted","Data":"509ba8184b0939230ef9e85b7b815e99d88b9013c1fc5132b1d0037de99d15ef"}
Oct 30 23:37:31.819846 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.819836    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7"
Oct 30 23:37:31.819999 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.819853    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7" event={"ID":"53df0b12-f9f8-496b-89b7-74ab374eedda","Type":"ContainerStarted","Data":"541484f6341bd81f52a9d023766792c70b622617d8b1c0dbd045e6769bf51093"}
Oct 30 23:37:31.842114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.842067    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b" podStartSLOduration=1.842054113 podStartE2EDuration="1.842054113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:37:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:31.839351248 +0000 UTC m=+1111.084207019" watchObservedRunningTime="2026-10-30 23:37:31.842054113 +0000 UTC m=+1111.086909911"
Oct 30 23:37:31.857903 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.857851    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7" podStartSLOduration=1.857834261 podStartE2EDuration="1.857834261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:37:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:31.856848753 +0000 UTC m=+1111.101704520" watchObservedRunningTime="2026-10-30 23:37:31.857834261 +0000 UTC m=+1111.102690030"
Oct 30 23:37:31.976508 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:31.976478    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"]
Oct 30 23:37:32.019789 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.019758    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:32.088375 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.088341    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz"]
Oct 30 23:37:32.104902 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.104855    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz"]
Oct 30 23:37:32.105061 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.104979    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz"
Oct 30 23:37:32.147402 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.147373    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w6-e15304\""
Oct 30 23:37:32.147572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.147515    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w6-e15304-dockercfg-8mxkq\""
Oct 30 23:37:32.150080 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.150030    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:32.223063 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.222261    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlzwz\" (UniqueName: \"kubernetes.io/projected/33d808b5-315e-4d68-a3f8-c5a3fb98531a-kube-api-access-hlzwz\") pod \"payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz\" (UID: \"33d808b5-315e-4d68-a3f8-c5a3fb98531a\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz"
Oct 30 23:37:32.223063 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.222429    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33d808b5-315e-4d68-a3f8-c5a3fb98531a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz\" (UID: \"33d808b5-315e-4d68-a3f8-c5a3fb98531a\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz"
Oct 30 23:37:32.323523 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.323442    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33d808b5-315e-4d68-a3f8-c5a3fb98531a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz\" (UID: \"33d808b5-315e-4d68-a3f8-c5a3fb98531a\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz"
Oct 30 23:37:32.323715 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.323535    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlzwz\" (UniqueName: \"kubernetes.io/projected/33d808b5-315e-4d68-a3f8-c5a3fb98531a-kube-api-access-hlzwz\") pod \"payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz\" (UID: \"33d808b5-315e-4d68-a3f8-c5a3fb98531a\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz"
Oct 30 23:37:32.324146 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.324126    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33d808b5-315e-4d68-a3f8-c5a3fb98531a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz\" (UID: \"33d808b5-315e-4d68-a3f8-c5a3fb98531a\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz"
Oct 30 23:37:32.339722 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.339697    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlzwz\" (UniqueName: \"kubernetes.io/projected/33d808b5-315e-4d68-a3f8-c5a3fb98531a-kube-api-access-hlzwz\") pod \"payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz\" (UID: \"33d808b5-315e-4d68-a3f8-c5a3fb98531a\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz"
Oct 30 23:37:32.422813 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.422791    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz"
Oct 30 23:37:32.627433 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.627338    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:32.714956 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.714672    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz"]
Oct 30 23:37:32.725809 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:37:32.721130    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33d808b5_315e_4d68_a3f8_c5a3fb98531a.slice/crio-3204372fbdf09a66c5893227209a6f88979f75b8751e84c3abcf75d4c4e167c4 WatchSource:0}: Error finding container 3204372fbdf09a66c5893227209a6f88979f75b8751e84c3abcf75d4c4e167c4: Status 404 returned error can't find the container with id 3204372fbdf09a66c5893227209a6f88979f75b8751e84c3abcf75d4c4e167c4
Oct 30 23:37:32.778748 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.778709    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:32.827052 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.827013    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz" event={"ID":"33d808b5-315e-4d68-a3f8-c5a3fb98531a","Type":"ContainerStarted","Data":"79f557d890516eca96fd039ddec50562f44dd84c2cfb57651b6b5047d9646ad0"}
Oct 30 23:37:32.827181 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.827106    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz" event={"ID":"33d808b5-315e-4d68-a3f8-c5a3fb98531a","Type":"ContainerStarted","Data":"3204372fbdf09a66c5893227209a6f88979f75b8751e84c3abcf75d4c4e167c4"}
Oct 30 23:37:32.827181 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.827136    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz"
Oct 30 23:37:32.828720 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.828689    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf" event={"ID":"ce487838-fd5e-45c8-9cb9-b29e538ef744","Type":"ContainerStarted","Data":"31516b15a9ec482446300d16f31f4cfca6553a3f5a0896a61511e7d29930e07e"}
Oct 30 23:37:32.828839 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.828754    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"
Oct 30 23:37:32.828839 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.828779    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf" event={"ID":"ce487838-fd5e-45c8-9cb9-b29e538ef744","Type":"ContainerStarted","Data":"1ceb87cb19acd9c524134036179a63601a7b3eb95a0eba629a07b1648ce9fac4"}
Oct 30 23:37:32.847729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.847686    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz" podStartSLOduration=0.847673653 podStartE2EDuration="847.673653ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:37:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:32.846429312 +0000 UTC m=+1112.091285080" watchObservedRunningTime="2026-10-30 23:37:32.847673653 +0000 UTC m=+1112.092529399"
Oct 30 23:37:32.934053 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:32.934013    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:33.070821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:33.070787    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:33.198969 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:33.198887    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:33.754532 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:33.754482    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:33.833501 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:33.833445    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf" podStartSLOduration=2.412079191 podStartE2EDuration="2.833428748s" totalImagesPullingTime="421.349557ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:32.89006434 +0000 UTC m=+1112.134920111" watchObservedRunningTime="2026-10-30 23:37:33.833428748 +0000 UTC m=+1113.078284516"
Oct 30 23:37:33.834709 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:33.834682    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh"]
Oct 30 23:37:33.838906 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:33.838888    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh"
Oct 30 23:37:33.850684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:33.850663    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh"]
Oct 30 23:37:33.915219 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:33.915093    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:33.944051 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:33.944012    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-9ef03a-dockercfg-56bx9\""
Oct 30 23:37:33.944268 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:33.944123    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-9ef03a\""
Oct 30 23:37:33.950172 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:33.947216    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56c37261-af56-45b1-8dcf-60c89754d2f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh\" (UID: \"56c37261-af56-45b1-8dcf-60c89754d2f7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh"
Oct 30 23:37:33.950172 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:33.947482    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vxj2\" (UniqueName: \"kubernetes.io/projected/56c37261-af56-45b1-8dcf-60c89754d2f7-kube-api-access-6vxj2\") pod \"payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh\" (UID: \"56c37261-af56-45b1-8dcf-60c89754d2f7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh"
Oct 30 23:37:34.048549 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.048453    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vxj2\" (UniqueName: \"kubernetes.io/projected/56c37261-af56-45b1-8dcf-60c89754d2f7-kube-api-access-6vxj2\") pod \"payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh\" (UID: \"56c37261-af56-45b1-8dcf-60c89754d2f7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh"
Oct 30 23:37:34.048734 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.048618    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56c37261-af56-45b1-8dcf-60c89754d2f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh\" (UID: \"56c37261-af56-45b1-8dcf-60c89754d2f7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh"
Oct 30 23:37:34.049308 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.049290    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56c37261-af56-45b1-8dcf-60c89754d2f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh\" (UID: \"56c37261-af56-45b1-8dcf-60c89754d2f7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh"
Oct 30 23:37:34.060628 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.060578    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vxj2\" (UniqueName: \"kubernetes.io/projected/56c37261-af56-45b1-8dcf-60c89754d2f7-kube-api-access-6vxj2\") pod \"payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh\" (UID: \"56c37261-af56-45b1-8dcf-60c89754d2f7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh"
Oct 30 23:37:34.158233 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.158204    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh"
Oct 30 23:37:34.441973 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.441947    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh"]
Oct 30 23:37:34.444205 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:37:34.444176    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56c37261_af56_45b1_8dcf_60c89754d2f7.slice/crio-c207cb5026d73fcda2b294390e7d6b2466983283721852ecb8cacd31f1259980 WatchSource:0}: Error finding container c207cb5026d73fcda2b294390e7d6b2466983283721852ecb8cacd31f1259980: Status 404 returned error can't find the container with id c207cb5026d73fcda2b294390e7d6b2466983283721852ecb8cacd31f1259980
Oct 30 23:37:34.541002 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.540976    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:34.758192 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.758112    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:34.781864 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.781827    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr"]
Oct 30 23:37:34.786201 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.786181    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr"
Oct 30 23:37:34.804708 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.804686    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr"]
Oct 30 23:37:34.836757 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.836730    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-b567bb\""
Oct 30 23:37:34.836886 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.836860    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-b567bb-dockercfg-g2mjl\""
Oct 30 23:37:34.842903 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.842878    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh" event={"ID":"56c37261-af56-45b1-8dcf-60c89754d2f7","Type":"ContainerStarted","Data":"317f1c65d60b07c6996ea5c65984b5ff7f781c7409a5a4c7d59d1eca2622298c"}
Oct 30 23:37:34.843035 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.843021    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh"
Oct 30 23:37:34.843107 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.843045    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh" event={"ID":"56c37261-af56-45b1-8dcf-60c89754d2f7","Type":"ContainerStarted","Data":"c207cb5026d73fcda2b294390e7d6b2466983283721852ecb8cacd31f1259980"}
Oct 30 23:37:34.858437 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.858410    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b5gh\" (UniqueName: \"kubernetes.io/projected/e0f8155c-e961-4fec-9802-20e2ac4a0428-kube-api-access-6b5gh\") pod \"payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr\" (UID: \"e0f8155c-e961-4fec-9802-20e2ac4a0428\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr"
Oct 30 23:37:34.858552 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.858457    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0f8155c-e961-4fec-9802-20e2ac4a0428-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr\" (UID: \"e0f8155c-e961-4fec-9802-20e2ac4a0428\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr"
Oct 30 23:37:34.862958 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.862922    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh" podStartSLOduration=1.8629094959999999 podStartE2EDuration="1.862909496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:37:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:34.862087846 +0000 UTC m=+1114.106943615" watchObservedRunningTime="2026-10-30 23:37:34.862909496 +0000 UTC m=+1114.107765264"
Oct 30 23:37:34.936792 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.936739    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:34.959351 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.959315    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b5gh\" (UniqueName: \"kubernetes.io/projected/e0f8155c-e961-4fec-9802-20e2ac4a0428-kube-api-access-6b5gh\") pod \"payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr\" (UID: \"e0f8155c-e961-4fec-9802-20e2ac4a0428\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr"
Oct 30 23:37:34.959509 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.959405    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0f8155c-e961-4fec-9802-20e2ac4a0428-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr\" (UID: \"e0f8155c-e961-4fec-9802-20e2ac4a0428\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr"
Oct 30 23:37:34.960639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.960343    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0f8155c-e961-4fec-9802-20e2ac4a0428-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr\" (UID: \"e0f8155c-e961-4fec-9802-20e2ac4a0428\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr"
Oct 30 23:37:34.972536 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:34.972513    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b5gh\" (UniqueName: \"kubernetes.io/projected/e0f8155c-e961-4fec-9802-20e2ac4a0428-kube-api-access-6b5gh\") pod \"payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr\" (UID: \"e0f8155c-e961-4fec-9802-20e2ac4a0428\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr"
Oct 30 23:37:35.098874 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.098799    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr"
Oct 30 23:37:35.377130 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.377098    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr"]
Oct 30 23:37:35.379071 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:37:35.379040    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f8155c_e961_4fec_9802_20e2ac4a0428.slice/crio-50392a99dfc6e95d295ac7c7c81a6113fade122cf5c4bf808f809b3d4b4ef808 WatchSource:0}: Error finding container 50392a99dfc6e95d295ac7c7c81a6113fade122cf5c4bf808f809b3d4b4ef808: Status 404 returned error can't find the container with id 50392a99dfc6e95d295ac7c7c81a6113fade122cf5c4bf808f809b3d4b4ef808
Oct 30 23:37:35.433012 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.432984    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"]
Oct 30 23:37:35.437839 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.437814    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"
Oct 30 23:37:35.446999 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.446976    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w6-e15304-serving-cert\""
Oct 30 23:37:35.450051 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.450027    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"]
Oct 30 23:37:35.515549 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.515511    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:35.574748 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.574701    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fdf298d-3b1f-49d9-9893-2a145ededcbe-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd\" (UID: \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"
Oct 30 23:37:35.574748 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.574763    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fdf298d-3b1f-49d9-9893-2a145ededcbe-maas-api-tls\") pod \"maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd\" (UID: \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"
Oct 30 23:37:35.575226 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.574859    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdf298d-3b1f-49d9-9893-2a145ededcbe-metrics-certs\") pod \"maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd\" (UID: \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"
Oct 30 23:37:35.575226 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.574917    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4snx\" (UniqueName: \"kubernetes.io/projected/7fdf298d-3b1f-49d9-9893-2a145ededcbe-kube-api-access-d4snx\") pod \"maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd\" (UID: \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"
Oct 30 23:37:35.644493 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.644464    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:35.676158 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.676127    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fdf298d-3b1f-49d9-9893-2a145ededcbe-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd\" (UID: \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"
Oct 30 23:37:35.676158 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.676159    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fdf298d-3b1f-49d9-9893-2a145ededcbe-maas-api-tls\") pod \"maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd\" (UID: \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"
Oct 30 23:37:35.676354 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.676214    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdf298d-3b1f-49d9-9893-2a145ededcbe-metrics-certs\") pod \"maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd\" (UID: \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"
Oct 30 23:37:35.676354 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.676247    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4snx\" (UniqueName: \"kubernetes.io/projected/7fdf298d-3b1f-49d9-9893-2a145ededcbe-kube-api-access-d4snx\") pod \"maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd\" (UID: \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"
Oct 30 23:37:35.676963 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.676897    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fdf298d-3b1f-49d9-9893-2a145ededcbe-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd\" (UID: \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"
Oct 30 23:37:35.678805 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.678785    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fdf298d-3b1f-49d9-9893-2a145ededcbe-maas-api-tls\") pod \"maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd\" (UID: \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"
Oct 30 23:37:35.678905 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.678821    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdf298d-3b1f-49d9-9893-2a145ededcbe-metrics-certs\") pod \"maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd\" (UID: \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"
Oct 30 23:37:35.688339 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.688314    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4snx\" (UniqueName: \"kubernetes.io/projected/7fdf298d-3b1f-49d9-9893-2a145ededcbe-kube-api-access-d4snx\") pod \"maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd\" (UID: \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"
Oct 30 23:37:35.761800 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.761774    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"
Oct 30 23:37:35.770799 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.770772    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:35.850462 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.850426    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr" event={"ID":"e0f8155c-e961-4fec-9802-20e2ac4a0428","Type":"ContainerStarted","Data":"96beb12d375a35951f37465c6d9ae883b67a98efbebef88800ac7409c757dd49"}
Oct 30 23:37:35.850646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.850492    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr" event={"ID":"e0f8155c-e961-4fec-9802-20e2ac4a0428","Type":"ContainerStarted","Data":"50392a99dfc6e95d295ac7c7c81a6113fade122cf5c4bf808f809b3d4b4ef808"}
Oct 30 23:37:35.850646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.850522    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr"
Oct 30 23:37:35.870889 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:35.870848    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr" podStartSLOduration=1.8708343269999999 podStartE2EDuration="1.870834327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:37:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:35.869814521 +0000 UTC m=+1115.114670290" watchObservedRunningTime="2026-10-30 23:37:35.870834327 +0000 UTC m=+1115.115690096"
Oct 30 23:37:36.041071 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:36.041047    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"]
Oct 30 23:37:36.042664 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:37:36.042636    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fdf298d_3b1f_49d9_9893_2a145ededcbe.slice/crio-0182bf44ffd2a727d1ea6e5b94fb71efe2e260fbbb4c6b3c20ca3611b54485df WatchSource:0}: Error finding container 0182bf44ffd2a727d1ea6e5b94fb71efe2e260fbbb4c6b3c20ca3611b54485df: Status 404 returned error can't find the container with id 0182bf44ffd2a727d1ea6e5b94fb71efe2e260fbbb4c6b3c20ca3611b54485df
Oct 30 23:37:36.532797 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:36.532770    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:36.666622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:36.666572    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:36.857841 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:36.857749    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd" event={"ID":"7fdf298d-3b1f-49d9-9893-2a145ededcbe","Type":"ContainerStarted","Data":"a78c098395ee6e74c153958397f541464b966d52c21bb042d2fcd6c1d926d953"}
Oct 30 23:37:36.857841 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:36.857819    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd" event={"ID":"7fdf298d-3b1f-49d9-9893-2a145ededcbe","Type":"ContainerStarted","Data":"0182bf44ffd2a727d1ea6e5b94fb71efe2e260fbbb4c6b3c20ca3611b54485df"}
Oct 30 23:37:37.248892 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.248837    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd" podStartSLOduration=1.817193155 podStartE2EDuration="2.248821606s" totalImagesPullingTime="431.628451ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:36.888707665 +0000 UTC m=+1116.133563434" watchObservedRunningTime="2026-10-30 23:37:37.248821606 +0000 UTC m=+1116.493677373"
Oct 30 23:37:37.250768 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.250740    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"]
Oct 30 23:37:37.255082 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.255057    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"
Oct 30 23:37:37.263394 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.263373    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-d3dcca-serving-cert\""
Oct 30 23:37:37.266874 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.266806    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"]
Oct 30 23:37:37.341326 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.341288    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:37.395425 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.395384    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8069d118-e6cb-420b-9502-85918a0169ef-metrics-certs\") pod \"maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6\" (UID: \"8069d118-e6cb-420b-9502-85918a0169ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"
Oct 30 23:37:37.395655 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.395565    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8069d118-e6cb-420b-9502-85918a0169ef-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6\" (UID: \"8069d118-e6cb-420b-9502-85918a0169ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"
Oct 30 23:37:37.395760 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.395746    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xml4s\" (UniqueName: \"kubernetes.io/projected/8069d118-e6cb-420b-9502-85918a0169ef-kube-api-access-xml4s\") pod \"maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6\" (UID: \"8069d118-e6cb-420b-9502-85918a0169ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"
Oct 30 23:37:37.395804 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.395772    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8069d118-e6cb-420b-9502-85918a0169ef-maas-api-tls\") pod \"maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6\" (UID: \"8069d118-e6cb-420b-9502-85918a0169ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"
Oct 30 23:37:37.479371 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.479337    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:37.496658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.496631    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8069d118-e6cb-420b-9502-85918a0169ef-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6\" (UID: \"8069d118-e6cb-420b-9502-85918a0169ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"
Oct 30 23:37:37.496790 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.496743    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xml4s\" (UniqueName: \"kubernetes.io/projected/8069d118-e6cb-420b-9502-85918a0169ef-kube-api-access-xml4s\") pod \"maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6\" (UID: \"8069d118-e6cb-420b-9502-85918a0169ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"
Oct 30 23:37:37.496790 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.496769    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8069d118-e6cb-420b-9502-85918a0169ef-maas-api-tls\") pod \"maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6\" (UID: \"8069d118-e6cb-420b-9502-85918a0169ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"
Oct 30 23:37:37.496898 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.496801    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8069d118-e6cb-420b-9502-85918a0169ef-metrics-certs\") pod \"maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6\" (UID: \"8069d118-e6cb-420b-9502-85918a0169ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"
Oct 30 23:37:37.497259 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.497235    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8069d118-e6cb-420b-9502-85918a0169ef-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6\" (UID: \"8069d118-e6cb-420b-9502-85918a0169ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"
Oct 30 23:37:37.499486 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.499416    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8069d118-e6cb-420b-9502-85918a0169ef-maas-api-tls\") pod \"maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6\" (UID: \"8069d118-e6cb-420b-9502-85918a0169ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"
Oct 30 23:37:37.499486 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.499449    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8069d118-e6cb-420b-9502-85918a0169ef-metrics-certs\") pod \"maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6\" (UID: \"8069d118-e6cb-420b-9502-85918a0169ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"
Oct 30 23:37:37.509379 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.509353    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xml4s\" (UniqueName: \"kubernetes.io/projected/8069d118-e6cb-420b-9502-85918a0169ef-kube-api-access-xml4s\") pod \"maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6\" (UID: \"8069d118-e6cb-420b-9502-85918a0169ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"
Oct 30 23:37:37.569958 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.569930    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"
Oct 30 23:37:37.865573 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.860755    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"]
Oct 30 23:37:37.869913 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:37:37.869874    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8069d118_e6cb_420b_9502_85918a0169ef.slice/crio-1e144929c0121f67bb2a75c11d70bd5c53242720792ad519a9dbca75f4ef840b WatchSource:0}: Error finding container 1e144929c0121f67bb2a75c11d70bd5c53242720792ad519a9dbca75f4ef840b: Status 404 returned error can't find the container with id 1e144929c0121f67bb2a75c11d70bd5c53242720792ad519a9dbca75f4ef840b
Oct 30 23:37:37.878163 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:37.878127    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"
Oct 30 23:37:38.160691 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:38.160649    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:38.298629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:38.298577    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:38.841549 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:38.841476    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"
Oct 30 23:37:38.886257 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:38.886222    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6" event={"ID":"8069d118-e6cb-420b-9502-85918a0169ef","Type":"ContainerStarted","Data":"eba9a436ad375b8a45203c9a365f662b2ed42e8585e3f4c581a918240c861279"}
Oct 30 23:37:38.886448 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:38.886276    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6" event={"ID":"8069d118-e6cb-420b-9502-85918a0169ef","Type":"ContainerStarted","Data":"1e144929c0121f67bb2a75c11d70bd5c53242720792ad519a9dbca75f4ef840b"}
Oct 30 23:37:38.907147 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:38.907086    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6" podStartSLOduration=1.402934453 podStartE2EDuration="1.907066454s" totalImagesPullingTime="504.132001ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:38.906268862 +0000 UTC m=+1118.151124631" watchObservedRunningTime="2026-10-30 23:37:38.907066454 +0000 UTC m=+1118.151922223"
Oct 30 23:37:38.982060 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:38.982029    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:39.831067 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:39.831015    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:39.893721 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:39.893692    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"
Oct 30 23:37:40.039026 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:40.039000    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:40.193188 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:40.193151    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:40.785621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:40.781871    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:41.448464 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:37:41.448434    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:37:41.703707 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:41.703206    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:42.832521 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:42.832493    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7"
Oct 30 23:37:42.832961 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:42.832554    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b"
Oct 30 23:37:42.856488 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:42.856464    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:43.836237 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:43.836088    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:43.838714 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:43.838695    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz"
Oct 30 23:37:43.928062 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:43.928041    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"
Oct 30 23:37:44.054431 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:44.054395    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:44.499620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:44.499343    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:44.730620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:44.726018    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:44.906621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:44.905184    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:45.543230 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:45.543011    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:45.853267 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:45.853191    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh"
Oct 30 23:37:45.931653 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:45.931631    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"
Oct 30 23:37:46.599696 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:46.599497    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:46.861789 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:46.861711    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr"
Oct 30 23:37:46.918262 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:46.918228    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:48.095623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:48.094436    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:49.232536 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:49.232503    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:49.544402 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:49.544319    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:50.145714 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:50.145683    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:50.272927 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:50.272887    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:50.409393 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:50.409275    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:51.124047 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:51.123965    4921 generic.go:356] "Generic (PLEG): container finished" podID="9927a847-b4b7-4c22-a3df-3ac672c98c80" containerID="bb8e9bd8927cb8f947c376734c7b9fa9e463996704822f2ffe35ddbc870ea681" exitCode=0
Oct 30 23:37:51.124264 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:51.124085    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f" event={"ID":"9927a847-b4b7-4c22-a3df-3ac672c98c80","Type":"ContainerDied","Data":"bb8e9bd8927cb8f947c376734c7b9fa9e463996704822f2ffe35ddbc870ea681"}
Oct 30 23:37:51.124529 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:51.124508    4921 scope.go:122] "RemoveContainer" containerID="bb8e9bd8927cb8f947c376734c7b9fa9e463996704822f2ffe35ddbc870ea681"
Oct 30 23:37:51.126537 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:51.126111    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:51.126537 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:51.126184    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:51.126537 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:51.126223    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:51.127194 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:51.127174    4921 generic.go:356] "Generic (PLEG): container finished" podID="ac24a789-f285-4a46-8121-579b4b3bd264" containerID="2a2ee75c000b3efb7bb9999d43fa38bb14fa1affc510cdefa2362eb6f05034fe" exitCode=0
Oct 30 23:37:51.127307 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:51.127224    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q" event={"ID":"ac24a789-f285-4a46-8121-579b4b3bd264","Type":"ContainerDied","Data":"2a2ee75c000b3efb7bb9999d43fa38bb14fa1affc510cdefa2362eb6f05034fe"}
Oct 30 23:37:51.127731 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:51.127714    4921 scope.go:122] "RemoveContainer" containerID="2a2ee75c000b3efb7bb9999d43fa38bb14fa1affc510cdefa2362eb6f05034fe"
Oct 30 23:37:51.134997 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:51.129703    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:51.134997 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:51.129788    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:51.134997 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:51.129841    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:51.660355 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:51.660252    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:51.796617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:51.795714    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:52.135510 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:52.135477    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f" event={"ID":"9927a847-b4b7-4c22-a3df-3ac672c98c80","Type":"ContainerStarted","Data":"8ab8f13c021e91f3305c46ece6859d0ea17655f65f36c64fc4ad9c6b79c3c6ca"}
Oct 30 23:37:52.138118 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:52.138094    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q" event={"ID":"ac24a789-f285-4a46-8121-579b4b3bd264","Type":"ContainerStarted","Data":"326a1d400a1ba18e4d25e6a96703f5b4d479be493e1ba75844173e738a586ce5"}
Oct 30 23:37:52.621673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:52.620358    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:52.998510 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:52.998031    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:52.998510 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:52.998162    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 23:37:52.998510 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:52.998208    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f" podUID="9927a847-b4b7-4c22-a3df-3ac672c98c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 23:37:53.093049 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:53.092957    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:53.112621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:53.095274    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 30 23:37:53.112621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:53.095373    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q" podUID="ac24a789-f285-4a46-8121-579b4b3bd264" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 30 23:37:53.641543 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:53.641483    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:53.818943 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:53.818876    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:53.997824 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:53.997739    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 23:37:53.998166 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:53.998123    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f" podUID="9927a847-b4b7-4c22-a3df-3ac672c98c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 23:37:54.091623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:54.091021    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 30 23:37:54.091623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:54.091096    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q" podUID="ac24a789-f285-4a46-8121-579b4b3bd264" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 30 23:37:54.309694 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:54.303433    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:54.604658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:54.604474    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:54.927943 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:54.927852    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:55.015622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:55.010092    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 23:37:55.015622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:55.010164    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f" podUID="9927a847-b4b7-4c22-a3df-3ac672c98c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 23:37:55.083659 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:55.077073    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:55.097620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:55.092986    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 30 23:37:55.097620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:55.093043    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q" podUID="ac24a789-f285-4a46-8121-579b4b3bd264" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 30 23:37:55.255504 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:55.255357    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:55.421370 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:55.421336    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:55.849870 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:55.849802    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:55.996652 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:55.996114    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:55.996652 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:55.996217    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 23:37:55.996652 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:55.996259    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f" podUID="9927a847-b4b7-4c22-a3df-3ac672c98c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 23:37:56.091406 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:56.091287    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 30 23:37:56.091406 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:56.091347    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q" podUID="ac24a789-f285-4a46-8121-579b4b3bd264" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 30 23:37:56.652975 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:56.652921    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:57.007675 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:57.007341    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 23:37:57.007675 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:57.007396    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f" podUID="9927a847-b4b7-4c22-a3df-3ac672c98c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 23:37:57.096620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:57.096002    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 30 23:37:57.096620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:57.096067    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q" podUID="ac24a789-f285-4a46-8121-579b4b3bd264" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 30 23:37:57.629617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:57.624977    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:57.803625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:57.799997    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:57.808823 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:57.805271    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:57.936149 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:57.936113    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": read tcp 10.132.0.2:50664->10.132.0.52:15021: read: connection reset by peer" start-of-body=
Oct 30 23:37:57.936374 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:57.936346    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j" podUID="b14e7bdd-df95-4c34-958c-3b023b9596fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": read tcp 10.132.0.2:50664->10.132.0.52:15021: read: connection reset by peer"
Oct 30 23:37:57.988620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:57.982932    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:58.108202 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:58.107893    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:58.221456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:58.221289    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:58.247790 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:58.247759    4921 generic.go:356] "Generic (PLEG): container finished" podID="b14e7bdd-df95-4c34-958c-3b023b9596fa" containerID="155ae7b14a7fbbcfce77b8477fbc890696ca53c7621572c4f25b970678bcbe74" exitCode=0
Oct 30 23:37:58.247958 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:58.247830    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j" event={"ID":"b14e7bdd-df95-4c34-958c-3b023b9596fa","Type":"ContainerDied","Data":"155ae7b14a7fbbcfce77b8477fbc890696ca53c7621572c4f25b970678bcbe74"}
Oct 30 23:37:58.248358 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:58.248335    4921 scope.go:122] "RemoveContainer" containerID="155ae7b14a7fbbcfce77b8477fbc890696ca53c7621572c4f25b970678bcbe74"
Oct 30 23:37:58.249063 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:58.249041    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 30 23:37:58.249177 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:58.249164    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 30 23:37:58.250239 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:58.250207    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:58.250319 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:58.250281    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:58.250319 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:58.250314    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:37:59.187642 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:59.187290    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:37:59.260617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:59.260281    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j" event={"ID":"b14e7bdd-df95-4c34-958c-3b023b9596fa","Type":"ContainerStarted","Data":"1bbabf31c888e9aea6dc43ed91e1adbaaf1eeb15ab9f1bf13f38a0b5effd33de"}
Oct 30 23:37:59.624670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:59.623779    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:37:59.624670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:59.624224    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Oct 30 23:37:59.624670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:59.624299    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j" podUID="b14e7bdd-df95-4c34-958c-3b023b9596fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Oct 30 23:37:59.821118 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:37:59.820899    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:00.116631 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:00.114251    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:00.249982 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:00.249935    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:00.432381 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:00.432354    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:00.592112 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:00.592040    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:00.613073 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:00.613035    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Oct 30 23:38:00.613356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:00.613328    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j" podUID="b14e7bdd-df95-4c34-958c-3b023b9596fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Oct 30 23:38:00.794274 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:00.794234    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:00.933908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:00.933875    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:01.369735 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:01.365885    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:01.612934 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:01.612898    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Oct 30 23:38:01.613133 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:01.612952    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j" podUID="b14e7bdd-df95-4c34-958c-3b023b9596fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Oct 30 23:38:01.842093 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:01.842054    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"]
Oct 30 23:38:01.848673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:01.848648    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:01.859901 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:01.859701    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-b567bb\"/\"default-dockercfg-jtbmr\""
Oct 30 23:38:01.859901 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:01.859861    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-b567bb\"/\"simulator-w3-b567bb-kserve-self-signed-certs\""
Oct 30 23:38:01.860121 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:01.859953    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"]
Oct 30 23:38:01.919946 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:01.919901    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-tmp-dir\") pod \"simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") " pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:01.920218 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:01.920189    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/288e6fd4-35b6-4452-8069-0f22ad2c094b-tls-certs\") pod \"simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") " pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:01.920334 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:01.920234    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htmbw\" (UniqueName: \"kubernetes.io/projected/288e6fd4-35b6-4452-8069-0f22ad2c094b-kube-api-access-htmbw\") pod \"simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") " pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:01.920479 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:01.920455    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-dshm\") pod \"simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") " pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:01.920633 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:01.920586    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-model-cache\") pod \"simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") " pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:01.920709 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:01.920690    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-home\") pod \"simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") " pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:01.938050 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:01.938023    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:01.945168 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:01.945145    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-b567bb\"/\"kube-root-ca.crt\""
Oct 30 23:38:01.945168 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:01.945157    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-b567bb\"/\"openshift-service-ca.crt\""
Oct 30 23:38:02.021815 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:02.021775    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-dshm\") pod \"simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") " pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:02.022013 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:02.021845    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-model-cache\") pod \"simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") " pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:02.022013 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:02.021899    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-home\") pod \"simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") " pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:02.022013 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:02.021989    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-tmp-dir\") pod \"simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") " pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:02.022013 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:02.022010    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/288e6fd4-35b6-4452-8069-0f22ad2c094b-tls-certs\") pod \"simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") " pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:02.022226 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:02.022033    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htmbw\" (UniqueName: \"kubernetes.io/projected/288e6fd4-35b6-4452-8069-0f22ad2c094b-kube-api-access-htmbw\") pod \"simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") " pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:02.025930 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:02.023917    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-home\") pod \"simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") " pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:02.057637 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:02.057571    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-model-cache\") pod \"simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") " pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:02.057970 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:02.057673    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-tmp-dir\") pod \"simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") " pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:02.064438 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:02.064405    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/288e6fd4-35b6-4452-8069-0f22ad2c094b-tls-certs\") pod \"simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") " pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:02.086638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:02.068915    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-dshm\") pod \"simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") " pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:02.087450 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:02.087418    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htmbw\" (UniqueName: \"kubernetes.io/projected/288e6fd4-35b6-4452-8069-0f22ad2c094b-kube-api-access-htmbw\") pod \"simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") " pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:02.203855 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:02.203813    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:02.313105 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:02.313070    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:02.503901 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:02.503518    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"]
Oct 30 23:38:02.506883 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:38:02.506854    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod288e6fd4_35b6_4452_8069_0f22ad2c094b.slice/crio-71f448b6e4f6ebe40f72a803366011debcb7628d18f3e4f6e154e53a61915011 WatchSource:0}: Error finding container 71f448b6e4f6ebe40f72a803366011debcb7628d18f3e4f6e154e53a61915011: Status 404 returned error can't find the container with id 71f448b6e4f6ebe40f72a803366011debcb7628d18f3e4f6e154e53a61915011
Oct 30 23:38:02.612489 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:02.612197    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Oct 30 23:38:02.612489 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:02.612236    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j" podUID="b14e7bdd-df95-4c34-958c-3b023b9596fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Oct 30 23:38:03.208253 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:03.208202    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:03.316625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:03.316576    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" event={"ID":"288e6fd4-35b6-4452-8069-0f22ad2c094b","Type":"ContainerStarted","Data":"33efad03ffeb7081e49c2b7353a9441c9e99bbd1589fb27d409360f5c746bf06"}
Oct 30 23:38:03.316812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:03.316640    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" event={"ID":"288e6fd4-35b6-4452-8069-0f22ad2c094b","Type":"ContainerStarted","Data":"71f448b6e4f6ebe40f72a803366011debcb7628d18f3e4f6e154e53a61915011"}
Oct 30 23:38:03.340496 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:03.340445    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podStartSLOduration=2.340431495 podStartE2EDuration="2.340431495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:38:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:38:03.337985542 +0000 UTC m=+1142.582841313" watchObservedRunningTime="2026-10-30 23:38:03.340431495 +0000 UTC m=+1142.585287263"
Oct 30 23:38:03.612211 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:03.612119    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Oct 30 23:38:03.612211 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:03.612175    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j" podUID="b14e7bdd-df95-4c34-958c-3b023b9596fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Oct 30 23:38:04.183716 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:04.183665    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:04.204825 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:04.203978    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:04.623673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:04.620801    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:38:04.623673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:04.621558    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:38:04.623673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:04.622759    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 30 23:38:05.054966 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:05.054935    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:05.914527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:05.914482    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:06.336301 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:06.336221    4921 generic.go:356] "Generic (PLEG): container finished" podID="22dee8ec-69c0-4889-adb1-8ecde0d7b66a" containerID="7aec0905983c2beab328983940a6b63cf5af50eb687ae8243ea62949632366f2" exitCode=0
Oct 30 23:38:06.336301 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:06.336296    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td" event={"ID":"22dee8ec-69c0-4889-adb1-8ecde0d7b66a","Type":"ContainerDied","Data":"7aec0905983c2beab328983940a6b63cf5af50eb687ae8243ea62949632366f2"}
Oct 30 23:38:06.336889 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:06.336861    4921 scope.go:122] "RemoveContainer" containerID="7aec0905983c2beab328983940a6b63cf5af50eb687ae8243ea62949632366f2"
Oct 30 23:38:06.338232 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:06.338200    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:38:06.338325 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:06.338266    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:38:06.338325 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:06.338299    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:38:06.641383 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:06.641346    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:06.798000 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:06.797012    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:07.343809 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:07.343766    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td" event={"ID":"22dee8ec-69c0-4889-adb1-8ecde0d7b66a","Type":"ContainerStarted","Data":"19915ae7629493778d44bd2dbec4319b6d0091ac56fd165f1f53090f409208cc"}
Oct 30 23:38:07.536016 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:07.535983    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:07.704071 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:07.704035    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:38:07.704265 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:07.704242    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 23:38:07.704318 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:07.704286    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td" podUID="22dee8ec-69c0-4889-adb1-8ecde0d7b66a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 23:38:08.345554 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:08.345516    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:08.704102 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:08.704068    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 23:38:08.704292 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:08.704124    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td" podUID="22dee8ec-69c0-4889-adb1-8ecde0d7b66a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 23:38:09.148846 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:09.148817    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:09.704153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:09.704116    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 23:38:09.704708 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:09.704185    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td" podUID="22dee8ec-69c0-4889-adb1-8ecde0d7b66a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 23:38:10.052041 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:10.051960    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:10.704147 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:10.704105    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 23:38:10.704346 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:10.704175    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td" podUID="22dee8ec-69c0-4889-adb1-8ecde0d7b66a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 23:38:10.948972 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:10.948944    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:11.438501 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:38:11.438473    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:38:11.588584 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:11.588545    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:11.707057 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:11.706971    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 23:38:11.707670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:11.707633    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td" podUID="22dee8ec-69c0-4889-adb1-8ecde0d7b66a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 23:38:12.050252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:12.050172    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:12.204736 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:12.204704    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:12.217292 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:12.217268    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:12.386841 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:12.386813    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:38:12.708507 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:12.708428    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:38:12.708912 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:12.708854    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:38:12.709472 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:12.709455    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 30 23:38:13.023660 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:13.023533    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:13.722347 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:13.722308    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:14.423685 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:14.423648    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:15.113980 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.113949    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:15.189471 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.189435    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"]
Oct 30 23:38:15.195776 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.195752    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.202150 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.201295    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-dd3a15\"/\"premium-w5-dd3a15-kserve-self-signed-certs\""
Oct 30 23:38:15.205865 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.205844    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-dd3a15\"/\"openshift-service-ca.crt\""
Oct 30 23:38:15.206016 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.205988    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-dd3a15\"/\"kube-root-ca.crt\""
Oct 30 23:38:15.206202 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.206083    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-dd3a15\"/\"default-dockercfg-ftrjj\""
Oct 30 23:38:15.209172 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.209149    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"]
Oct 30 23:38:15.280099 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.280070    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-tls-certs\") pod \"premium-w5-dd3a15-kserve-6fc9b957dc-szdrr\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") " pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.280243 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.280109    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b2h7\" (UniqueName: \"kubernetes.io/projected/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-kube-api-access-5b2h7\") pod \"premium-w5-dd3a15-kserve-6fc9b957dc-szdrr\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") " pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.280243 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.280142    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-model-cache\") pod \"premium-w5-dd3a15-kserve-6fc9b957dc-szdrr\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") " pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.280326 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.280281    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-dshm\") pod \"premium-w5-dd3a15-kserve-6fc9b957dc-szdrr\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") " pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.280378 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.280325    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-tmp-dir\") pod \"premium-w5-dd3a15-kserve-6fc9b957dc-szdrr\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") " pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.280378 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.280343    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-home\") pod \"premium-w5-dd3a15-kserve-6fc9b957dc-szdrr\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") " pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.284719 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.284687    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:15.381465 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.381025    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-tls-certs\") pod \"premium-w5-dd3a15-kserve-6fc9b957dc-szdrr\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") " pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.381465 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.381080    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b2h7\" (UniqueName: \"kubernetes.io/projected/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-kube-api-access-5b2h7\") pod \"premium-w5-dd3a15-kserve-6fc9b957dc-szdrr\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") " pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.381465 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.381132    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-model-cache\") pod \"premium-w5-dd3a15-kserve-6fc9b957dc-szdrr\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") " pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.381465 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.381174    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-dshm\") pod \"premium-w5-dd3a15-kserve-6fc9b957dc-szdrr\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") " pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.381465 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.381219    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-tmp-dir\") pod \"premium-w5-dd3a15-kserve-6fc9b957dc-szdrr\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") " pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.381465 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.381242    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-home\") pod \"premium-w5-dd3a15-kserve-6fc9b957dc-szdrr\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") " pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.381922 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.381761    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-home\") pod \"premium-w5-dd3a15-kserve-6fc9b957dc-szdrr\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") " pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.382865 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.382835    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-model-cache\") pod \"premium-w5-dd3a15-kserve-6fc9b957dc-szdrr\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") " pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.385968 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.385941    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-tmp-dir\") pod \"premium-w5-dd3a15-kserve-6fc9b957dc-szdrr\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") " pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.386174 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.386151    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-dshm\") pod \"premium-w5-dd3a15-kserve-6fc9b957dc-szdrr\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") " pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.386486 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.386454    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-tls-certs\") pod \"premium-w5-dd3a15-kserve-6fc9b957dc-szdrr\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") " pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.396262 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.396242    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b2h7\" (UniqueName: \"kubernetes.io/projected/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-kube-api-access-5b2h7\") pod \"premium-w5-dd3a15-kserve-6fc9b957dc-szdrr\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") " pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.512182 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.512148    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:15.788775 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.788750    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"]
Oct 30 23:38:15.790952 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:38:15.790924    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d920e12_0adb_4c9b_9e43_0c22f9b9f5f2.slice/crio-b9d569029718bbf8b2d8f21f18073530a78f277596f3e9e47a44e5b07291cf83 WatchSource:0}: Error finding container b9d569029718bbf8b2d8f21f18073530a78f277596f3e9e47a44e5b07291cf83: Status 404 returned error can't find the container with id b9d569029718bbf8b2d8f21f18073530a78f277596f3e9e47a44e5b07291cf83
Oct 30 23:38:15.826974 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:15.826948    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:16.410647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:16.410284    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" event={"ID":"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2","Type":"ContainerStarted","Data":"42f8965ee9c68532b35099a8f2594444465e07bae34210bbde84c246e4be6d20"}
Oct 30 23:38:16.410647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:16.410361    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" event={"ID":"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2","Type":"ContainerStarted","Data":"b9d569029718bbf8b2d8f21f18073530a78f277596f3e9e47a44e5b07291cf83"}
Oct 30 23:38:16.432713 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:16.432232    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podStartSLOduration=1.432214127 podStartE2EDuration="1.432214127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:38:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:38:16.431309763 +0000 UTC m=+1155.676165534" watchObservedRunningTime="2026-10-30 23:38:16.432214127 +0000 UTC m=+1155.677069897"
Oct 30 23:38:16.512668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:16.512636    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:16.723902 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:16.723809    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:17.633208 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:17.633174    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:18.422271 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:18.422239    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:19.080958 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:19.080922    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:19.740518 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:19.740487    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:20.401370 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:20.401338    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:21.196895 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:21.196862    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:21.965382 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:21.965340    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:22.360378 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:22.360288    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:22.756991 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:22.756957    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:23.560770 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:23.560739    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:24.316973 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:24.316943    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:25.094361 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:25.094330    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:25.512932 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:25.512903    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:25.525726 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:25.525705    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:25.827050 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:25.826970    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:26.132289 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.132208    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"]
Oct 30 23:38:26.136932 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.136901    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.145103 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.145056    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-e15304\"/\"openshift-service-ca.crt\""
Oct 30 23:38:26.145103 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.145091    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-e15304\"/\"kube-root-ca.crt\""
Oct 30 23:38:26.146755 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.146705    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-e15304\"/\"premium-w6-e15304-kserve-self-signed-certs\""
Oct 30 23:38:26.147036 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.146826    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-e15304\"/\"default-dockercfg-l9wjz\""
Oct 30 23:38:26.149286 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.149263    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"]
Oct 30 23:38:26.205577 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.205545    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-home\") pod \"premium-w6-e15304-kserve-677d889694-h2rwr\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") " pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.205577 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.205588    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-dshm\") pod \"premium-w6-e15304-kserve-677d889694-h2rwr\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") " pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.205809 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.205713    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-442kj\" (UniqueName: \"kubernetes.io/projected/cf659c67-7154-40fe-b07a-423e271d8d7b-kube-api-access-442kj\") pod \"premium-w6-e15304-kserve-677d889694-h2rwr\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") " pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.205809 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.205761    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-tmp-dir\") pod \"premium-w6-e15304-kserve-677d889694-h2rwr\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") " pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.205880 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.205848    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-model-cache\") pod \"premium-w6-e15304-kserve-677d889694-h2rwr\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") " pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.205880 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.205876    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf659c67-7154-40fe-b07a-423e271d8d7b-tls-certs\") pod \"premium-w6-e15304-kserve-677d889694-h2rwr\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") " pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.212852 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.212801    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:26.306913 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.306877    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-home\") pod \"premium-w6-e15304-kserve-677d889694-h2rwr\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") " pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.307232 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.306932    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-dshm\") pod \"premium-w6-e15304-kserve-677d889694-h2rwr\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") " pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.307232 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.306964    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-442kj\" (UniqueName: \"kubernetes.io/projected/cf659c67-7154-40fe-b07a-423e271d8d7b-kube-api-access-442kj\") pod \"premium-w6-e15304-kserve-677d889694-h2rwr\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") " pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.307232 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.307012    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-tmp-dir\") pod \"premium-w6-e15304-kserve-677d889694-h2rwr\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") " pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.307232 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.307058    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-model-cache\") pod \"premium-w6-e15304-kserve-677d889694-h2rwr\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") " pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.307232 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.307081    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf659c67-7154-40fe-b07a-423e271d8d7b-tls-certs\") pod \"premium-w6-e15304-kserve-677d889694-h2rwr\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") " pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.308053 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.307965    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-tmp-dir\") pod \"premium-w6-e15304-kserve-677d889694-h2rwr\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") " pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.308344 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.308282    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-model-cache\") pod \"premium-w6-e15304-kserve-677d889694-h2rwr\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") " pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.308687 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.308666    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-home\") pod \"premium-w6-e15304-kserve-677d889694-h2rwr\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") " pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.310914 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.310847    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-dshm\") pod \"premium-w6-e15304-kserve-677d889694-h2rwr\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") " pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.311019 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.310943    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf659c67-7154-40fe-b07a-423e271d8d7b-tls-certs\") pod \"premium-w6-e15304-kserve-677d889694-h2rwr\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") " pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.319857 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.319837    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-442kj\" (UniqueName: \"kubernetes.io/projected/cf659c67-7154-40fe-b07a-423e271d8d7b-kube-api-access-442kj\") pod \"premium-w6-e15304-kserve-677d889694-h2rwr\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") " pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.451976 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.451946    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:26.519186 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.519136    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:38:26.640501 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.640443    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:26.735538 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:26.735512    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"]
Oct 30 23:38:26.737114 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:38:26.737090    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf659c67_7154_40fe_b07a_423e271d8d7b.slice/crio-afba1ae32d2de570069103dbcca90320c3619e3a203daf284a1550c51ddc4067 WatchSource:0}: Error finding container afba1ae32d2de570069103dbcca90320c3619e3a203daf284a1550c51ddc4067: Status 404 returned error can't find the container with id afba1ae32d2de570069103dbcca90320c3619e3a203daf284a1550c51ddc4067
Oct 30 23:38:27.357545 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:27.357317    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:27.509969 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:27.509934    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" event={"ID":"cf659c67-7154-40fe-b07a-423e271d8d7b","Type":"ContainerStarted","Data":"0e8ebd4fbc01afad69dcf9067073f76eaf66d4af84bf7e6e5e70d1afa24419d5"}
Oct 30 23:38:27.510155 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:27.509982    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" event={"ID":"cf659c67-7154-40fe-b07a-423e271d8d7b","Type":"ContainerStarted","Data":"afba1ae32d2de570069103dbcca90320c3619e3a203daf284a1550c51ddc4067"}
Oct 30 23:38:27.533059 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:27.533008    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podStartSLOduration=1.532995 podStartE2EDuration="1.532995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:38:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:38:27.53172933 +0000 UTC m=+1166.776585109" watchObservedRunningTime="2026-10-30 23:38:27.532995 +0000 UTC m=+1166.777850768"
Oct 30 23:38:28.150315 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:28.150272    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:28.270882 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:28.270817    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:28.452714 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:28.452647    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:28.826270 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:28.826186    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:29.215982 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:29.215953    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:29.626294 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:29.626209    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:30.633055 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:30.633020    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:31.325584 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:31.325493    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:32.116178 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:32.116142    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:32.807039 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:32.807005    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:33.136792 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:33.136760    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:33.750497 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:33.750437    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:34.436070 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:34.436038    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:35.228255 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:35.228226    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:36.140072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:36.140017    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:36.452339 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:36.452243    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:36.483450 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:36.483390    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:36.590368 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:36.590330    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:38:37.133021 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:37.132989    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:37.847620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:37.844372    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:38.628298 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:38.628267    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:39.434105 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:39.434070    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:40.131990 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.131959    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:40.701704 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.701665    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"]
Oct 30 23:38:40.707832 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.707806    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.717797 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.717774    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"]
Oct 30 23:38:40.729051 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.729030    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-611ef3-openshift-default-dockercfg-gcsfx\""
Oct 30 23:38:40.790695 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.790658    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8kd4\" (UniqueName: \"kubernetes.io/projected/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-kube-api-access-v8kd4\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.790853 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.790700    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-podinfo\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.790853 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.790816    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-data\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.790953 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.790868    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-credential-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.790953 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.790939    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-envoy\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.791048 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.790975    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-workload-certs\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.791101 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.791088    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-workload-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.791136 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.791113    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-token\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.791181 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.791135    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istiod-ca-cert\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.892692 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.892663    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-credential-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.892861 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.892699    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-envoy\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.892861 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.892719    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-workload-certs\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.892861 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.892791    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-workload-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.892861 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.892808    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-token\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.892861 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.892829    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istiod-ca-cert\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.892861 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.892858    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8kd4\" (UniqueName: \"kubernetes.io/projected/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-kube-api-access-v8kd4\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.893126 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.892884    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-podinfo\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.893126 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.892967    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-data\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.893232 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.893120    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-credential-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.893232 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.893163    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-workload-certs\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.893368 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.893350    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-workload-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.893430 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.893368    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-data\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.893907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.893880    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istiod-ca-cert\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.895235 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.895214    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-envoy\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.895709 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.895691    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-podinfo\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.905184 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.905166    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8kd4\" (UniqueName: \"kubernetes.io/projected/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-kube-api-access-v8kd4\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.905275 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.905236    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-token\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:40.968670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:40.968202    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:41.024337 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:41.024310    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:41.312411 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:41.312379    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"]
Oct 30 23:38:41.313894 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:38:41.313865    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf45a5b30_d79d_4f87_bd68_9d4b089c0c3e.slice/crio-c8895079260e473fae27b495f6cb46877b3358374a96d9afa50d60d18740ae09 WatchSource:0}: Error finding container c8895079260e473fae27b495f6cb46877b3358374a96d9afa50d60d18740ae09: Status 404 returned error can't find the container with id c8895079260e473fae27b495f6cb46877b3358374a96d9afa50d60d18740ae09
Oct 30 23:38:41.317458 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:41.317420    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:38:41.317554 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:41.317495    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:38:41.317554 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:41.317527    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:38:41.411832 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:41.411800    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:41.411832 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:38:41.411816    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:38:41.592359 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:41.592261    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6" event={"ID":"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e","Type":"ContainerStarted","Data":"6bb3f47cce75396b7f979a3434cacd060e978a9e2564a8a3a53d749f0a3a8a8b"}
Oct 30 23:38:41.592359 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:41.592332    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6" event={"ID":"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e","Type":"ContainerStarted","Data":"c8895079260e473fae27b495f6cb46877b3358374a96d9afa50d60d18740ae09"}
Oct 30 23:38:41.618513 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:41.618464    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6" podStartSLOduration=1.6184503879999999 podStartE2EDuration="1.618450388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:38:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:38:41.615531218 +0000 UTC m=+1180.860386967" watchObservedRunningTime="2026-10-30 23:38:41.618450388 +0000 UTC m=+1180.863306156"
Oct 30 23:38:41.742652 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:41.742620    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:42.024742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:42.024709    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:42.026367 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:42.026344    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 23:38:42.026489 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:42.026398    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6" podUID="f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 23:38:42.524442 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:42.524395    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:43.025061 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:43.025029    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 23:38:43.025471 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:43.025081    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6" podUID="f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 23:38:43.691620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:43.690989    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:44.025328 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:44.025251    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 23:38:44.025328 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:44.025310    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6" podUID="f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 23:38:44.442371 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:44.442335    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:45.024903 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:45.024873    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 23:38:45.025095 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:45.024922    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6" podUID="f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 23:38:45.346943 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:45.346851    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:46.025550 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:46.025511    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 23:38:46.025756 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:46.025575    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6" podUID="f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 23:38:46.260379 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:46.260334    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:47.025157 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:47.025110    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 23:38:47.025566 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:47.025163    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6" podUID="f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 23:38:47.402046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:47.402016    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:48.025358 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:48.025327    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 23:38:48.025830 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:48.025379    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6" podUID="f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 23:38:48.238976 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:48.238933    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:48.968268 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:48.968234    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:49.114934 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:49.114901    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:49.115428 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:49.115398    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:49.117259 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:49.117233    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:38:49.725128 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:49.725096    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:50.429097 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:50.429067    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:51.141866 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:51.141801    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:51.814949 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:51.814903    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:51.944188 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:51.944149    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:52.658165 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:52.658070    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:53.621871 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:53.621838    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:54.235858 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:54.235827    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:55.214088 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:55.214059    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:55.944116 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:55.944083    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:56.842576 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:56.842529    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:57.544621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:57.544560    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:58.243588 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:58.243552    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:58.936297 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:58.936265    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:38:59.639324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:38:59.639283    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:00.332299 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:00.332266    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:01.002777 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:01.002749    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 30 23:39:01.005252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:01.005228    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 30 23:39:01.141316 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:01.141284    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:02.073656 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:02.073318    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:03.018484 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:03.018450    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:03.725253 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:03.725214    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:04.440862 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:04.440826    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:05.510849 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:05.510805    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:06.433237 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:06.433198    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:07.276292 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:07.276259    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:08.107565 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:08.107527    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:08.842193 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:08.842155    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:09.539537 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:09.539501    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:10.347520 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:10.347478    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:11.112397 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:11.112354    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:11.404676 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:39:11.404637    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:39:11.941356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:11.941323    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:12.904285 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:12.904247    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:13.613504 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:13.613470    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:14.417680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:14.417652    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:15.136242 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:15.136207    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:15.899155 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:15.899119    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:16.636647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:16.636616    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:17.347006 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:17.346976    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:18.127071 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:18.127034    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:18.945487 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:18.945448    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:19.730985 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:19.730953    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:20.432816 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:20.432786    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:21.159620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:21.154020    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:21.830170 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:21.830129    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:22.533505 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:22.533471    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:23.222819 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:23.222787    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:23.924431 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:23.924403    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:24.643850 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:24.643808    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:25.341078 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:25.341042    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:26.148852 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:26.148818    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:26.940970 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:26.940938    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:27.719373 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:27.719341    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:28.441082 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:28.441049    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:29.213778 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:29.213745    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:30.080160 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:30.080129    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:30.923049 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:30.923017    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:31.890562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:31.890529    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:32.718834 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:32.718793    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:33.544534 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:33.544495    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:34.485783 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:34.485754    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:35.203145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:35.203111    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:35.923345 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:35.923311    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:36.633440 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:36.633406    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:37.464827 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:37.464795    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:38.341866 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:38.341829    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:39.023014 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:39.022972    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:39.719047 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:39.719014    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:40.445273 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.445225    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:40.673695 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.673657    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"]
Oct 30 23:39:40.679015 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.678994    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.686852 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.686306    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-dd3a15-openshift-default-dockercfg-72cjz\""
Oct 30 23:39:40.689808 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.689785    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"]
Oct 30 23:39:40.809947 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.809862    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-token\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.809947 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.809918    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-credential-socket\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.810153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.810078    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da75f51e-ddb3-40a1-b475-b252bc8954d0-istiod-ca-cert\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.810153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.810135    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-podinfo\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.810278 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.810189    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-workload-socket\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.810338 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.810278    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnxq5\" (UniqueName: \"kubernetes.io/projected/da75f51e-ddb3-40a1-b475-b252bc8954d0-kube-api-access-tnxq5\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.810414 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.810390    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-envoy\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.810474 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.810425    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-data\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.810474 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.810458    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-workload-certs\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.911993 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.911964    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-token\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.912190 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.912003    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-credential-socket\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.912190 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.912068    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da75f51e-ddb3-40a1-b475-b252bc8954d0-istiod-ca-cert\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.912190 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.912098    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-podinfo\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.912190 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.912147    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-workload-socket\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.912190 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.912177    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnxq5\" (UniqueName: \"kubernetes.io/projected/da75f51e-ddb3-40a1-b475-b252bc8954d0-kube-api-access-tnxq5\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.912463 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.912262    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-envoy\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.912463 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.912285    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-data\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.912580 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.912520    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-credential-socket\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.912580 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.912571    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-workload-certs\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.912732 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.912643    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-workload-socket\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.912732 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.912692    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-data\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.912903 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.912879    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-workload-certs\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.912957 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.912936    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da75f51e-ddb3-40a1-b475-b252bc8954d0-istiod-ca-cert\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.914671 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.914649    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-envoy\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.914939 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.914919    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-podinfo\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.927130 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.927105    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-token\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.927257 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.927224    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnxq5\" (UniqueName: \"kubernetes.io/projected/da75f51e-ddb3-40a1-b475-b252bc8954d0-kube-api-access-tnxq5\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:40.994659 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:40.994623    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:41.281909 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:41.281881    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"]
Oct 30 23:39:41.283084 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:39:41.283047    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda75f51e_ddb3_40a1_b475_b252bc8954d0.slice/crio-05e146197064b0842d2b4cec6b46d69536f4f5d28ba1dfbdc812adb4cb6ea096 WatchSource:0}: Error finding container 05e146197064b0842d2b4cec6b46d69536f4f5d28ba1dfbdc812adb4cb6ea096: Status 404 returned error can't find the container with id 05e146197064b0842d2b4cec6b46d69536f4f5d28ba1dfbdc812adb4cb6ea096
Oct 30 23:39:41.285646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:41.285580    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:39:41.285750 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:41.285692    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:39:41.285750 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:41.285737    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:39:41.341860 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:41.340498    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:41.436878 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:39:41.436831    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:39:42.018639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:42.018572    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg" event={"ID":"da75f51e-ddb3-40a1-b475-b252bc8954d0","Type":"ContainerStarted","Data":"60703ce96b2004c0bb39637852042a7132bdd7632988b621e8ed1a4d737e1658"}
Oct 30 23:39:42.019057 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:42.018652    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg" event={"ID":"da75f51e-ddb3-40a1-b475-b252bc8954d0","Type":"ContainerStarted","Data":"05e146197064b0842d2b4cec6b46d69536f4f5d28ba1dfbdc812adb4cb6ea096"}
Oct 30 23:39:42.044022 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:42.043968    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg" podStartSLOduration=2.043953973 podStartE2EDuration="2.043953973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:39:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:39:42.041772934 +0000 UTC m=+1241.286628702" watchObservedRunningTime="2026-10-30 23:39:42.043953973 +0000 UTC m=+1241.288809741"
Oct 30 23:39:42.103628 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:42.103249    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:42.994922 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:42.994887    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:42.996694 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:42.996660    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 30 23:39:42.996826 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:42.996725    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg" podUID="da75f51e-ddb3-40a1-b475-b252bc8954d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 30 23:39:43.030098 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:43.030072    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:43.857647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:43.857613    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:44.000729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:43.996771    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 30 23:39:44.000729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:43.996828    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg" podUID="da75f51e-ddb3-40a1-b475-b252bc8954d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 30 23:39:44.936489 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:44.936432    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:44.997679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:44.996647    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 30 23:39:44.997679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:44.996770    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg" podUID="da75f51e-ddb3-40a1-b475-b252bc8954d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 30 23:39:45.998234 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:45.998133    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 30 23:39:45.998234 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:45.998197    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg" podUID="da75f51e-ddb3-40a1-b475-b252bc8954d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 30 23:39:46.075054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:46.075019    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:47.005035 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.004997    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 30 23:39:47.005730 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.005688    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg" podUID="da75f51e-ddb3-40a1-b475-b252bc8954d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 30 23:39:47.050160 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.050077    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:47.184045 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.184014    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4"]
Oct 30 23:39:47.196142 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.196090    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4"
Oct 30 23:39:47.201135 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.201065    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4"]
Oct 30 23:39:47.218515 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.218445    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bmrd2\""
Oct 30 23:39:47.218515 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.218488    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 23:39:47.237483 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.237446    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/75e8f197-3170-4261-8454-f6bab23c0152-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3818c7fb-dmbp4\" (UID: \"75e8f197-3170-4261-8454-f6bab23c0152\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4"
Oct 30 23:39:47.237810 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.237788    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/75e8f197-3170-4261-8454-f6bab23c0152-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3818c7fb-dmbp4\" (UID: \"75e8f197-3170-4261-8454-f6bab23c0152\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4"
Oct 30 23:39:47.238068 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.238047    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj9lz\" (UniqueName: \"kubernetes.io/projected/75e8f197-3170-4261-8454-f6bab23c0152-kube-api-access-dj9lz\") pod \"maas-api-revoke-sub-3818c7fb-dmbp4\" (UID: \"75e8f197-3170-4261-8454-f6bab23c0152\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4"
Oct 30 23:39:47.339072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.338973    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj9lz\" (UniqueName: \"kubernetes.io/projected/75e8f197-3170-4261-8454-f6bab23c0152-kube-api-access-dj9lz\") pod \"maas-api-revoke-sub-3818c7fb-dmbp4\" (UID: \"75e8f197-3170-4261-8454-f6bab23c0152\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4"
Oct 30 23:39:47.339252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.339121    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/75e8f197-3170-4261-8454-f6bab23c0152-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3818c7fb-dmbp4\" (UID: \"75e8f197-3170-4261-8454-f6bab23c0152\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4"
Oct 30 23:39:47.339252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.339185    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/75e8f197-3170-4261-8454-f6bab23c0152-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3818c7fb-dmbp4\" (UID: \"75e8f197-3170-4261-8454-f6bab23c0152\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4"
Oct 30 23:39:47.340019 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.339998    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/75e8f197-3170-4261-8454-f6bab23c0152-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3818c7fb-dmbp4\" (UID: \"75e8f197-3170-4261-8454-f6bab23c0152\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4"
Oct 30 23:39:47.341712 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.341694    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/75e8f197-3170-4261-8454-f6bab23c0152-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3818c7fb-dmbp4\" (UID: \"75e8f197-3170-4261-8454-f6bab23c0152\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4"
Oct 30 23:39:47.355032 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.354999    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj9lz\" (UniqueName: \"kubernetes.io/projected/75e8f197-3170-4261-8454-f6bab23c0152-kube-api-access-dj9lz\") pod \"maas-api-revoke-sub-3818c7fb-dmbp4\" (UID: \"75e8f197-3170-4261-8454-f6bab23c0152\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4"
Oct 30 23:39:47.539622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.539570    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4"
Oct 30 23:39:47.826231 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.826201    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4"]
Oct 30 23:39:47.831980 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:39:47.828586    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e8f197_3170_4261_8454_f6bab23c0152.slice/crio-eb2a1191d808e0c155653a53660b9a0da84b7afd23c741d8b77e6dd3dda3238e WatchSource:0}: Error finding container eb2a1191d808e0c155653a53660b9a0da84b7afd23c741d8b77e6dd3dda3238e: Status 404 returned error can't find the container with id eb2a1191d808e0c155653a53660b9a0da84b7afd23c741d8b77e6dd3dda3238e
Oct 30 23:39:47.831980 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.830913    4921 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 23:39:47.918788 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:47.918759    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:48.114669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:48.114634    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4" event={"ID":"75e8f197-3170-4261-8454-f6bab23c0152","Type":"ContainerStarted","Data":"eb2a1191d808e0c155653a53660b9a0da84b7afd23c741d8b77e6dd3dda3238e"}
Oct 30 23:39:48.629276 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:48.629239    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:48.772244 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:48.772214    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:48.772524 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:48.772501    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:48.773528 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:48.773507    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 30 23:39:49.007935 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:49.007900    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-74v7f-6hdv9"]
Oct 30 23:39:49.012262 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:49.012229    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-74v7f-6hdv9"
Oct 30 23:39:49.017169 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:49.017151    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mx9rq\""
Oct 30 23:39:49.021023 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:49.021000    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-74v7f-6hdv9"]
Oct 30 23:39:49.068587 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:49.068554    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvm2h\" (UniqueName: \"kubernetes.io/projected/d53cebe3-7403-4d17-8e70-2620bf4362a4-kube-api-access-bvm2h\") pod \"periodic-gathering-74v7f-6hdv9\" (UID: \"d53cebe3-7403-4d17-8e70-2620bf4362a4\") " pod="openshift-insights/periodic-gathering-74v7f-6hdv9"
Oct 30 23:39:49.068748 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:49.068697    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d53cebe3-7403-4d17-8e70-2620bf4362a4-trusted-ca-bundle\") pod \"periodic-gathering-74v7f-6hdv9\" (UID: \"d53cebe3-7403-4d17-8e70-2620bf4362a4\") " pod="openshift-insights/periodic-gathering-74v7f-6hdv9"
Oct 30 23:39:49.068748 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:49.068741    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/d53cebe3-7403-4d17-8e70-2620bf4362a4-archives-path\") pod \"periodic-gathering-74v7f-6hdv9\" (UID: \"d53cebe3-7403-4d17-8e70-2620bf4362a4\") " pod="openshift-insights/periodic-gathering-74v7f-6hdv9"
Oct 30 23:39:49.068877 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:49.068851    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d53cebe3-7403-4d17-8e70-2620bf4362a4-service-ca-bundle\") pod \"periodic-gathering-74v7f-6hdv9\" (UID: \"d53cebe3-7403-4d17-8e70-2620bf4362a4\") " pod="openshift-insights/periodic-gathering-74v7f-6hdv9"
Oct 30 23:39:49.170017 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:49.169982    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d53cebe3-7403-4d17-8e70-2620bf4362a4-service-ca-bundle\") pod \"periodic-gathering-74v7f-6hdv9\" (UID: \"d53cebe3-7403-4d17-8e70-2620bf4362a4\") " pod="openshift-insights/periodic-gathering-74v7f-6hdv9"
Oct 30 23:39:49.170484 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:49.170082    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvm2h\" (UniqueName: \"kubernetes.io/projected/d53cebe3-7403-4d17-8e70-2620bf4362a4-kube-api-access-bvm2h\") pod \"periodic-gathering-74v7f-6hdv9\" (UID: \"d53cebe3-7403-4d17-8e70-2620bf4362a4\") " pod="openshift-insights/periodic-gathering-74v7f-6hdv9"
Oct 30 23:39:49.170484 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:49.170184    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d53cebe3-7403-4d17-8e70-2620bf4362a4-trusted-ca-bundle\") pod \"periodic-gathering-74v7f-6hdv9\" (UID: \"d53cebe3-7403-4d17-8e70-2620bf4362a4\") " pod="openshift-insights/periodic-gathering-74v7f-6hdv9"
Oct 30 23:39:49.170648 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:49.170554    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/d53cebe3-7403-4d17-8e70-2620bf4362a4-archives-path\") pod \"periodic-gathering-74v7f-6hdv9\" (UID: \"d53cebe3-7403-4d17-8e70-2620bf4362a4\") " pod="openshift-insights/periodic-gathering-74v7f-6hdv9"
Oct 30 23:39:49.170811 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:49.170787    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d53cebe3-7403-4d17-8e70-2620bf4362a4-service-ca-bundle\") pod \"periodic-gathering-74v7f-6hdv9\" (UID: \"d53cebe3-7403-4d17-8e70-2620bf4362a4\") " pod="openshift-insights/periodic-gathering-74v7f-6hdv9"
Oct 30 23:39:49.170965 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:49.170946    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/d53cebe3-7403-4d17-8e70-2620bf4362a4-archives-path\") pod \"periodic-gathering-74v7f-6hdv9\" (UID: \"d53cebe3-7403-4d17-8e70-2620bf4362a4\") " pod="openshift-insights/periodic-gathering-74v7f-6hdv9"
Oct 30 23:39:49.171523 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:49.171499    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d53cebe3-7403-4d17-8e70-2620bf4362a4-trusted-ca-bundle\") pod \"periodic-gathering-74v7f-6hdv9\" (UID: \"d53cebe3-7403-4d17-8e70-2620bf4362a4\") " pod="openshift-insights/periodic-gathering-74v7f-6hdv9"
Oct 30 23:39:49.184218 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:49.184162    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvm2h\" (UniqueName: \"kubernetes.io/projected/d53cebe3-7403-4d17-8e70-2620bf4362a4-kube-api-access-bvm2h\") pod \"periodic-gathering-74v7f-6hdv9\" (UID: \"d53cebe3-7403-4d17-8e70-2620bf4362a4\") " pod="openshift-insights/periodic-gathering-74v7f-6hdv9"
Oct 30 23:39:49.327827 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:49.327748    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-74v7f-6hdv9"
Oct 30 23:39:49.339657 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:49.339626    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:49.667038 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:49.667008    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-74v7f-6hdv9"]
Oct 30 23:39:49.669033 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:39:49.668998    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53cebe3_7403_4d17_8e70_2620bf4362a4.slice/crio-8c392e66b0b0bfc31144e85ac960cbd9379e02124a5bc01d37ef66243999b1f0 WatchSource:0}: Error finding container 8c392e66b0b0bfc31144e85ac960cbd9379e02124a5bc01d37ef66243999b1f0: Status 404 returned error can't find the container with id 8c392e66b0b0bfc31144e85ac960cbd9379e02124a5bc01d37ef66243999b1f0
Oct 30 23:39:50.077023 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:50.076933    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:50.134823 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:50.134719    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-74v7f-6hdv9" event={"ID":"d53cebe3-7403-4d17-8e70-2620bf4362a4","Type":"ContainerStarted","Data":"f2cbddce48fecc6ac398285cacb975e99816b6662b3c8f9aabd3487eb1ebfddf"}
Oct 30 23:39:50.134823 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:50.134780    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-74v7f-6hdv9" event={"ID":"d53cebe3-7403-4d17-8e70-2620bf4362a4","Type":"ContainerStarted","Data":"8c392e66b0b0bfc31144e85ac960cbd9379e02124a5bc01d37ef66243999b1f0"}
Oct 30 23:39:50.155912 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:50.155852    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-74v7f-6hdv9" podStartSLOduration=2.155836303 podStartE2EDuration="2.155836303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:39:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:39:50.153464976 +0000 UTC m=+1249.398320801" watchObservedRunningTime="2026-10-30 23:39:50.155836303 +0000 UTC m=+1249.400692107"
Oct 30 23:39:50.828058 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:50.828027    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:51.142116 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:51.142075    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4" event={"ID":"75e8f197-3170-4261-8454-f6bab23c0152","Type":"ContainerStarted","Data":"d4e5d9ec728cbbccad4bd3a7d3fc8aae12548f64359f94f151e8eae817e9e277"}
Oct 30 23:39:51.161863 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:51.161814    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4" podStartSLOduration=1.296504268 podStartE2EDuration="4.161800052s" totalImagesPullingTime="2.865295784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:39:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:39:51.160111995 +0000 UTC m=+1250.404967763" watchObservedRunningTime="2026-10-30 23:39:51.161800052 +0000 UTC m=+1250.406655821"
Oct 30 23:39:51.733179 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:51.733136    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:51.913639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:51.913576    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:52.149769 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.149731    4921 generic.go:356] "Generic (PLEG): container finished" podID="75e8f197-3170-4261-8454-f6bab23c0152" containerID="d4e5d9ec728cbbccad4bd3a7d3fc8aae12548f64359f94f151e8eae817e9e277" exitCode=0
Oct 30 23:39:52.149954 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.149816    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4" event={"ID":"75e8f197-3170-4261-8454-f6bab23c0152","Type":"ContainerDied","Data":"d4e5d9ec728cbbccad4bd3a7d3fc8aae12548f64359f94f151e8eae817e9e277"}
Oct 30 23:39:52.438913 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.438879    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:52.744338 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.744250    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"]
Oct 30 23:39:52.749507 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.749481    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:52.759243 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.759217    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"]
Oct 30 23:39:52.761397 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.760581    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-d3dcca\"/\"kube-root-ca.crt\""
Oct 30 23:39:52.761397 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.760659    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-d3dcca\"/\"openshift-service-ca.crt\""
Oct 30 23:39:52.761397 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.760667    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-d3dcca\"/\"default-dockercfg-rzhfh\""
Oct 30 23:39:52.761397 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.760710    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-d3dcca\"/\"distinct-w0-d3dcca-kserve-self-signed-certs\""
Oct 30 23:39:52.815304 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.815271    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:52.845541 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.845514    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-home\") pod \"distinct-w0-d3dcca-kserve-84888cf469-ctrhn\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") " pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:52.845541 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.845543    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-model-cache\") pod \"distinct-w0-d3dcca-kserve-84888cf469-ctrhn\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") " pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:52.845770 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.845697    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98ncn\" (UniqueName: \"kubernetes.io/projected/43c0107d-53f5-4fa8-809b-5ecab19c6e58-kube-api-access-98ncn\") pod \"distinct-w0-d3dcca-kserve-84888cf469-ctrhn\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") " pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:52.845770 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.845754    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43c0107d-53f5-4fa8-809b-5ecab19c6e58-tls-certs\") pod \"distinct-w0-d3dcca-kserve-84888cf469-ctrhn\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") " pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:52.845841 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.845814    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-tmp-dir\") pod \"distinct-w0-d3dcca-kserve-84888cf469-ctrhn\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") " pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:52.845883 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.845869    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-dshm\") pod \"distinct-w0-d3dcca-kserve-84888cf469-ctrhn\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") " pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:52.950368 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.950323    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98ncn\" (UniqueName: \"kubernetes.io/projected/43c0107d-53f5-4fa8-809b-5ecab19c6e58-kube-api-access-98ncn\") pod \"distinct-w0-d3dcca-kserve-84888cf469-ctrhn\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") " pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:52.950890 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.950396    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43c0107d-53f5-4fa8-809b-5ecab19c6e58-tls-certs\") pod \"distinct-w0-d3dcca-kserve-84888cf469-ctrhn\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") " pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:52.950890 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.950473    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-tmp-dir\") pod \"distinct-w0-d3dcca-kserve-84888cf469-ctrhn\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") " pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:52.950890 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.950524    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-dshm\") pod \"distinct-w0-d3dcca-kserve-84888cf469-ctrhn\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") " pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:52.950890 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.950643    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-home\") pod \"distinct-w0-d3dcca-kserve-84888cf469-ctrhn\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") " pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:52.950890 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.950668    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-model-cache\") pod \"distinct-w0-d3dcca-kserve-84888cf469-ctrhn\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") " pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:52.951161 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.951095    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-model-cache\") pod \"distinct-w0-d3dcca-kserve-84888cf469-ctrhn\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") " pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:52.951219 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.951199    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-tmp-dir\") pod \"distinct-w0-d3dcca-kserve-84888cf469-ctrhn\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") " pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:52.951274 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.951237    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-home\") pod \"distinct-w0-d3dcca-kserve-84888cf469-ctrhn\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") " pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:52.955644 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.955581    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-dshm\") pod \"distinct-w0-d3dcca-kserve-84888cf469-ctrhn\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") " pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:52.955878 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.955861    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43c0107d-53f5-4fa8-809b-5ecab19c6e58-tls-certs\") pod \"distinct-w0-d3dcca-kserve-84888cf469-ctrhn\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") " pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:52.964176 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:52.964133    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98ncn\" (UniqueName: \"kubernetes.io/projected/43c0107d-53f5-4fa8-809b-5ecab19c6e58-kube-api-access-98ncn\") pod \"distinct-w0-d3dcca-kserve-84888cf469-ctrhn\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") " pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:53.066246 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:53.066164    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:53.307141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:53.307116    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4"
Oct 30 23:39:53.352561 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:53.352481    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"]
Oct 30 23:39:53.355021 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:53.354993    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/75e8f197-3170-4261-8454-f6bab23c0152-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/75e8f197-3170-4261-8454-f6bab23c0152-maas-api-xks-ca\") pod \"75e8f197-3170-4261-8454-f6bab23c0152\" (UID: \"75e8f197-3170-4261-8454-f6bab23c0152\") "
Oct 30 23:39:53.355166 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:53.355144    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/75e8f197-3170-4261-8454-f6bab23c0152-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/75e8f197-3170-4261-8454-f6bab23c0152-maas-api-openshift-ca\") pod \"75e8f197-3170-4261-8454-f6bab23c0152\" (UID: \"75e8f197-3170-4261-8454-f6bab23c0152\") "
Oct 30 23:39:53.355242 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:53.355229    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75e8f197-3170-4261-8454-f6bab23c0152-kube-api-access-dj9lz\" (UniqueName: \"kubernetes.io/projected/75e8f197-3170-4261-8454-f6bab23c0152-kube-api-access-dj9lz\") pod \"75e8f197-3170-4261-8454-f6bab23c0152\" (UID: \"75e8f197-3170-4261-8454-f6bab23c0152\") "
Oct 30 23:39:53.355988 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:53.355961    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75e8f197-3170-4261-8454-f6bab23c0152-maas-api-openshift-ca" pod "75e8f197-3170-4261-8454-f6bab23c0152" (UID: "75e8f197-3170-4261-8454-f6bab23c0152"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:39:53.357841 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:53.357814    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75e8f197-3170-4261-8454-f6bab23c0152-kube-api-access-dj9lz" pod "75e8f197-3170-4261-8454-f6bab23c0152" (UID: "75e8f197-3170-4261-8454-f6bab23c0152"). InnerVolumeSpecName "kube-api-access-dj9lz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:39:53.358269 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:53.358243    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75e8f197-3170-4261-8454-f6bab23c0152-maas-api-xks-ca" pod "75e8f197-3170-4261-8454-f6bab23c0152" (UID: "75e8f197-3170-4261-8454-f6bab23c0152"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:39:53.359565 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:39:53.359537    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43c0107d_53f5_4fa8_809b_5ecab19c6e58.slice/crio-fb6390ec89720c2a50c3ee7cac1c76436b8ab6a2c791bde97c73ae9ccea98ba9 WatchSource:0}: Error finding container fb6390ec89720c2a50c3ee7cac1c76436b8ab6a2c791bde97c73ae9ccea98ba9: Status 404 returned error can't find the container with id fb6390ec89720c2a50c3ee7cac1c76436b8ab6a2c791bde97c73ae9ccea98ba9
Oct 30 23:39:53.446089 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:53.446005    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:53.458131 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:53.458092    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/75e8f197-3170-4261-8454-f6bab23c0152-maas-api-xks-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:39:53.458131 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:53.458130    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/75e8f197-3170-4261-8454-f6bab23c0152-maas-api-openshift-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:39:53.458416 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:53.458145    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj9lz\" (UniqueName: \"kubernetes.io/projected/75e8f197-3170-4261-8454-f6bab23c0152-kube-api-access-dj9lz\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:39:54.174209 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:54.174160    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:54.195125 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:54.195086    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4"
Oct 30 23:39:54.195319 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:54.195188    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4" event={"ID":"75e8f197-3170-4261-8454-f6bab23c0152","Type":"ContainerDied","Data":"eb2a1191d808e0c155653a53660b9a0da84b7afd23c741d8b77e6dd3dda3238e"}
Oct 30 23:39:54.195319 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:54.195253    4921 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb2a1191d808e0c155653a53660b9a0da84b7afd23c741d8b77e6dd3dda3238e"
Oct 30 23:39:54.197556 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:54.197526    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" event={"ID":"43c0107d-53f5-4fa8-809b-5ecab19c6e58","Type":"ContainerStarted","Data":"3627b7e9d0a185b825a30539501bcfbed5bf1c962a2e31e7d71684bdb7710283"}
Oct 30 23:39:54.197750 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:54.197563    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" event={"ID":"43c0107d-53f5-4fa8-809b-5ecab19c6e58","Type":"ContainerStarted","Data":"fb6390ec89720c2a50c3ee7cac1c76436b8ab6a2c791bde97c73ae9ccea98ba9"}
Oct 30 23:39:54.259062 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:54.258981    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podStartSLOduration=2.258967619 podStartE2EDuration="2.258967619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:39:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:39:54.256890686 +0000 UTC m=+1253.501746454" watchObservedRunningTime="2026-10-30 23:39:54.258967619 +0000 UTC m=+1253.503823386"
Oct 30 23:39:55.004436 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:55.004404    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:55.066492 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:55.066464    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:39:55.802068 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:55.802027    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:55.928364 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:55.928331    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"]
Oct 30 23:39:55.928951 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:55.928932    4921 cpu_manager.go:414] "containerMap: removing container" podUID="75e8f197-3170-4261-8454-f6bab23c0152" containerName="revoke-keys"
Oct 30 23:39:55.929068 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:55.928952    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75e8f197-3170-4261-8454-f6bab23c0152" containerName="revoke-keys"
Oct 30 23:39:55.929143 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:55.929129    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="75e8f197-3170-4261-8454-f6bab23c0152" containerName="revoke-keys"
Oct 30 23:39:55.933073 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:55.933050    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:55.949476 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:55.949445    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"]
Oct 30 23:39:56.015124 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.015076    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-workload-socket\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.015124 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.015116    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31849433-47df-48bc-87c0-903660560055-istio-podinfo\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.015339 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.015182    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31849433-47df-48bc-87c0-903660560055-istio-token\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.015339 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.015238    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-istio-data\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.015339 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.015292    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk9pv\" (UniqueName: \"kubernetes.io/projected/31849433-47df-48bc-87c0-903660560055-kube-api-access-nk9pv\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.015464 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.015376    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-credential-socket\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.015464 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.015395    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-istio-envoy\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.015464 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.015428    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31849433-47df-48bc-87c0-903660560055-istiod-ca-cert\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.015634 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.015569    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-workload-certs\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.116911 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.116837    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-workload-certs\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.117114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.116935    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-workload-socket\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.117114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.116959    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31849433-47df-48bc-87c0-903660560055-istio-podinfo\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.117114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.116976    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31849433-47df-48bc-87c0-903660560055-istio-token\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.117114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.117057    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-istio-data\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.117114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.117092    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk9pv\" (UniqueName: \"kubernetes.io/projected/31849433-47df-48bc-87c0-903660560055-kube-api-access-nk9pv\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.117505 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.117138    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-credential-socket\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.117505 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.117163    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-istio-envoy\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.117505 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.117213    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31849433-47df-48bc-87c0-903660560055-istiod-ca-cert\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.117505 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.117235    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-workload-certs\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.117505 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.117397    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-istio-data\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.117763 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.117530    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-credential-socket\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.117763 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.117621    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-workload-socket\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.118174 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.118156    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31849433-47df-48bc-87c0-903660560055-istiod-ca-cert\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.119787 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.119762    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31849433-47df-48bc-87c0-903660560055-istio-podinfo\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.119893 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.119868    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-istio-envoy\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.129479 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.129459    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31849433-47df-48bc-87c0-903660560055-istio-token\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.129581 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.129462    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk9pv\" (UniqueName: \"kubernetes.io/projected/31849433-47df-48bc-87c0-903660560055-kube-api-access-nk9pv\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq\" (UID: \"31849433-47df-48bc-87c0-903660560055\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.253943 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.253914    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:56.546966 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.546936    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"]
Oct 30 23:39:56.548354 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:39:56.548321    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31849433_47df_48bc_87c0_903660560055.slice/crio-bab3c6d002351de24f30654f56c6d50df7c3c70d94a0dac1b09f69dc7c320499 WatchSource:0}: Error finding container bab3c6d002351de24f30654f56c6d50df7c3c70d94a0dac1b09f69dc7c320499: Status 404 returned error can't find the container with id bab3c6d002351de24f30654f56c6d50df7c3c70d94a0dac1b09f69dc7c320499
Oct 30 23:39:56.550948 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.550913    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:39:56.551049 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.550981    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:39:56.551049 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.551008    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:39:56.827986 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:56.827883    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:57.217025 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:57.216994    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq" event={"ID":"31849433-47df-48bc-87c0-903660560055","Type":"ContainerStarted","Data":"a32a2a13e914be4b03a146c58733e49e61cb7a2c854ae6fdc797318d640a6232"}
Oct 30 23:39:57.217220 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:57.217043    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq" event={"ID":"31849433-47df-48bc-87c0-903660560055","Type":"ContainerStarted","Data":"bab3c6d002351de24f30654f56c6d50df7c3c70d94a0dac1b09f69dc7c320499"}
Oct 30 23:39:57.245944 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:57.245898    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq" podStartSLOduration=2.245884367 podStartE2EDuration="2.245884367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:39:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:39:57.243169866 +0000 UTC m=+1256.488025634" watchObservedRunningTime="2026-10-30 23:39:57.245884367 +0000 UTC m=+1256.490740135"
Oct 30 23:39:57.254982 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:57.254951    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:39:57.256701 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:57.256681    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 23:39:57.256774 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:57.256725    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq" podUID="31849433-47df-48bc-87c0-903660560055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 23:39:57.695069 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:57.695026    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:58.254833 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:58.254804    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 23:39:58.255234 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:58.254859    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq" podUID="31849433-47df-48bc-87c0-903660560055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 23:39:58.550993 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:58.550902    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:39:59.254901 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:59.254871    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 23:39:59.255285 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:59.254935    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq" podUID="31849433-47df-48bc-87c0-903660560055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 23:39:59.329986 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:39:59.329952    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:00.272619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:00.271005    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 23:40:00.272619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:00.271079    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq" podUID="31849433-47df-48bc-87c0-903660560055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 23:40:01.356222 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:01.355730    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 23:40:01.356222 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:01.355820    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq" podUID="31849433-47df-48bc-87c0-903660560055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 23:40:01.437629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:01.433152    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:02.022020 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.021988    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"]
Oct 30 23:40:02.028488 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.028463    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.036801 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.036768    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-e15304\"/\"distinct-w6-e15304-kserve-self-signed-certs\""
Oct 30 23:40:02.041705 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.041676    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"]
Oct 30 23:40:02.049420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.049389    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-tmp-dir\") pod \"distinct-w6-e15304-kserve-57874f8b5c-ct2xz\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") " pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.049558 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.049432    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-tls-certs\") pod \"distinct-w6-e15304-kserve-57874f8b5c-ct2xz\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") " pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.049558 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.049521    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-home\") pod \"distinct-w6-e15304-kserve-57874f8b5c-ct2xz\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") " pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.049721 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.049700    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-model-cache\") pod \"distinct-w6-e15304-kserve-57874f8b5c-ct2xz\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") " pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.049788 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.049765    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvqgk\" (UniqueName: \"kubernetes.io/projected/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-kube-api-access-cvqgk\") pod \"distinct-w6-e15304-kserve-57874f8b5c-ct2xz\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") " pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.049893 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.049875    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-dshm\") pod \"distinct-w6-e15304-kserve-57874f8b5c-ct2xz\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") " pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.103616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.103050    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:02.151971 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.151826    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-dshm\") pod \"distinct-w6-e15304-kserve-57874f8b5c-ct2xz\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") " pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.152312 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.152288    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-tmp-dir\") pod \"distinct-w6-e15304-kserve-57874f8b5c-ct2xz\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") " pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.152448 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.152433    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-tls-certs\") pod \"distinct-w6-e15304-kserve-57874f8b5c-ct2xz\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") " pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.152557 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.152545    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-home\") pod \"distinct-w6-e15304-kserve-57874f8b5c-ct2xz\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") " pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.152822 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.152803    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-model-cache\") pod \"distinct-w6-e15304-kserve-57874f8b5c-ct2xz\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") " pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.152979 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.152960    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvqgk\" (UniqueName: \"kubernetes.io/projected/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-kube-api-access-cvqgk\") pod \"distinct-w6-e15304-kserve-57874f8b5c-ct2xz\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") " pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.159660 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.159615    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-home\") pod \"distinct-w6-e15304-kserve-57874f8b5c-ct2xz\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") " pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.160315 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.160292    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-tmp-dir\") pod \"distinct-w6-e15304-kserve-57874f8b5c-ct2xz\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") " pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.160739 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.160716    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-model-cache\") pod \"distinct-w6-e15304-kserve-57874f8b5c-ct2xz\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") " pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.194540 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.194510    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-dshm\") pod \"distinct-w6-e15304-kserve-57874f8b5c-ct2xz\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") " pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.209630 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.197171    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-tls-certs\") pod \"distinct-w6-e15304-kserve-57874f8b5c-ct2xz\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") " pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.246319 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.246248    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvqgk\" (UniqueName: \"kubernetes.io/projected/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-kube-api-access-cvqgk\") pod \"distinct-w6-e15304-kserve-57874f8b5c-ct2xz\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") " pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.273673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.256178    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 23:40:02.273673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.256248    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq" podUID="31849433-47df-48bc-87c0-903660560055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 23:40:02.346585 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.346557    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:02.451002 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.450972    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:02.659178 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:02.659151    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"]
Oct 30 23:40:02.660085 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:40:02.660056    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16e9c6c7_2b6c_47f0_83bf_259de0754c3c.slice/crio-a6eb479ab18bd3fb6605921d96a691044c0f32599f1bfae9256bb00deac2bdb4 WatchSource:0}: Error finding container a6eb479ab18bd3fb6605921d96a691044c0f32599f1bfae9256bb00deac2bdb4: Status 404 returned error can't find the container with id a6eb479ab18bd3fb6605921d96a691044c0f32599f1bfae9256bb00deac2bdb4
Oct 30 23:40:03.066623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:03.066523    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:40:03.102583 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:03.102554    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:40:03.249788 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:03.249711    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:03.255631 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:03.255364    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 23:40:03.255631 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:03.255418    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq" podUID="31849433-47df-48bc-87c0-903660560055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 23:40:03.453288 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:03.453231    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" event={"ID":"16e9c6c7-2b6c-47f0-83bf-259de0754c3c","Type":"ContainerStarted","Data":"9efa0d67f7efd6e378109c93dca0f928b61b139a59194eaa6d6cdee815853c50"}
Oct 30 23:40:03.453735 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:03.453306    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" event={"ID":"16e9c6c7-2b6c-47f0-83bf-259de0754c3c","Type":"ContainerStarted","Data":"a6eb479ab18bd3fb6605921d96a691044c0f32599f1bfae9256bb00deac2bdb4"}
Oct 30 23:40:03.465891 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:03.465860    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:40:03.473854 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:03.473811    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podStartSLOduration=2.473797579 podStartE2EDuration="2.473797579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:40:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:40:03.471878139 +0000 UTC m=+1262.716733908" watchObservedRunningTime="2026-10-30 23:40:03.473797579 +0000 UTC m=+1262.718653347"
Oct 30 23:40:04.024940 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:04.024897    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:04.347546 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:04.347470    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:04.825241 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:04.825185    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:04.921625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:04.921563    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:40:04.922013 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:04.921996    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:40:04.922832 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:04.922802    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:40:05.726160 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:05.726128    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:06.550661 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:06.549451    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:07.455560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:07.455525    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:08.640668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:08.640223    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:09.335889 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:09.335851    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:10.164192 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:10.164155    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:10.673312 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:10.673286    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:11.014768 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.014697    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"]
Oct 30 23:40:11.018899 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.018875    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.033326 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.033304    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"]
Oct 30 23:40:11.100206 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.100175    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-credential-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.100368 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.100229    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-data\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.100368 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.100342    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-podinfo\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.100438 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.100370    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59a6ba32-e3e0-479f-8e87-5ee77a926503-istiod-ca-cert\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.100438 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.100390    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-envoy\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.100510 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.100495    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-workload-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.100579 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.100563    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-token\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.100688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.100667    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2nqc\" (UniqueName: \"kubernetes.io/projected/59a6ba32-e3e0-479f-8e87-5ee77a926503-kube-api-access-q2nqc\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.100759 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.100705    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-workload-certs\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.157538 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.157499    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:11.204554 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.202013    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-podinfo\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.204554 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.202076    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59a6ba32-e3e0-479f-8e87-5ee77a926503-istiod-ca-cert\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.204554 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.202110    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-envoy\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.204554 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.202192    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-workload-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.204554 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.202270    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-token\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.204554 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.202308    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2nqc\" (UniqueName: \"kubernetes.io/projected/59a6ba32-e3e0-479f-8e87-5ee77a926503-kube-api-access-q2nqc\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.204554 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.202342    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-workload-certs\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.204554 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.202372    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-credential-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.204554 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.202435    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-data\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.204554 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.202936    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-data\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.205634 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.205580    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59a6ba32-e3e0-479f-8e87-5ee77a926503-istiod-ca-cert\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.208878 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.207969    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-workload-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.209705 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.208178    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-workload-certs\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.209867 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.208741    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-credential-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.213965 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.213936    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-podinfo\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.221544 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.221243    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-envoy\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.221544 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.221256    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-token\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.222115 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.222074    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2nqc\" (UniqueName: \"kubernetes.io/projected/59a6ba32-e3e0-479f-8e87-5ee77a926503-kube-api-access-q2nqc\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.335622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.335509    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:11.416119 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:40:11.416063    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:40:11.665615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.665297    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"]
Oct 30 23:40:11.675768 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.675526    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:11.675768 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.675648    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:11.675768 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.675701    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:11.940059 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:11.939914    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:12.347798 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:12.347715    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:12.360443 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:12.360418    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:12.512924 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:12.512888    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9" event={"ID":"59a6ba32-e3e0-479f-8e87-5ee77a926503","Type":"ContainerStarted","Data":"f11abe114195eeffa8f96f1a5edfc97fda4205dec526c07d1abe5220ed7fafa6"}
Oct 30 23:40:12.513110 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:12.512950    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9" event={"ID":"59a6ba32-e3e0-479f-8e87-5ee77a926503","Type":"ContainerStarted","Data":"d2a8dfb9895fc42f95ec437170f061b6e1d9e46d876d8692b68993c322508c2e"}
Oct 30 23:40:12.524420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:12.524397    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:40:12.540322 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:12.540274    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9" podStartSLOduration=2.540261298 podStartE2EDuration="2.540261298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:40:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:40:12.537039838 +0000 UTC m=+1271.781895606" watchObservedRunningTime="2026-10-30 23:40:12.540261298 +0000 UTC m=+1271.785117066"
Oct 30 23:40:12.735998 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:12.735961    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:13.335707 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:13.335667    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:13.337472 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:13.337443    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 23:40:13.337628 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:13.337517    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9" podUID="59a6ba32-e3e0-479f-8e87-5ee77a926503" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 23:40:13.551867 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:13.551833    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:14.336082 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:14.336048    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 23:40:14.336276 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:14.336118    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9" podUID="59a6ba32-e3e0-479f-8e87-5ee77a926503" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 23:40:14.438746 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:14.438691    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:15.253919 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:15.253884    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:15.336236 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:15.336200    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 23:40:15.336420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:15.336261    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9" podUID="59a6ba32-e3e0-479f-8e87-5ee77a926503" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 23:40:16.246124 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:16.246090    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:16.336346 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:16.336310    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 23:40:16.336821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:16.336377    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9" podUID="59a6ba32-e3e0-479f-8e87-5ee77a926503" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 23:40:17.341619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:17.337799    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 23:40:17.341619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:17.337956    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9" podUID="59a6ba32-e3e0-479f-8e87-5ee77a926503" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 23:40:17.617682 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:17.617307    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:18.336949 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:18.336918    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 23:40:18.337115 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:18.336984    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9" podUID="59a6ba32-e3e0-479f-8e87-5ee77a926503" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 23:40:18.533484 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:18.533453    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:18.821968 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:18.821286    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:19.336214 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:19.336177    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 23:40:19.336421 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:19.336244    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9" podUID="59a6ba32-e3e0-479f-8e87-5ee77a926503" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 23:40:19.447636 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:19.447582    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:20.320785 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:20.317189    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:20.366988 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:20.366954    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:20.368735 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:20.368711    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:20.370772 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:20.370746    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:40:20.913656 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:20.913627    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"]
Oct 30 23:40:20.919879 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:20.919849    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"]
Oct 30 23:40:20.920045 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:20.919962    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:20.924366 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:20.924345    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-dd3a15\"/\"distinct-w5-dd3a15-kserve-self-signed-certs\""
Oct 30 23:40:20.954432 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:20.954397    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:21.057141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.057105    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-tmp-dir\") pod \"distinct-w5-dd3a15-kserve-746bf55566-7q9tq\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") " pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:21.057473 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.057450    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-model-cache\") pod \"distinct-w5-dd3a15-kserve-746bf55566-7q9tq\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") " pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:21.057749 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.057729    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-dshm\") pod \"distinct-w5-dd3a15-kserve-746bf55566-7q9tq\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") " pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:21.057932 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.057916    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf081868-d868-477d-90d4-c7c8f9fb2c5e-tls-certs\") pod \"distinct-w5-dd3a15-kserve-746bf55566-7q9tq\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") " pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:21.058059 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.058044    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6g26\" (UniqueName: \"kubernetes.io/projected/bf081868-d868-477d-90d4-c7c8f9fb2c5e-kube-api-access-g6g26\") pod \"distinct-w5-dd3a15-kserve-746bf55566-7q9tq\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") " pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:21.058196 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.058180    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-home\") pod \"distinct-w5-dd3a15-kserve-746bf55566-7q9tq\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") " pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:21.162427 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.162394    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf081868-d868-477d-90d4-c7c8f9fb2c5e-tls-certs\") pod \"distinct-w5-dd3a15-kserve-746bf55566-7q9tq\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") " pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:21.162641 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.162441    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6g26\" (UniqueName: \"kubernetes.io/projected/bf081868-d868-477d-90d4-c7c8f9fb2c5e-kube-api-access-g6g26\") pod \"distinct-w5-dd3a15-kserve-746bf55566-7q9tq\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") " pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:21.162641 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.162465    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-home\") pod \"distinct-w5-dd3a15-kserve-746bf55566-7q9tq\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") " pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:21.163028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.162970    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-home\") pod \"distinct-w5-dd3a15-kserve-746bf55566-7q9tq\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") " pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:21.163160 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.163055    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-tmp-dir\") pod \"distinct-w5-dd3a15-kserve-746bf55566-7q9tq\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") " pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:21.163160 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.162582    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-tmp-dir\") pod \"distinct-w5-dd3a15-kserve-746bf55566-7q9tq\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") " pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:21.163283 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.163160    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-model-cache\") pod \"distinct-w5-dd3a15-kserve-746bf55566-7q9tq\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") " pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:21.163492 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.163459    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-model-cache\") pod \"distinct-w5-dd3a15-kserve-746bf55566-7q9tq\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") " pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:21.163719 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.163660    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-dshm\") pod \"distinct-w5-dd3a15-kserve-746bf55566-7q9tq\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") " pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:21.166573 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.166232    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-dshm\") pod \"distinct-w5-dd3a15-kserve-746bf55566-7q9tq\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") " pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:21.166573 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.166359    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf081868-d868-477d-90d4-c7c8f9fb2c5e-tls-certs\") pod \"distinct-w5-dd3a15-kserve-746bf55566-7q9tq\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") " pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:21.175039 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.175013    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6g26\" (UniqueName: \"kubernetes.io/projected/bf081868-d868-477d-90d4-c7c8f9fb2c5e-kube-api-access-g6g26\") pod \"distinct-w5-dd3a15-kserve-746bf55566-7q9tq\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") " pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:21.239829 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.239794    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:21.451380 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.451282    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:21.590473 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.590367    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"]
Oct 30 23:40:21.593323 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:40:21.593282    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf081868_d868_477d_90d4_c7c8f9fb2c5e.slice/crio-eb7b01fec9a0450df68cdbc2a3816e9844afa507daec81c0c1cb59a1703c3782 WatchSource:0}: Error finding container eb7b01fec9a0450df68cdbc2a3816e9844afa507daec81c0c1cb59a1703c3782: Status 404 returned error can't find the container with id eb7b01fec9a0450df68cdbc2a3816e9844afa507daec81c0c1cb59a1703c3782
Oct 30 23:40:21.690711 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:21.690673    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" event={"ID":"bf081868-d868-477d-90d4-c7c8f9fb2c5e","Type":"ContainerStarted","Data":"eb7b01fec9a0450df68cdbc2a3816e9844afa507daec81c0c1cb59a1703c3782"}
Oct 30 23:40:22.278921 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:22.278880    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:22.698679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:22.698643    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" event={"ID":"bf081868-d868-477d-90d4-c7c8f9fb2c5e","Type":"ContainerStarted","Data":"558229e1b6e6b04ee406250472fdf94e7ed0db4f910b10a21b1407e00fcf5bef"}
Oct 30 23:40:22.719044 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:22.718999    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podStartSLOduration=2.718985451 podStartE2EDuration="2.718985451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:40:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:40:22.717622719 +0000 UTC m=+1281.962478485" watchObservedRunningTime="2026-10-30 23:40:22.718985451 +0000 UTC m=+1281.963841218"
Oct 30 23:40:23.019560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:23.019471    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:23.241662 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:23.241630    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:23.712163 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:23.712128    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:24.409133 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:24.409079    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:24.799123 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:24.798985    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:25.313042 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.313011    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:25.587514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.587436    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"]
Oct 30 23:40:25.596944 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.596918    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.609532 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.609490    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"]
Oct 30 23:40:25.768475 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.768437    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-credential-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.768702 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.768496    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-workload-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.768702 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.768573    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-token\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.768702 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.768670    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-envoy\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.768869 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.768718    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-workload-certs\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.768869 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.768779    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsm6c\" (UniqueName: \"kubernetes.io/projected/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-kube-api-access-lsm6c\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.768869 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.768842    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-podinfo\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.769020 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.768872    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istiod-ca-cert\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.769020 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.769006    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-data\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.844790 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.844714    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"]
Oct 30 23:40:25.849335 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.849314    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:25.865919 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.865898    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"]
Oct 30 23:40:25.870090 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.870062    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-data\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.870213 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.870195    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-credential-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.870274 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.870260    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-workload-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.870323 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.870287    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-token\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.870356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.870321    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-envoy\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.870398 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.870366    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-workload-certs\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.870398 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.870393    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsm6c\" (UniqueName: \"kubernetes.io/projected/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-kube-api-access-lsm6c\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.870476 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.870467    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-podinfo\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.870511 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.870496    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istiod-ca-cert\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.871067 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.871039    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-data\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.871193 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.871037    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-credential-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.871977 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.871336    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-workload-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.871977 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.871679    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-workload-certs\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.871977 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.871919    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istiod-ca-cert\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.876892 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.876865    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-envoy\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.895620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.877260    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-podinfo\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.902648 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.902356    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-token\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.902648 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.902497    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsm6c\" (UniqueName: \"kubernetes.io/projected/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-kube-api-access-lsm6c\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.922803 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.922768    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:25.971712 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.971664    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-data\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:25.971866 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.971731    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-credential-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:25.971924 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.971849    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istiod-ca-cert\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:25.971962 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.971950    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-podinfo\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:25.972005 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.971986    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-workload-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:25.972067 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.972053    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-token\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:25.972115 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.972098    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-envoy\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:25.972280 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.972264    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nczs7\" (UniqueName: \"kubernetes.io/projected/5db30e90-72c0-41bd-bc2d-101e8ece1f35-kube-api-access-nczs7\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:25.972374 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:25.972358    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-workload-certs\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.073748 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.073718    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-workload-certs\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.073935 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.073774    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-data\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.073935 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.073809    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-credential-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.073935 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.073831    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istiod-ca-cert\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.073935 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.073882    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-podinfo\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.073935 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.073915    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-workload-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.074752 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.073971    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-token\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.074752 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.074011    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-envoy\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.074752 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.074116    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nczs7\" (UniqueName: \"kubernetes.io/projected/5db30e90-72c0-41bd-bc2d-101e8ece1f35-kube-api-access-nczs7\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.074752 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.074219    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-workload-certs\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.074752 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.074298    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-credential-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.074752 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.074421    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-data\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.074752 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.074621    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istiod-ca-cert\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.074752 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.074738    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-workload-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.076613 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.076579    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-podinfo\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.076781 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.076761    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-envoy\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.087211 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.087191    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nczs7\" (UniqueName: \"kubernetes.io/projected/5db30e90-72c0-41bd-bc2d-101e8ece1f35-kube-api-access-nczs7\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.087211 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.087201    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-token\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.163378 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.163346    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:26.229196 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.229012    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:26.229196 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.229174    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"]
Oct 30 23:40:26.230025 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:40:26.229994    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1425ac60_c9a8_4e11_9abd_b0b0cd652cb3.slice/crio-e1516f747fb2dd3531234dd3d3be89047f7d01e75486c6e37e2b6423de00b4f9 WatchSource:0}: Error finding container e1516f747fb2dd3531234dd3d3be89047f7d01e75486c6e37e2b6423de00b4f9: Status 404 returned error can't find the container with id e1516f747fb2dd3531234dd3d3be89047f7d01e75486c6e37e2b6423de00b4f9
Oct 30 23:40:26.235767 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.233312    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:26.235767 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.233404    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:26.235767 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.233449    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:26.356984 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.356946    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:26.504864 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.504677    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"]
Oct 30 23:40:26.525496 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.525465    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:26.525704 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.525686    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:26.525814 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.525801    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:26.727270 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.727236    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc" event={"ID":"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3","Type":"ContainerStarted","Data":"d3bfea8ba74449b574a6be42f3d305f29b945cead11937d65d514e131eb6d37b"}
Oct 30 23:40:26.727461 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.727299    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc" event={"ID":"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3","Type":"ContainerStarted","Data":"e1516f747fb2dd3531234dd3d3be89047f7d01e75486c6e37e2b6423de00b4f9"}
Oct 30 23:40:26.729480 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.729452    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz" event={"ID":"5db30e90-72c0-41bd-bc2d-101e8ece1f35","Type":"ContainerStarted","Data":"b2206ffad8a33d22224d9364026301fee166c734f82addc735545ae34a787813"}
Oct 30 23:40:26.729612 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.729503    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz" event={"ID":"5db30e90-72c0-41bd-bc2d-101e8ece1f35","Type":"ContainerStarted","Data":"f91e173a364b9cd0439c9798d9f3d9bd2e952141d1b05b7a4bae7e58c3d8c4dd"}
Oct 30 23:40:26.752535 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.752478    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc" podStartSLOduration=1.752460962 podStartE2EDuration="1.752460962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:40:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:40:26.749476881 +0000 UTC m=+1285.994332650" watchObservedRunningTime="2026-10-30 23:40:26.752460962 +0000 UTC m=+1285.997316730"
Oct 30 23:40:26.775579 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.775438    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz" podStartSLOduration=1.775421831 podStartE2EDuration="1.775421831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:40:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:40:26.770923549 +0000 UTC m=+1286.015779314" watchObservedRunningTime="2026-10-30 23:40:26.775421831 +0000 UTC m=+1286.020277595"
Oct 30 23:40:26.923873 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:26.923839    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:27.163964 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:27.163929    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:27.165578 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:27.165554    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 23:40:27.165744 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:27.165618    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz" podUID="5db30e90-72c0-41bd-bc2d-101e8ece1f35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 23:40:27.191640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:27.191441    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:27.930815 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:27.930267    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 23:40:27.930815 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:27.930331    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc" podUID="1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 23:40:28.164143 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:28.164103    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 23:40:28.164321 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:28.164166    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz" podUID="5db30e90-72c0-41bd-bc2d-101e8ece1f35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 23:40:28.217703 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:28.217586    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:28.923503 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:28.923467    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 23:40:28.923687 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:28.923534    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc" podUID="1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 23:40:29.163985 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:29.163952    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 23:40:29.164432 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:29.164005    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz" podUID="5db30e90-72c0-41bd-bc2d-101e8ece1f35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 23:40:29.309298 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:29.309194    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:29.923955 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:29.923915    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 23:40:29.924154 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:29.923990    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc" podUID="1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 23:40:30.164408 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:30.164372    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 23:40:30.164840 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:30.164424    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz" podUID="5db30e90-72c0-41bd-bc2d-101e8ece1f35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 23:40:30.189675 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:30.189535    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:30.926124 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:30.926091    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 23:40:30.926414 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:30.926389    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc" podUID="1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 23:40:31.164814 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:31.164782    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 23:40:31.165235 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:31.164833    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz" podUID="5db30e90-72c0-41bd-bc2d-101e8ece1f35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 23:40:31.212101 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:31.211974    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:31.243722 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:31.243690    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:31.346509 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:31.346344    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:31.823903 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:31.823876    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:40:31.924075 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:31.924042    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 23:40:31.924366 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:31.924334    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc" podUID="1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 23:40:32.143999 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:32.143970    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:32.186715 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:32.186676    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 23:40:32.187286 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:32.187250    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz" podUID="5db30e90-72c0-41bd-bc2d-101e8ece1f35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 23:40:32.923300 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:32.923261    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 23:40:32.923540 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:32.923326    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc" podUID="1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 23:40:32.978934 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:32.978901    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:33.164428 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:33.164390    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 23:40:33.164625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:33.164458    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz" podUID="5db30e90-72c0-41bd-bc2d-101e8ece1f35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 23:40:33.755723 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:33.755656    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:33.927780 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:33.927748    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:33.928149 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:33.928123    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:33.928815 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:33.928794    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:40:34.168134 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:34.168106    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:34.168539 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:34.168517    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:34.169236 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:34.169214    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:40:34.585650 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:34.585555    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:35.430582 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:35.430550    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:36.242366 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:36.242307    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:37.045340 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:37.045292    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:38.145578 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:38.145543    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:39.244768 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:39.244734    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:40.035540 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:40.035506    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:40.870209 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:40.870172    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:40.921819 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:40.921763    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"]
Oct 30 23:40:40.928680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:40.928653    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"]
Oct 30 23:40:40.928909 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:40.928775    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:40.997797 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:40.997765    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"]
Oct 30 23:40:41.002787 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.002762    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.017499 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.017472    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"]
Oct 30 23:40:41.037303 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.037263    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istiod-ca-cert\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.037470 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.037316    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-token\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.037470 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.037353    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-credential-socket\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.037470 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.037382    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-workload-socket\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.037470 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.037398    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-token\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.037470 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.037447    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-data\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.037793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.037496    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-workload-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.037793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.037534    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8zgl\" (UniqueName: \"kubernetes.io/projected/d4143a5c-73c5-4535-89f8-ea32b2c52b60-kube-api-access-n8zgl\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.037793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.037572    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-credential-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.037793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.037608    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-data\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.037793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.037638    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-podinfo\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.037793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.037663    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-workload-certs\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.037793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.037678    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-podinfo\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.037793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.037713    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-envoy\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.037793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.037756    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8adef569-361f-4e2b-82c2-43610bd3a7b8-istiod-ca-cert\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.037793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.037790    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npdxl\" (UniqueName: \"kubernetes.io/projected/8adef569-361f-4e2b-82c2-43610bd3a7b8-kube-api-access-npdxl\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.038336 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.037826    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-workload-certs\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.038336 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.037855    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-envoy\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.139491 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.139452    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-envoy\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.139736 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.139504    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8adef569-361f-4e2b-82c2-43610bd3a7b8-istiod-ca-cert\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.139736 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.139532    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npdxl\" (UniqueName: \"kubernetes.io/projected/8adef569-361f-4e2b-82c2-43610bd3a7b8-kube-api-access-npdxl\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.139736 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.139579    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-workload-certs\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.139736 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.139631    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-envoy\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.139736 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.139677    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istiod-ca-cert\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.139736 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.139723    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-token\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.140094 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.139770    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-credential-socket\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.140094 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.139817    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-workload-socket\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.140094 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.139870    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-token\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.140094 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.139950    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-data\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.140094 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.140005    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-workload-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.140094 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.140069    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8zgl\" (UniqueName: \"kubernetes.io/projected/d4143a5c-73c5-4535-89f8-ea32b2c52b60-kube-api-access-n8zgl\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.140418 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.140152    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-credential-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.140418 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.140183    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-data\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.140418 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.140201    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-credential-socket\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.140418 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.140226    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-podinfo\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.140418 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.140270    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-workload-certs\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.140418 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.140295    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-podinfo\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.140790 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.140488    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istiod-ca-cert\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.140790 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.140500    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-workload-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.140790 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.140571    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8adef569-361f-4e2b-82c2-43610bd3a7b8-istiod-ca-cert\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.140790 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.140776    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-data\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.141026 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.140822    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-data\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.141026 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.140980    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-workload-certs\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.141026 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.140978    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-workload-socket\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.141375 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.141207    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-credential-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.141489 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.141468    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-workload-certs\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.142370 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.142342    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-envoy\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.142469 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.142452    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-envoy\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.143046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.143024    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-podinfo\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.143311 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.143278    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-podinfo\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.151877 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.151846    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-token\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.152026 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.152007    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-token\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.152323 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.152300    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npdxl\" (UniqueName: \"kubernetes.io/projected/8adef569-361f-4e2b-82c2-43610bd3a7b8-kube-api-access-npdxl\") pod \"e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") " pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.153206 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.153189    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8zgl\" (UniqueName: \"kubernetes.io/projected/d4143a5c-73c5-4535-89f8-ea32b2c52b60-kube-api-access-n8zgl\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.245811 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.245780    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:41.321174 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.320852    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:41.421543 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:40:41.421499    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:40:41.531763 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.531735    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"]
Oct 30 23:40:41.533195 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:40:41.533173    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4143a5c_73c5_4535_89f8_ea32b2c52b60.slice/crio-94224307ca4e3bdae95088d9ea7c75c6fdd4374ada3bdcd6911b3076bc49e372 WatchSource:0}: Error finding container 94224307ca4e3bdae95088d9ea7c75c6fdd4374ada3bdcd6911b3076bc49e372: Status 404 returned error can't find the container with id 94224307ca4e3bdae95088d9ea7c75c6fdd4374ada3bdcd6911b3076bc49e372
Oct 30 23:40:41.535561 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.535524    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:41.535688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.535633    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:41.535688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.535664    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:41.619870 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.619841    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"]
Oct 30 23:40:41.620931 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:40:41.620904    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8adef569_361f_4e2b_82c2_43610bd3a7b8.slice/crio-88837abd798da3d51d6fb1d0688c8492672188620d0e34b562f5632fd66df7be WatchSource:0}: Error finding container 88837abd798da3d51d6fb1d0688c8492672188620d0e34b562f5632fd66df7be: Status 404 returned error can't find the container with id 88837abd798da3d51d6fb1d0688c8492672188620d0e34b562f5632fd66df7be
Oct 30 23:40:41.624264 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.624214    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:41.624371 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.624314    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:41.624371 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.624359    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:41.650363 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.650331    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:41.936644 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.936521    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8" event={"ID":"8adef569-361f-4e2b-82c2-43610bd3a7b8","Type":"ContainerStarted","Data":"4ad6a1ef59b73fc85309daa39b91ef975a73603641730f3d5f5e6b6116bbd414"}
Oct 30 23:40:41.937084 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.936661    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8" event={"ID":"8adef569-361f-4e2b-82c2-43610bd3a7b8","Type":"ContainerStarted","Data":"88837abd798da3d51d6fb1d0688c8492672188620d0e34b562f5632fd66df7be"}
Oct 30 23:40:41.938954 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.938913    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss" event={"ID":"d4143a5c-73c5-4535-89f8-ea32b2c52b60","Type":"ContainerStarted","Data":"65b9e078858b8aca7d5603ed6bdf45a3a1cdaef320de6061c5b1a4ab5a3738d6"}
Oct 30 23:40:41.939106 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.938977    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss" event={"ID":"d4143a5c-73c5-4535-89f8-ea32b2c52b60","Type":"ContainerStarted","Data":"94224307ca4e3bdae95088d9ea7c75c6fdd4374ada3bdcd6911b3076bc49e372"}
Oct 30 23:40:41.965742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.965692    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8" podStartSLOduration=1.965673213 podStartE2EDuration="1.965673213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:40:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:40:41.959455095 +0000 UTC m=+1301.204310865" watchObservedRunningTime="2026-10-30 23:40:41.965673213 +0000 UTC m=+1301.210528983"
Oct 30 23:40:41.988363 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:41.988307    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss" podStartSLOduration=1.98828769 podStartE2EDuration="1.98828769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:40:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:40:41.984311984 +0000 UTC m=+1301.229167753" watchObservedRunningTime="2026-10-30 23:40:41.98828769 +0000 UTC m=+1301.233143456"
Oct 30 23:40:42.246731 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:42.246648    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:42.248240 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:42.248210    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 23:40:42.248394 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:42.248267    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss" podUID="d4143a5c-73c5-4535-89f8-ea32b2c52b60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 23:40:42.321928 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:42.321891    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:42.323527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:42.323506    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 23:40:42.323644 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:42.323556    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8" podUID="8adef569-361f-4e2b-82c2-43610bd3a7b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 23:40:42.503154 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:42.503064    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:43.247008 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:43.246969    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 23:40:43.247515 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:43.247029    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss" podUID="d4143a5c-73c5-4535-89f8-ea32b2c52b60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 23:40:43.330310 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:43.330269    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 23:40:43.350779 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:43.350739    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8" podUID="8adef569-361f-4e2b-82c2-43610bd3a7b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 23:40:43.352262 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:43.344318    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:44.117163 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:44.117127    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:44.251437 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:44.251401    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 23:40:44.253161 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:44.253123    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss" podUID="d4143a5c-73c5-4535-89f8-ea32b2c52b60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 23:40:44.321903 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:44.321864    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 23:40:44.322048 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:44.321932    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8" podUID="8adef569-361f-4e2b-82c2-43610bd3a7b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 23:40:45.191186 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.191113    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:45.246885 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.246845    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 23:40:45.247166 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.247128    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss" podUID="d4143a5c-73c5-4535-89f8-ea32b2c52b60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 23:40:45.358647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.339844    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"]
Oct 30 23:40:45.362797 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.358674    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 23:40:45.362954 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.362839    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8" podUID="8adef569-361f-4e2b-82c2-43610bd3a7b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 23:40:45.363183 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.358927    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:45.398734 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.398705    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"]
Oct 30 23:40:45.399103 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.399086    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:45.430075 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.430047    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-611ef3\"/\"openshift-service-ca.crt\""
Oct 30 23:40:45.439495 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.430279    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-611ef3\"/\"kube-root-ca.crt\""
Oct 30 23:40:45.439495 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.430971    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-611ef3\"/\"distinct-2-w1-611ef3-kserve-self-signed-certs\""
Oct 30 23:40:45.580002 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.579916    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-611ef3\"/\"default-dockercfg-mdbds\""
Oct 30 23:40:45.627525 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.583945    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-tmp-dir\") pod \"distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") " pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:45.627525 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.625212    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-home\") pod \"distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") " pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:45.627525 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.625392    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-model-cache\") pod \"distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") " pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:45.627525 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.625460    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-dshm\") pod \"distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") " pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:45.627525 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.625497    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41a8c528-85de-4dd2-986d-3e4e26fa0985-tls-certs\") pod \"distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") " pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:45.627525 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.625581    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcjw8\" (UniqueName: \"kubernetes.io/projected/41a8c528-85de-4dd2-986d-3e4e26fa0985-kube-api-access-zcjw8\") pod \"distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") " pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:45.728328 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.728275    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-tmp-dir\") pod \"distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") " pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:45.728507 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.728345    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-home\") pod \"distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") " pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:45.728507 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.728472    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-model-cache\") pod \"distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") " pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:45.728705 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.728528    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-dshm\") pod \"distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") " pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:45.728705 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.728560    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41a8c528-85de-4dd2-986d-3e4e26fa0985-tls-certs\") pod \"distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") " pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:45.728705 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.728641    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcjw8\" (UniqueName: \"kubernetes.io/projected/41a8c528-85de-4dd2-986d-3e4e26fa0985-kube-api-access-zcjw8\") pod \"distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") " pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:45.728882 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.728710    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-tmp-dir\") pod \"distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") " pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:45.728882 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.728779    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-home\") pod \"distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") " pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:45.729036 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.729014    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-model-cache\") pod \"distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") " pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:45.731796 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.731770    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-dshm\") pod \"distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") " pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:45.732603 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.732571    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41a8c528-85de-4dd2-986d-3e4e26fa0985-tls-certs\") pod \"distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") " pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:45.742584 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:45.742075    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcjw8\" (UniqueName: \"kubernetes.io/projected/41a8c528-85de-4dd2-986d-3e4e26fa0985-kube-api-access-zcjw8\") pod \"distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") " pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:46.009620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:46.008870    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:46.246861 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:46.246830    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 23:40:46.247009 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:46.246877    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss" podUID="d4143a5c-73c5-4535-89f8-ea32b2c52b60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 23:40:46.322379 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:46.322173    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 23:40:46.322379 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:46.322237    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8" podUID="8adef569-361f-4e2b-82c2-43610bd3a7b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 23:40:46.347878 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:46.347809    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:46.403162 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:46.403123    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"]
Oct 30 23:40:46.469078 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:40:46.428187    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41a8c528_85de_4dd2_986d_3e4e26fa0985.slice/crio-2ab992d21a2e03c92c215ea6c45257528485a03731e1adde5049306953aae0c8 WatchSource:0}: Error finding container 2ab992d21a2e03c92c215ea6c45257528485a03731e1adde5049306953aae0c8: Status 404 returned error can't find the container with id 2ab992d21a2e03c92c215ea6c45257528485a03731e1adde5049306953aae0c8
Oct 30 23:40:47.025424 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:47.025385    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" event={"ID":"41a8c528-85de-4dd2-986d-3e4e26fa0985","Type":"ContainerStarted","Data":"e0aafa04f19fbf286c649c36f95e94dafb9af60aea540375291587ec575f4ad4"}
Oct 30 23:40:47.025631 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:47.025431    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" event={"ID":"41a8c528-85de-4dd2-986d-3e4e26fa0985","Type":"ContainerStarted","Data":"2ab992d21a2e03c92c215ea6c45257528485a03731e1adde5049306953aae0c8"}
Oct 30 23:40:47.050650 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:47.050583    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podStartSLOduration=2.050570736 podStartE2EDuration="2.050570736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:40:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:40:47.048136126 +0000 UTC m=+1306.292991894" watchObservedRunningTime="2026-10-30 23:40:47.050570736 +0000 UTC m=+1306.295426521"
Oct 30 23:40:47.262662 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:47.248400    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 23:40:47.262662 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:47.248478    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss" podUID="d4143a5c-73c5-4535-89f8-ea32b2c52b60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 23:40:47.328669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:47.325089    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 23:40:47.328669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:47.325165    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8" podUID="8adef569-361f-4e2b-82c2-43610bd3a7b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 23:40:47.653983 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:47.653924    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:48.010291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:48.010200    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:48.246722 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:48.246682    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 23:40:48.246943 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:48.246747    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss" podUID="d4143a5c-73c5-4535-89f8-ea32b2c52b60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 23:40:48.322207 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:48.322117    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 23:40:48.322207 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:48.322174    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8" podUID="8adef569-361f-4e2b-82c2-43610bd3a7b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 23:40:48.429040 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:48.429001    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:48.933608 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:48.933531    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:49.251701 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:49.251568    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:49.252077 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:49.252051    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:49.252870 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:49.252848    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:40:49.451557 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:49.451526    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:49.480195 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:49.480164    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:49.481952 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:49.481128    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:49.485823 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:49.485802    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 30 23:40:50.422449 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:50.422422    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:51.127915 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:51.127886    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:51.898485 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:51.898452    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:52.030556 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:52.030522    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:52.663510 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:52.663428    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:53.429862 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:53.429833    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:54.115075 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:54.115035    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:54.762054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:54.762021    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:54.932287 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:54.932252    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:55.655017 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.654978    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:55.781487 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.781450    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"]
Oct 30 23:40:55.786525 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.786500    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.803491 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.803463    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-podinfo\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.803647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.803515    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf6206f1-d136-4625-bf0a-bb3482bd7839-istiod-ca-cert\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.803647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.803552    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-credential-socket\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.803647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.803624    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-token\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.803787 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.803706    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-workload-socket\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.803787 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.803773    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-envoy\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.803851 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.803801    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-data\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.803851 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.803825    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqmpb\" (UniqueName: \"kubernetes.io/projected/cf6206f1-d136-4625-bf0a-bb3482bd7839-kube-api-access-tqmpb\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.803916 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.803871    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-workload-certs\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.811037 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.810714    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"]
Oct 30 23:40:55.905133 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.905046    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-podinfo\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.905133 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.905105    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf6206f1-d136-4625-bf0a-bb3482bd7839-istiod-ca-cert\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.905388 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.905136    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-credential-socket\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.905388 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.905173    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-token\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.905388 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.905244    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-workload-socket\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.905388 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.905309    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-envoy\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.905388 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.905337    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-data\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.905388 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.905364    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqmpb\" (UniqueName: \"kubernetes.io/projected/cf6206f1-d136-4625-bf0a-bb3482bd7839-kube-api-access-tqmpb\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.905755 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.905411    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-workload-certs\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.905755 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.905631    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-credential-socket\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.905755 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.905726    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-workload-socket\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.906070 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.906050    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf6206f1-d136-4625-bf0a-bb3482bd7839-istiod-ca-cert\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.906133 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.906070    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-workload-certs\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.906133 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.906078    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-data\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.907713 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.907691    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-podinfo\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.907903 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.907885    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-envoy\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.917767 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.917747    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-token\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:55.917857 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:55.917830    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqmpb\" (UniqueName: \"kubernetes.io/projected/cf6206f1-d136-4625-bf0a-bb3482bd7839-kube-api-access-tqmpb\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:56.009337 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.009301    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:56.022537 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.022515    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:56.078527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.078499    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"]
Oct 30 23:40:56.089016 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.088993    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.099937 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.099911    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"]
Oct 30 23:40:56.108731 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.108699    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-credential-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.108867 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.108795    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istiod-ca-cert\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.108867 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.108839    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lzdg\" (UniqueName: \"kubernetes.io/projected/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-kube-api-access-5lzdg\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.109003 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.108937    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-podinfo\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.109003 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.108961    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-token\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.109114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.109012    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-workload-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.109114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.109041    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-envoy\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.109222 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.109150    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-workload-certs\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.109222 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.109175    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-data\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.116402 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.116373    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:56.150272 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.150026    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:40:56.214466 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.210547    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-credential-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.214466 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.210662    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istiod-ca-cert\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.214466 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.210691    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lzdg\" (UniqueName: \"kubernetes.io/projected/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-kube-api-access-5lzdg\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.214466 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.210782    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-podinfo\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.214466 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.210804    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-token\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.214466 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.210852    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-workload-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.214466 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.210880    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-envoy\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.214466 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.210987    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-workload-certs\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.214466 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.211009    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-data\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.214466 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.211549    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-data\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.214466 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.211802    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-credential-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.214466 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.212286    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istiod-ca-cert\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.214466 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.213820    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-workload-certs\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.214466 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.214287    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-workload-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.216993 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.216967    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-podinfo\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.217340 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.217320    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-envoy\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.227791 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.227766    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lzdg\" (UniqueName: \"kubernetes.io/projected/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-kube-api-access-5lzdg\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.228649 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.228629    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-token\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.237397 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.237371    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"]
Oct 30 23:40:56.244128 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.244109    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.258364 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.258342    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"]
Oct 30 23:40:56.258722 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.258701    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-b567bb-openshift-default-dockercfg-wvjgm\""
Oct 30 23:40:56.314671 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.314557    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-credential-socket\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.314671 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.314642    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-token\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.315151 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.314689    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istiod-ca-cert\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.315151 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.314808    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-workload-socket\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.315151 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.314846    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-data\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.315151 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.314909    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-workload-certs\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.315151 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.314945    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpstg\" (UniqueName: \"kubernetes.io/projected/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-kube-api-access-zpstg\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.315151 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.314987    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-envoy\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.315151 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.315033    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-podinfo\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.416116 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.416083    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:56.416575 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.416552    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-workload-socket\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.416680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.416625    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-data\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.416743 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.416680    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-workload-certs\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.416743 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.416707    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpstg\" (UniqueName: \"kubernetes.io/projected/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-kube-api-access-zpstg\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.416849 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.416746    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-envoy\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.416849 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.416791    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-podinfo\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.416950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.416854    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-credential-socket\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.416950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.416897    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-token\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.417043 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.416954    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istiod-ca-cert\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.417095 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.417054    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-workload-socket\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.417095 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.417061    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-data\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.417422 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.417399    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-credential-socket\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.417639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.417614    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-workload-certs\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.418062 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.418016    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istiod-ca-cert\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.420087 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.420063    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-podinfo\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.424586 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.424564    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-envoy\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.430087 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.430064    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-token\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.430997 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.430330    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpstg\" (UniqueName: \"kubernetes.io/projected/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-kube-api-access-zpstg\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.431653 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.431629    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"]
Oct 30 23:40:56.431929 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:40:56.431907    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf6206f1_d136_4625_bf0a_bb3482bd7839.slice/crio-cb43b909113a37df5eb1d446eeedb8800ab28b65eb338d8c27428b75e7f9e310 WatchSource:0}: Error finding container cb43b909113a37df5eb1d446eeedb8800ab28b65eb338d8c27428b75e7f9e310: Status 404 returned error can't find the container with id cb43b909113a37df5eb1d446eeedb8800ab28b65eb338d8c27428b75e7f9e310
Oct 30 23:40:56.434818 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.434783    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:56.434883 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.434848    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:56.434883 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.434877    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:56.572188 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.571912    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:56.717294 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.717208    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:56.795396 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.795361    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"]
Oct 30 23:40:56.809098 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.807587    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:56.809098 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.807698    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:56.809098 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.807746    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:56.884363 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:40:56.884289    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3314cb8c_6ed4_4e6d_80d6_1d38940e88a9.slice/crio-d9f95fa3dd5fb59f866b0c790da74475472eb4a336b253eafce61432b0c52124 WatchSource:0}: Error finding container d9f95fa3dd5fb59f866b0c790da74475472eb4a336b253eafce61432b0c52124: Status 404 returned error can't find the container with id d9f95fa3dd5fb59f866b0c790da74475472eb4a336b253eafce61432b0c52124
Oct 30 23:40:56.887688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.887652    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:56.887785 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.887719    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:56.887785 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.887749    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:40:56.890013 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:56.889990    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"]
Oct 30 23:40:57.139379 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:57.139256    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g" event={"ID":"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9","Type":"ContainerStarted","Data":"119c25b0c8823af3b3bf92dd7e05955cba562a3d597f071d5472aefc0766e8e5"}
Oct 30 23:40:57.139780 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:57.139346    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g" event={"ID":"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9","Type":"ContainerStarted","Data":"d9f95fa3dd5fb59f866b0c790da74475472eb4a336b253eafce61432b0c52124"}
Oct 30 23:40:57.142644 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:57.142045    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" event={"ID":"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec","Type":"ContainerStarted","Data":"43f8a81d78c6283c5ae2fd4748b6da54bb144ae32ef1272fdaca92176bf5eec0"}
Oct 30 23:40:57.142644 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:57.142088    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" event={"ID":"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec","Type":"ContainerStarted","Data":"2c0759ba47d4af0990dea814562aef31befb5b719e51e32951cd37bfe23f04f4"}
Oct 30 23:40:57.146319 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:57.145795    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" event={"ID":"cf6206f1-d136-4625-bf0a-bb3482bd7839","Type":"ContainerStarted","Data":"d9c8aa0022d72197aad63463916597ee008b09356df35404a621ee6d4067e7eb"}
Oct 30 23:40:57.146319 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:57.145848    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" event={"ID":"cf6206f1-d136-4625-bf0a-bb3482bd7839","Type":"ContainerStarted","Data":"cb43b909113a37df5eb1d446eeedb8800ab28b65eb338d8c27428b75e7f9e310"}
Oct 30 23:40:57.168718 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:57.168662    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g" podStartSLOduration=1.168644875 podStartE2EDuration="1.168644875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:40:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:40:57.166850513 +0000 UTC m=+1316.411706279" watchObservedRunningTime="2026-10-30 23:40:57.168644875 +0000 UTC m=+1316.413500644"
Oct 30 23:40:57.191965 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:57.191910    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" podStartSLOduration=2.191892678 podStartE2EDuration="2.191892678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:40:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:40:57.191101154 +0000 UTC m=+1316.435956934" watchObservedRunningTime="2026-10-30 23:40:57.191892678 +0000 UTC m=+1316.436748447"
Oct 30 23:40:57.216984 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:57.216882    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" podStartSLOduration=1.216862013 podStartE2EDuration="1.216862013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:40:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:40:57.213118552 +0000 UTC m=+1316.457974343" watchObservedRunningTime="2026-10-30 23:40:57.216862013 +0000 UTC m=+1316.461717782"
Oct 30 23:40:57.416258 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:57.416226    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:40:57.417924 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:57.417897    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:40:57.418154 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:57.418128    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 23:40:57.585657 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:57.585549    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:40:57.694232 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:57.694154    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:58.132672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:58.123650    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:40:58.132672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:58.123785    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 23:40:58.132672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:58.123854    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 23:40:58.451685 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:58.447953    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:40:58.451685 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:58.448016    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 23:40:58.582620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:58.579878    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 23:40:58.582620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:58.579939    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g" podUID="3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 23:40:58.641552 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:58.641515    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:58.790748 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:58.790658    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:58.963166 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:58.963126    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:40:59.119101 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:59.119004    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 23:40:59.119373 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:59.119342    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 23:40:59.426673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:59.426064    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:40:59.426673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:59.426127    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 23:40:59.581069 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:59.581037    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 23:40:59.581398 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:40:59.581346    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g" podUID="3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 23:41:00.121027 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:00.120988    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 23:41:00.121359 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:00.121286    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 23:41:00.251618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:00.251011    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:00.421696 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:00.419645    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:41:00.421696 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:00.419704    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 23:41:00.582620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:00.577039    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 23:41:00.582620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:00.577100    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g" podUID="3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 23:41:01.122629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:01.121482    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 23:41:01.122629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:01.121543    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 23:41:01.432761 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:01.414866    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:41:01.455653 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:01.452485    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:41:01.455653 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:01.452557    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 23:41:01.508621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:01.496809    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:41:01.569618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:01.544144    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:01.603619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:01.601669    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:41:01.631624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:01.614974    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 23:41:01.631624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:01.615055    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g" podUID="3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 23:41:01.668139 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:01.667783    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:02.137624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:02.134667    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 23:41:02.137624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:02.134729    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 23:41:02.170247 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:02.166982    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:02.434132 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:02.434033    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:02.434946 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:02.434923    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:41:02.468660 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:02.466632    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:41:02.468660 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:02.466691    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 23:41:02.499848 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:02.499806    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:02.500629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:02.500584    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:41:02.602622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:02.593847    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 23:41:02.602622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:02.593926    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g" podUID="3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 23:41:02.608673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:02.608624    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:41:02.693445 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:02.693332    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:02.720659 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:02.704684    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:41:02.726826 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:02.717171    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:02.791662 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:02.786049    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:02.839674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:02.837145    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:41:02.884810 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:02.873820    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:41:03.214677 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:03.184869    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 23:41:03.214677 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:03.184928    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 23:41:03.308621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:03.270032    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:03.308621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:03.301243    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 23:41:03.389353 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:03.329696    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:03.437005 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:03.390904    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:03.471926 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:03.438281    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:41:03.479618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:03.473547    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:41:03.479618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:03.473639    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 23:41:03.556621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:03.525350    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:03.616888 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:03.616837    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:41:03.868679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:03.629784    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 23:41:03.886619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:03.868939    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g" podUID="3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 23:41:03.898620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:03.816946    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:03.924953 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:03.772072    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:41:03.956620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:03.904022    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:04.075618 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:41:04.074806    4921 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.191s"
Oct 30 23:41:04.075618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:04.074918    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:41:04.075618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:04.075030    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:41:04.249928 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:04.249883    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 23:41:04.250265 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:04.250208    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 23:41:04.340622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:04.336880    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:04.502682 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:04.384275    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": context deadline exceeded"
Oct 30 23:41:04.502682 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:04.475946    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:04.537786 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:04.537747    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:41:04.538069 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:04.538038    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 23:41:04.604937 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:04.604763    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:04.780578 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:04.633202    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 23:41:04.888131 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:04.888087    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g" podUID="3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 23:41:04.888609 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:04.826673    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:04.889066 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:04.842102    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:41:04.889318 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:04.889295    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg" podUID="da75f51e-ddb3-40a1-b475-b252bc8954d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:04.900463 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:04.900424    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:04.995910 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:04.995850    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 23:41:04.996660 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:04.996631    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:41:05.013526 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.013498    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:41:05.013858 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.013803    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc" podUID="1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:05.040841 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.040735    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:05.462620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.428776    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 23:41:05.500623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.439176    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 23:41:05.500623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.499765    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 23:41:05.504619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.439311    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:41:05.504619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.502102    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6" podUID="f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:05.508615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.504996    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:05.631630 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.616680    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:05.764062 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.763924    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 23:41:05.795374 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.795309    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g" podUID="3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 23:41:05.819661 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.795048    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:41:05.847742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.822876    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 23:41:05.847742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.823046    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:41:05.847742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.823081    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss" podUID="d4143a5c-73c5-4535-89f8-ea32b2c52b60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:05.847742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.847132    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:41:05.847742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.847179    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:41:05.847742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.847205    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8" podUID="8adef569-361f-4e2b-82c2-43610bd3a7b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:05.847742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:05.847245    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz" podUID="5db30e90-72c0-41bd-bc2d-101e8ece1f35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:06.032285 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.032159    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:06.059633 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.059562    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:41:06.059959 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.059911    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq" podUID="31849433-47df-48bc-87c0-903660560055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:06.149656 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.146828    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 23:41:06.149656 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.146892    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 23:41:06.181442 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.181400    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 23:41:06.240620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.221700    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:41:06.274753 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.221899    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 23:41:06.420681 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:41:06.353393    4921 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.478s"
Oct 30 23:41:06.420681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.353467    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"]
Oct 30 23:41:06.465795 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.465755    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:41:06.466011 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.465835    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 23:41:06.512569 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.512521    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 23:41:06.543828 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.543784    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:06.544513 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.544485    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:06.654199 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.654167    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-b567bb\"/\"distinct-2-w3-b567bb-kserve-self-signed-certs\""
Oct 30 23:41:06.683034 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.674677    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/health\": context deadline exceeded"
Oct 30 23:41:06.683034 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.680965    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"]
Oct 30 23:41:06.683034 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.681107    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:06.733767 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.733729    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 23:41:06.756930 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.751658    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g" podUID="3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 23:41:06.773667 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.745205    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:06.825408 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.812774    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qh8d\" (UniqueName: \"kubernetes.io/projected/cf03d62a-8708-41ed-9013-90e30a26cd9a-kube-api-access-5qh8d\") pod \"distinct-2-w3-b567bb-kserve-7485875cd7-n4l66\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") " pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:06.825408 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.812842    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-tmp-dir\") pod \"distinct-2-w3-b567bb-kserve-7485875cd7-n4l66\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") " pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:06.825408 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.812946    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-model-cache\") pod \"distinct-2-w3-b567bb-kserve-7485875cd7-n4l66\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") " pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:06.825408 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.813007    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-home\") pod \"distinct-2-w3-b567bb-kserve-7485875cd7-n4l66\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") " pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:06.825408 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.813123    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-dshm\") pod \"distinct-2-w3-b567bb-kserve-7485875cd7-n4l66\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") " pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:06.825408 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.813155    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf03d62a-8708-41ed-9013-90e30a26cd9a-tls-certs\") pod \"distinct-2-w3-b567bb-kserve-7485875cd7-n4l66\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") " pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:06.922867 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.922829    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:41:06.923163 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.923131    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9" podUID="59a6ba32-e3e0-479f-8e87-5ee77a926503" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:06.943679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.924766    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qh8d\" (UniqueName: \"kubernetes.io/projected/cf03d62a-8708-41ed-9013-90e30a26cd9a-kube-api-access-5qh8d\") pod \"distinct-2-w3-b567bb-kserve-7485875cd7-n4l66\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") " pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:06.951626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.947726    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-tmp-dir\") pod \"distinct-2-w3-b567bb-kserve-7485875cd7-n4l66\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") " pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:07.012887 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.012842    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-model-cache\") pod \"distinct-2-w3-b567bb-kserve-7485875cd7-n4l66\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") " pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:07.013218 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.013193    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-home\") pod \"distinct-2-w3-b567bb-kserve-7485875cd7-n4l66\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") " pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:07.013526 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.013506    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-dshm\") pod \"distinct-2-w3-b567bb-kserve-7485875cd7-n4l66\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") " pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:07.013695 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.013677    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf03d62a-8708-41ed-9013-90e30a26cd9a-tls-certs\") pod \"distinct-2-w3-b567bb-kserve-7485875cd7-n4l66\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") " pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:07.014693 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:06.953168    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-tmp-dir\") pod \"distinct-2-w3-b567bb-kserve-7485875cd7-n4l66\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") " pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:07.015166 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.015146    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-model-cache\") pod \"distinct-2-w3-b567bb-kserve-7485875cd7-n4l66\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") " pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:07.025640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.015531    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-home\") pod \"distinct-2-w3-b567bb-kserve-7485875cd7-n4l66\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") " pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:07.053831 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.053688    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:07.070356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.070316    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:07.239587 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.228774    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:07.300734 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.300688    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:07.328685 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.328640    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 23:41:07.494183 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.493700    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:07.515804 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.515758    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 23:41:07.801673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.625841    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 23:41:07.801673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.522007    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:41:07.801673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.700805    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 23:41:07.801673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.671275    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:41:07.801673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.679865    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 23:41:07.801673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.753904    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:41:07.801673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.628239    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 23:41:07.801673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:07.756489    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g" podUID="3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 23:41:08.121158 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.121059    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:08.127468 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.124618    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 23:41:08.188627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.185687    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 23:41:08.188627 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:41:08.164160    4921 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.283s"
Oct 30 23:41:08.188627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.138964    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-dshm\") pod \"distinct-2-w3-b567bb-kserve-7485875cd7-n4l66\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") " pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:08.288622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.285272    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:08.312158 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.312124    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf03d62a-8708-41ed-9013-90e30a26cd9a-tls-certs\") pod \"distinct-2-w3-b567bb-kserve-7485875cd7-n4l66\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") " pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:08.330930 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.314539    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:41:08.341587 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.335933    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:08.358527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.358491    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:41:08.360632 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.360585    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qh8d\" (UniqueName: \"kubernetes.io/projected/cf03d62a-8708-41ed-9013-90e30a26cd9a-kube-api-access-5qh8d\") pod \"distinct-2-w3-b567bb-kserve-7485875cd7-n4l66\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") " pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:08.363184 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.362771    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:08.389031 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.388999    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:08.423615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.421257    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:41:08.423615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.421402    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 23:41:08.439193 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.439173    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:41:08.440636 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.439780    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:41:08.472342 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.472313    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:41:08.553166 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.553137    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:41:08.556033 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.556011    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:41:08.598784 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.598744    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 23:41:08.599105 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.599076    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g" podUID="3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 23:41:08.914810 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.914780    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"]
Oct 30 23:41:08.938489 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:08.938457    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:09.123551 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:09.123095    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 23:41:09.123551 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:09.123157    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 23:41:09.134034 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:09.133993    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:09.394850 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:09.394803    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" event={"ID":"cf03d62a-8708-41ed-9013-90e30a26cd9a","Type":"ContainerStarted","Data":"19e51aca58b21f68f94cf952d613dc643ff077a2efecfa6ffc7ba9992c182281"}
Oct 30 23:41:09.395049 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:09.394864    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" event={"ID":"cf03d62a-8708-41ed-9013-90e30a26cd9a","Type":"ContainerStarted","Data":"a0bc94292037259eed83eec1aa89bf7175d43cef3ea07807411fd0ccba82778b"}
Oct 30 23:41:09.418490 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:09.418450    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 23:41:09.418713 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:09.418510    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 23:41:09.419472 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:09.419416    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podStartSLOduration=5.419399251 podStartE2EDuration="5.419399251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:41:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:41:09.419007531 +0000 UTC m=+1328.663863299" watchObservedRunningTime="2026-10-30 23:41:09.419399251 +0000 UTC m=+1328.664255020"
Oct 30 23:41:09.591618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:09.577318    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 23:41:09.591618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:09.577378    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g" podUID="3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 23:41:10.147948 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:10.147911    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:10.391988 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:10.391956    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:10.578941 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:10.578853    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:41:10.579392 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:10.579366    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:41:10.580735 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:10.580712    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:41:11.088620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:11.082724    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:11.126619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:11.126516    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:41:11.171792 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:11.171747    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:41:11.172498 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:11.172462    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:11.419620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:11.418845    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:41:11.436894 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:41:11.436861    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:41:11.463786 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:11.463740    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:41:11.463966 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:11.463812    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:11.535889 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:11.535854    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:41:11.538815 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:11.538787    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 30 23:41:11.830019 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:11.829936    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:41:12.040670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:12.040640    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:12.201644 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:12.194871    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:12.439632 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:12.439588    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:41:13.233619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:13.230463    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:14.114537 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:14.114500    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:14.792031 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:14.792002    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:15.634124 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:15.634092    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:16.437347 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:16.437308    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:17.279111 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:17.279074    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:18.245728 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:18.245673    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:18.392678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:18.392650    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:18.406194 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:18.406169    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:18.508367 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:18.508283    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:19.345301 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:19.345268    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:20.156188 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:20.156133    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:20.964298 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:20.964253    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:21.703360 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:21.703331    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:22.439515 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:22.439480    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:23.162721 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:23.162670    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:23.858044 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:23.858008    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:24.545264 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.545231    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:24.631016 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.630968    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"]
Oct 30 23:41:24.660888 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.660848    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:24.662228 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.662203    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"]
Oct 30 23:41:24.668479 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.668454    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-9ef03a\"/\"openshift-service-ca.crt\""
Oct 30 23:41:24.669838 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.669815    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-9ef03a\"/\"kube-root-ca.crt\""
Oct 30 23:41:24.669989 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.669834    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-9ef03a\"/\"distinct-2-w2-9ef03a-kserve-self-signed-certs\""
Oct 30 23:41:24.670127 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.669891    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-9ef03a\"/\"default-dockercfg-4fxkj\""
Oct 30 23:41:24.711219 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.711192    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:24.737329 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.737303    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-model-cache\") pod \"distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") " pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:24.737439 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.737335    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-tmp-dir\") pod \"distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") " pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:24.737439 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.737362    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-home\") pod \"distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") " pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:24.737511 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.737489    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5qw8\" (UniqueName: \"kubernetes.io/projected/f0f53351-2b81-489a-a08e-dd0d49682556-kube-api-access-d5qw8\") pod \"distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") " pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:24.737557 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.737542    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-dshm\") pod \"distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") " pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:24.737661 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.737649    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f53351-2b81-489a-a08e-dd0d49682556-tls-certs\") pod \"distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") " pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:24.841484 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.841386    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5qw8\" (UniqueName: \"kubernetes.io/projected/f0f53351-2b81-489a-a08e-dd0d49682556-kube-api-access-d5qw8\") pod \"distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") " pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:24.842163 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.842139    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-dshm\") pod \"distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") " pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:24.858384 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.858355    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f53351-2b81-489a-a08e-dd0d49682556-tls-certs\") pod \"distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") " pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:24.859563 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.859540    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-model-cache\") pod \"distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") " pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:24.860081 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.860064    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-tmp-dir\") pod \"distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") " pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:24.860564 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.860542    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-home\") pod \"distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") " pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:24.873621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.860481    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-tmp-dir\") pod \"distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") " pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:24.873865 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.860010    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-model-cache\") pod \"distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") " pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:24.873971 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.855880    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-dshm\") pod \"distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") " pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:24.874057 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.864933    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-home\") pod \"distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") " pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:24.874137 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.870018    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5qw8\" (UniqueName: \"kubernetes.io/projected/f0f53351-2b81-489a-a08e-dd0d49682556-kube-api-access-d5qw8\") pod \"distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") " pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:24.874863 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.874838    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f53351-2b81-489a-a08e-dd0d49682556-tls-certs\") pod \"distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") " pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:24.988744 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:24.988708    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:25.274099 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.274066    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"]
Oct 30 23:41:25.275139 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:41:25.275098    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0f53351_2b81_489a_a08e_dd0d49682556.slice/crio-abe534bc986ef3559a63531978096beeb9b1f1548d0d7af66c3678153ea65e99 WatchSource:0}: Error finding container abe534bc986ef3559a63531978096beeb9b1f1548d0d7af66c3678153ea65e99: Status 404 returned error can't find the container with id abe534bc986ef3559a63531978096beeb9b1f1548d0d7af66c3678153ea65e99
Oct 30 23:41:25.481736 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.479609    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:25.563514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.563422    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" event={"ID":"f0f53351-2b81-489a-a08e-dd0d49682556","Type":"ContainerStarted","Data":"8867c8fa5d2c3113a631b844d411243e3d93453c34d17f790167f0d3f93c9c23"}
Oct 30 23:41:25.563514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.563474    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" event={"ID":"f0f53351-2b81-489a-a08e-dd0d49682556","Type":"ContainerStarted","Data":"abe534bc986ef3559a63531978096beeb9b1f1548d0d7af66c3678153ea65e99"}
Oct 30 23:41:25.585478 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.585426    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podStartSLOduration=1.585411788 podStartE2EDuration="1.585411788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:41:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:41:25.58384839 +0000 UTC m=+1344.828704159" watchObservedRunningTime="2026-10-30 23:41:25.585411788 +0000 UTC m=+1344.830267555"
Oct 30 23:41:25.691289 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.691255    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"]
Oct 30 23:41:25.698711 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.698683    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.783616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.779224    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-token\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.783616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.779341    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-credential-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.783616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.779387    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-workload-certs\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.783616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.779415    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-envoy\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.783616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.779440    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-data\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.783616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.779491    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hm2f\" (UniqueName: \"kubernetes.io/projected/a1c33c43-ad1c-409a-91d0-51a15a29304b-kube-api-access-9hm2f\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.783616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.779546    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1c33c43-ad1c-409a-91d0-51a15a29304b-istiod-ca-cert\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.810234 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.806100    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-podinfo\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.810234 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.806186    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-workload-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.810234 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.806618    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"]
Oct 30 23:41:25.907478 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.907449    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hm2f\" (UniqueName: \"kubernetes.io/projected/a1c33c43-ad1c-409a-91d0-51a15a29304b-kube-api-access-9hm2f\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.907925 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.907499    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1c33c43-ad1c-409a-91d0-51a15a29304b-istiod-ca-cert\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.907925 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.907644    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-podinfo\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.907925 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.907696    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-workload-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.907925 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.907825    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-token\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.908114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.907923    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-credential-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.908114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.907975    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-workload-certs\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.908114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.908010    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-envoy\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.908114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.908039    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-data\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.908262 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.908136    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-workload-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.908262 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.908155    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1c33c43-ad1c-409a-91d0-51a15a29304b-istiod-ca-cert\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.908337 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.908317    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-data\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.908518 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.908497    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-credential-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.908749 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.908734    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-workload-certs\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.910265 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.910245    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-envoy\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.910355 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.910304    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-podinfo\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.922158 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.922132    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-token\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.922310 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.922274    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hm2f\" (UniqueName: \"kubernetes.io/projected/a1c33c43-ad1c-409a-91d0-51a15a29304b-kube-api-access-9hm2f\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:25.991650 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.989646    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:25.991650 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.990085    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"]
Oct 30 23:41:25.995815 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:25.995789    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.006686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.006661    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"]
Oct 30 23:41:26.111366 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.111332    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-token\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.111544 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.111471    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-data\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.111629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.111553    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-envoy\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.111674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.111650    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-credential-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.111720 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.111678    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-workload-certs\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.111720 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.111703    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-podinfo\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.111793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.111778    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-workload-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.111828 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.111806    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb87h\" (UniqueName: \"kubernetes.io/projected/66eff4e5-734b-4b15-82db-5cccb5521c00-kube-api-access-sb87h\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.111900 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.111884    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66eff4e5-734b-4b15-82db-5cccb5521c00-istiod-ca-cert\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.136086 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.136052    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:26.215812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.213530    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-data\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.215812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.213681    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-envoy\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.215812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.213720    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-credential-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.215812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.213757    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-workload-certs\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.215812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.213802    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-podinfo\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.215812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.213880    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-workload-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.215812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.213905    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb87h\" (UniqueName: \"kubernetes.io/projected/66eff4e5-734b-4b15-82db-5cccb5521c00-kube-api-access-sb87h\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.215812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.214006    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66eff4e5-734b-4b15-82db-5cccb5521c00-istiod-ca-cert\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.215812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.214073    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-data\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.215812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.214102    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-token\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.215812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.214714    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-workload-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.215812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.215392    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66eff4e5-734b-4b15-82db-5cccb5521c00-istiod-ca-cert\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.215812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.215757    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-workload-certs\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.215812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.215768    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-credential-socket\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.218355 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.218328    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-envoy\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.218858 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.218836    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-podinfo\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.227005 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.226979    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-token\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.227781 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.227758    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb87h\" (UniqueName: \"kubernetes.io/projected/66eff4e5-734b-4b15-82db-5cccb5521c00-kube-api-access-sb87h\") pod \"e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") " pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.315973 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.315936    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:26.449940 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.449912    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"]
Oct 30 23:41:26.450046 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:41:26.449997    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1c33c43_ad1c_409a_91d0_51a15a29304b.slice/crio-37ac9d2e1f436b3b2984bc96d382ef264d5fa414eabd17259bc7fd784a8efcc6 WatchSource:0}: Error finding container 37ac9d2e1f436b3b2984bc96d382ef264d5fa414eabd17259bc7fd784a8efcc6: Status 404 returned error can't find the container with id 37ac9d2e1f436b3b2984bc96d382ef264d5fa414eabd17259bc7fd784a8efcc6
Oct 30 23:41:26.453449 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.453404    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:41:26.453578 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.453497    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:41:26.453578 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.453568    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:41:26.586618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.585680    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l" event={"ID":"a1c33c43-ad1c-409a-91d0-51a15a29304b","Type":"ContainerStarted","Data":"fc9bbda83eb3c334bd56791392c5ebaa4492ce008f0d24efb14c1b3983d9b7cc"}
Oct 30 23:41:26.586618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.585785    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l" event={"ID":"a1c33c43-ad1c-409a-91d0-51a15a29304b","Type":"ContainerStarted","Data":"37ac9d2e1f436b3b2984bc96d382ef264d5fa414eabd17259bc7fd784a8efcc6"}
Oct 30 23:41:26.609395 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:41:26.609364    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66eff4e5_734b_4b15_82db_5cccb5521c00.slice/crio-088825e02d7b42cf4bf3a984ae7e2863a514085aa12bdffac5ba04ebf89d60fd WatchSource:0}: Error finding container 088825e02d7b42cf4bf3a984ae7e2863a514085aa12bdffac5ba04ebf89d60fd: Status 404 returned error can't find the container with id 088825e02d7b42cf4bf3a984ae7e2863a514085aa12bdffac5ba04ebf89d60fd
Oct 30 23:41:26.611640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.611608    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"]
Oct 30 23:41:26.612258 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.612226    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:41:26.612353 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.612313    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:41:26.612353 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.612348    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:41:26.615429 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.615383    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l" podStartSLOduration=1.615369892 podStartE2EDuration="1.615369892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:41:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:41:26.607851793 +0000 UTC m=+1345.852707562" watchObservedRunningTime="2026-10-30 23:41:26.615369892 +0000 UTC m=+1345.860225659"
Oct 30 23:41:26.753863 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:26.753764    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:27.136638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:27.136587    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:27.138079 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:27.138050    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 23:41:27.138219 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:27.138107    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l" podUID="a1c33c43-ad1c-409a-91d0-51a15a29304b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 23:41:27.632714 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:27.632671    4921 generic.go:356] "Generic (PLEG): container finished" podID="d53cebe3-7403-4d17-8e70-2620bf4362a4" containerID="f2cbddce48fecc6ac398285cacb975e99816b6662b3c8f9aabd3487eb1ebfddf" exitCode=0
Oct 30 23:41:27.632964 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:27.632751    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-74v7f-6hdv9" event={"ID":"d53cebe3-7403-4d17-8e70-2620bf4362a4","Type":"ContainerDied","Data":"f2cbddce48fecc6ac398285cacb975e99816b6662b3c8f9aabd3487eb1ebfddf"}
Oct 30 23:41:27.636170 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:27.636142    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp" event={"ID":"66eff4e5-734b-4b15-82db-5cccb5521c00","Type":"ContainerStarted","Data":"185d1d0ec04093dfbfe509df88d008d906d4e51754bee71592522684ad2b5b3e"}
Oct 30 23:41:27.636310 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:27.636179    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp" event={"ID":"66eff4e5-734b-4b15-82db-5cccb5521c00","Type":"ContainerStarted","Data":"088825e02d7b42cf4bf3a984ae7e2863a514085aa12bdffac5ba04ebf89d60fd"}
Oct 30 23:41:28.137822 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:28.137783    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 23:41:28.138413 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:28.138374    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l" podUID="a1c33c43-ad1c-409a-91d0-51a15a29304b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 23:41:28.319621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:28.319515    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:28.319842 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:28.319711    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 23:41:28.319842 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:28.319764    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp" podUID="66eff4e5-734b-4b15-82db-5cccb5521c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 23:41:28.338367 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:28.338315    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:28.988621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:28.980713    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-74v7f-6hdv9"
Oct 30 23:41:29.009443 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.009383    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp" podStartSLOduration=4.00936314 podStartE2EDuration="4.00936314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:41:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:41:27.685090756 +0000 UTC m=+1346.929946524" watchObservedRunningTime="2026-10-30 23:41:29.00936314 +0000 UTC m=+1348.254218909"
Oct 30 23:41:29.136564 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.136533    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d53cebe3-7403-4d17-8e70-2620bf4362a4-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/d53cebe3-7403-4d17-8e70-2620bf4362a4-archives-path\") pod \"d53cebe3-7403-4d17-8e70-2620bf4362a4\" (UID: \"d53cebe3-7403-4d17-8e70-2620bf4362a4\") "
Oct 30 23:41:29.136802 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.136691    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d53cebe3-7403-4d17-8e70-2620bf4362a4-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d53cebe3-7403-4d17-8e70-2620bf4362a4-trusted-ca-bundle\") pod \"d53cebe3-7403-4d17-8e70-2620bf4362a4\" (UID: \"d53cebe3-7403-4d17-8e70-2620bf4362a4\") "
Oct 30 23:41:29.136802 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.136726    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d53cebe3-7403-4d17-8e70-2620bf4362a4-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d53cebe3-7403-4d17-8e70-2620bf4362a4-service-ca-bundle\") pod \"d53cebe3-7403-4d17-8e70-2620bf4362a4\" (UID: \"d53cebe3-7403-4d17-8e70-2620bf4362a4\") "
Oct 30 23:41:29.136969 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.136868    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d53cebe3-7403-4d17-8e70-2620bf4362a4-kube-api-access-bvm2h\" (UniqueName: \"kubernetes.io/projected/d53cebe3-7403-4d17-8e70-2620bf4362a4-kube-api-access-bvm2h\") pod \"d53cebe3-7403-4d17-8e70-2620bf4362a4\" (UID: \"d53cebe3-7403-4d17-8e70-2620bf4362a4\") "
Oct 30 23:41:29.138131 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.137934    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d53cebe3-7403-4d17-8e70-2620bf4362a4-archives-path" pod "d53cebe3-7403-4d17-8e70-2620bf4362a4" (UID: "d53cebe3-7403-4d17-8e70-2620bf4362a4"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:41:29.138131 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.137955    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d53cebe3-7403-4d17-8e70-2620bf4362a4-trusted-ca-bundle" pod "d53cebe3-7403-4d17-8e70-2620bf4362a4" (UID: "d53cebe3-7403-4d17-8e70-2620bf4362a4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:41:29.138933 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.138329    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d53cebe3-7403-4d17-8e70-2620bf4362a4-service-ca-bundle" pod "d53cebe3-7403-4d17-8e70-2620bf4362a4" (UID: "d53cebe3-7403-4d17-8e70-2620bf4362a4"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:41:29.138933 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.138343    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 23:41:29.138933 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.138386    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l" podUID="a1c33c43-ad1c-409a-91d0-51a15a29304b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 23:41:29.141024 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.141002    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d53cebe3-7403-4d17-8e70-2620bf4362a4-kube-api-access-bvm2h" pod "d53cebe3-7403-4d17-8e70-2620bf4362a4" (UID: "d53cebe3-7403-4d17-8e70-2620bf4362a4"). InnerVolumeSpecName "kube-api-access-bvm2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:41:29.239271 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.239142    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvm2h\" (UniqueName: \"kubernetes.io/projected/d53cebe3-7403-4d17-8e70-2620bf4362a4-kube-api-access-bvm2h\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:41:29.239271 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.239180    4921 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/d53cebe3-7403-4d17-8e70-2620bf4362a4-archives-path\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:41:29.239271 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.239195    4921 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d53cebe3-7403-4d17-8e70-2620bf4362a4-trusted-ca-bundle\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:41:29.239271 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.239207    4921 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d53cebe3-7403-4d17-8e70-2620bf4362a4-service-ca-bundle\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:41:29.317527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.316996    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 23:41:29.317527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.317055    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp" podUID="66eff4e5-734b-4b15-82db-5cccb5521c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 23:41:29.390622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.386169    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:29.649817 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.649782    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-74v7f-6hdv9" event={"ID":"d53cebe3-7403-4d17-8e70-2620bf4362a4","Type":"ContainerDied","Data":"8c392e66b0b0bfc31144e85ac960cbd9379e02124a5bc01d37ef66243999b1f0"}
Oct 30 23:41:29.649978 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.649838    4921 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c392e66b0b0bfc31144e85ac960cbd9379e02124a5bc01d37ef66243999b1f0"
Oct 30 23:41:29.649978 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:29.649899    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-74v7f-6hdv9"
Oct 30 23:41:30.133439 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:30.133405    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:30.136680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:30.136656    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 23:41:30.136816 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:30.136705    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l" podUID="a1c33c43-ad1c-409a-91d0-51a15a29304b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 23:41:30.317511 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:30.317044    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 23:41:30.317511 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:30.317105    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp" podUID="66eff4e5-734b-4b15-82db-5cccb5521c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 23:41:30.320392 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:30.320357    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:31.127059 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:31.127026    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:31.140464 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:31.139976    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 23:41:31.140464 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:31.140036    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l" podUID="a1c33c43-ad1c-409a-91d0-51a15a29304b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 23:41:31.317241 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:31.317156    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 23:41:31.317535 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:31.317494    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp" podUID="66eff4e5-734b-4b15-82db-5cccb5521c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 23:41:31.862618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:31.854823    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:32.051633 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:32.046306    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:32.332620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:32.331768    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": context deadline exceeded"
Oct 30 23:41:32.344618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:32.334797    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:41:32.370622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:32.345346    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 23:41:32.370949 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:32.370910    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l" podUID="a1c33c43-ad1c-409a-91d0-51a15a29304b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 23:41:32.399794 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:32.346009    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 23:41:32.400120 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:32.400071    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp" podUID="66eff4e5-734b-4b15-82db-5cccb5521c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 23:41:32.491634 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:32.480682    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:32.506753 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:32.506688    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:32.953620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:32.928517    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:33.181938 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:33.013653    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 23:41:33.183607 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:33.051496    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:33.183607 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:33.150218    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 23:41:33.183607 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:33.183029    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l" podUID="a1c33c43-ad1c-409a-91d0-51a15a29304b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 23:41:33.592620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:33.573049    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:33.592620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:33.574276    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:33.592620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:33.577042    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:41:33.592620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:33.579741    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 23:41:33.592620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:33.587153    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:41:33.624949 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:33.580756    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/health\": context deadline exceeded"
Oct 30 23:41:33.693639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:33.666410    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 23:41:33.715934 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:33.715894    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp" podUID="66eff4e5-734b-4b15-82db-5cccb5521c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 23:41:33.716221 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:33.667698    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:41:33.741963 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:33.741925    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:41:33.743181 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:33.743158    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:33.762620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:33.743377    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:41:33.990748 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:33.990683    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:34.098373 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.098315    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:34.172075 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.172041    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 23:41:34.172362 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.172326    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l" podUID="a1c33c43-ad1c-409a-91d0-51a15a29304b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 23:41:34.178717 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.178686    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:34.179081 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.179058    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:34.179409 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.179392    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:41:34.179617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.179585    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:41:34.214892 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.201333    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 23:41:34.347032 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.338759    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 23:41:34.347032 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.338822    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp" podUID="66eff4e5-734b-4b15-82db-5cccb5521c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 23:41:34.721619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.720557    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:34.743225 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.742418    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:41:34.745380 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.743471    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 23:41:34.745380 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.743779    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:41:34.787618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.787093    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:41:34.862653 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.862564    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:41:34.917756 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.917725    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:41:34.975927 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.975846    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:41:34.975927 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.975913    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:34.993464 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:34.991815    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:35.014927 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:35.014897    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:35.137583 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:35.137546    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 23:41:35.137784 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:35.137638    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l" podUID="a1c33c43-ad1c-409a-91d0-51a15a29304b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 23:41:35.317171 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:35.317092    4921 patch_prober.go:29] interesting pod/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 23:41:35.317171 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:35.317147    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp" podUID="66eff4e5-734b-4b15-82db-5cccb5521c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 23:41:35.605344 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:35.605242    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:35.797608 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:35.797555    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:36.635346 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:36.635309    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:36.635778 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:36.635754    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:36.636658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:36.636639    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:41:36.760663 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:36.760627    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:37.132645 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:37.132616    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:37.133236 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:37.133202    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:37.134018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:37.133990    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:41:37.741499 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:37.741469    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:38.637798 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:38.637765    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:39.320778 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:39.320732    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:40.135057 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:40.135018    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:41.170617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:41.169297    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:41.405340 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:41:41.405299    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:41:41.855616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:41.854076    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:42.824486 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:42.824436    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:43.523209 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:43.523169    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:44.310049 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:44.310020    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:45.177192 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:45.177152    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:46.159621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:46.156027    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:46.961346 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:46.961312    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:47.749947 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:47.749914    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:48.532778 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:48.532743    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:49.229031 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:49.228990    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:50.177925 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:50.177887    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:51.192052 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:51.192021    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:51.977080 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:51.977044    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:52.116946 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:52.116891    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:52.872677 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:52.872570    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:53.773758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:53.773721    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:54.905657 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:54.904409    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:55.576430 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.576393    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:55.826519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.826441    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"]
Oct 30 23:41:55.827106 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.827090    4921 cpu_manager.go:414] "containerMap: removing container" podUID="d53cebe3-7403-4d17-8e70-2620bf4362a4" containerName="insights-gathering"
Oct 30 23:41:55.827157 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.827107    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d53cebe3-7403-4d17-8e70-2620bf4362a4" containerName="insights-gathering"
Oct 30 23:41:55.827261 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.827251    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="d53cebe3-7403-4d17-8e70-2620bf4362a4" containerName="insights-gathering"
Oct 30 23:41:55.830847 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.830829    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:55.853956 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.853928    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"]
Oct 30 23:41:55.868369 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.868339    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"]
Oct 30 23:41:55.873975 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.873940    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:55.919763 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.919735    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"]
Oct 30 23:41:55.920694 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.920667    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbvz9\" (UniqueName: \"kubernetes.io/projected/dedc712d-832a-4a02-bbd6-83a7d728835c-kube-api-access-kbvz9\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:55.920816 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.920771    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-credential-socket\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:55.920882 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.920856    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-workload-socket\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:55.920945 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.920921    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-podinfo\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:55.921067 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.921046    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-data\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:55.921134 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.921092    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istiod-ca-cert\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:55.921134 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.921120    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dedc712d-832a-4a02-bbd6-83a7d728835c-istiod-ca-cert\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:55.921210 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.921155    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-envoy\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:55.921210 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.921181    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-token\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:55.921285 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.921222    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-token\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:55.921285 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.921263    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-envoy\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:55.921356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.921313    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-workload-socket\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:55.921356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.921343    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-podinfo\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:55.921434 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.921370    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-workload-certs\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:55.921434 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.921419    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-data\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:55.921503 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.921450    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-workload-certs\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:55.921503 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.921479    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-credential-socket\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:55.921756 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:55.921734    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sfh7\" (UniqueName: \"kubernetes.io/projected/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-kube-api-access-9sfh7\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.023656 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.023625    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-data\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.023838 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.023675    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-workload-certs\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.023838 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.023704    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-credential-socket\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:56.023838 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.023804    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sfh7\" (UniqueName: \"kubernetes.io/projected/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-kube-api-access-9sfh7\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.024089 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.023888    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbvz9\" (UniqueName: \"kubernetes.io/projected/dedc712d-832a-4a02-bbd6-83a7d728835c-kube-api-access-kbvz9\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:56.024089 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.023932    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-credential-socket\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.024089 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.024012    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-workload-socket\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:56.024089 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.024020    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-workload-certs\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.024089 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.024017    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-data\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.024089 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.024048    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-podinfo\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:56.024527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.024112    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-data\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:56.024527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.024148    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istiod-ca-cert\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.024987 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.024877    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dedc712d-832a-4a02-bbd6-83a7d728835c-istiod-ca-cert\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:56.024987 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.024932    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-envoy\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.024987 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.024959    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-token\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:56.025254 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.025005    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-token\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.025254 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.025049    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-envoy\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:56.025254 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.025105    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-workload-socket\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.025254 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.025138    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-podinfo\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.025254 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.025170    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-workload-certs\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:56.025545 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.025521    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istiod-ca-cert\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.025645 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.024818    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-workload-socket\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:56.025645 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.024531    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-data\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:56.025645 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.025579    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-workload-certs\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:56.026201 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.026176    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dedc712d-832a-4a02-bbd6-83a7d728835c-istiod-ca-cert\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:56.026294 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.024531    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-credential-socket\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.026294 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.026281    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-credential-socket\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:56.027392 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.027337    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-podinfo\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:56.028543 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.028474    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-workload-socket\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.029166 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.029128    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-envoy\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.029764 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.029745    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-podinfo\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.030869 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.030850    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-envoy\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:56.086259 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.086188    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sfh7\" (UniqueName: \"kubernetes.io/projected/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-kube-api-access-9sfh7\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.086418 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.086240    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-token\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.087050 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.087027    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-token\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:56.087311 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.087290    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbvz9\" (UniqueName: \"kubernetes.io/projected/dedc712d-832a-4a02-bbd6-83a7d728835c-kube-api-access-kbvz9\") pod \"e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") " pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:56.144532 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.144508    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:56.188572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.188543    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:41:56.209559 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.209531    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"]
Oct 30 23:41:56.214692 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.214668    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.254383 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.254339    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"]
Oct 30 23:41:56.330819 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.330785    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f91240cc-16c4-406a-9db3-4f40de05e354-istiod-ca-cert\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.331001 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.330844    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9jjk\" (UniqueName: \"kubernetes.io/projected/f91240cc-16c4-406a-9db3-4f40de05e354-kube-api-access-z9jjk\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.331087 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.331063    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-credential-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.331181 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.331167    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-workload-certs\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.331308 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.331254    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f91240cc-16c4-406a-9db3-4f40de05e354-istio-podinfo\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.331394 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.331308    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-istio-envoy\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.331394 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.331371    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-workload-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.331505 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.331409    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f91240cc-16c4-406a-9db3-4f40de05e354-istio-token\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.331505 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.331456    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-istio-data\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.386204 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.386172    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"]
Oct 30 23:41:56.391716 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.391690    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.415198 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.415099    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"]
Oct 30 23:41:56.433342 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.433306    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-envoy\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.433474 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.433393    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f91240cc-16c4-406a-9db3-4f40de05e354-istio-token\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.433474 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.433420    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8xq5\" (UniqueName: \"kubernetes.io/projected/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-kube-api-access-s8xq5\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.433474 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.433446    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-istio-data\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.433687 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.433475    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-data\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.433687 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.433523    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f91240cc-16c4-406a-9db3-4f40de05e354-istiod-ca-cert\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.433687 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.433545    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istiod-ca-cert\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.433687 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.433574    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9jjk\" (UniqueName: \"kubernetes.io/projected/f91240cc-16c4-406a-9db3-4f40de05e354-kube-api-access-z9jjk\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.433687 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.433641    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-workload-socket\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.433951 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.433706    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-credential-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.433951 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.433753    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-credential-socket\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.433951 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.433786    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-workload-certs\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.433951 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.433828    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-workload-certs\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.434158 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.433933    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f91240cc-16c4-406a-9db3-4f40de05e354-istio-podinfo\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.434687 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.434659    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-istio-envoy\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.434791 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.434733    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-podinfo\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.434860 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.434785    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-workload-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.434860 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.434812    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-token\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.435641 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.435568    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-istio-data\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.436464 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.436432    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f91240cc-16c4-406a-9db3-4f40de05e354-istiod-ca-cert\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.440025 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.439812    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-workload-certs\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.440025 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.439860    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-credential-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.440025 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.439992    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-istio-envoy\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.440254 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.440048    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-workload-socket\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.442733 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.442693    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f91240cc-16c4-406a-9db3-4f40de05e354-istio-podinfo\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.448375 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.448351    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f91240cc-16c4-406a-9db3-4f40de05e354-istio-token\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.462657 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.461441    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9jjk\" (UniqueName: \"kubernetes.io/projected/f91240cc-16c4-406a-9db3-4f40de05e354-kube-api-access-z9jjk\") pod \"e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") " pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.466218 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:41:56.466167    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6923aee3_e3d4_4aac_8b12_7815ea7e2afc.slice/crio-25deeeeed05e590b56b1d9fe58d955344a47450224f336ce55cad2f155527b5a WatchSource:0}: Error finding container 25deeeeed05e590b56b1d9fe58d955344a47450224f336ce55cad2f155527b5a: Status 404 returned error can't find the container with id 25deeeeed05e590b56b1d9fe58d955344a47450224f336ce55cad2f155527b5a
Oct 30 23:41:56.466346 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.466314    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"]
Oct 30 23:41:56.470141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.470106    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:41:56.470246 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.470183    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:41:56.470246 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.470228    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:41:56.584620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.545660    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-workload-socket\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.710198 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.710166    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-credential-socket\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.710457 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.710442    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-workload-certs\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.710733 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.710715    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-podinfo\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.710888 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.710870    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-token\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.729048 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.729020    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-envoy\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.729299 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.729283    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8xq5\" (UniqueName: \"kubernetes.io/projected/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-kube-api-access-s8xq5\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.729430 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.729418    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-data\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.729584 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.729571    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istiod-ca-cert\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.729875 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.709974    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:41:56.730039 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.730006    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:41:56.730200 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.730181    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:41:56.730895 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.588795    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:41:56.744746 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.593054    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-workload-socket\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.744746 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.721318    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-credential-socket\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.744746 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.741454    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-data\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.744746 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.667311    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"]
Oct 30 23:41:56.744746 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.742205    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istiod-ca-cert\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.744746 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.721102    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-workload-certs\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.777621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.769268    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-podinfo\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.831704 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.824761    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-token\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:56.936672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:56.929431    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-envoy\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:57.086620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:57.058461    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8xq5\" (UniqueName: \"kubernetes.io/projected/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-kube-api-access-s8xq5\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:57.086620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:57.084155    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:41:57.824692 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:57.821146    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 23:41:57.872799 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:57.872752    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn" event={"ID":"dedc712d-832a-4a02-bbd6-83a7d728835c","Type":"ContainerStarted","Data":"8abe0e83afc5946b51c80efb29158d0da298c4f5db331d641c6e4cb3a9e3575e"}
Oct 30 23:41:57.910392 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:57.910351    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" event={"ID":"6923aee3-e3d4-4aac-8b12-7815ea7e2afc","Type":"ContainerStarted","Data":"25deeeeed05e590b56b1d9fe58d955344a47450224f336ce55cad2f155527b5a"}
Oct 30 23:41:57.912121 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:57.912080    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:58.061235 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:58.046079    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" podStartSLOduration=3.046057934 podStartE2EDuration="3.046057934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:41:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:41:58.016101103 +0000 UTC m=+1377.260956893" watchObservedRunningTime="2026-10-30 23:41:58.046057934 +0000 UTC m=+1377.290913706"
Oct 30 23:41:58.274640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:58.199406    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:41:58.309180 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:58.275021    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:41:58.309180 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:58.275083    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 23:41:58.309180 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:58.275789    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:58.428199 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:58.428162    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"]
Oct 30 23:41:58.449948 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:58.447442    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:41:58.449948 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:58.447538    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:41:58.449948 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:58.447619    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:41:58.568621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:58.568363    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:58.614940 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:58.610889    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:41:58.823621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:58.822714    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:58.823621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:58.823192    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:58.833623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:58.825689    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:41:58.870618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:58.866177    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:41:58.909884 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:58.872035    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:58.909884 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:58.903851    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:58.914219 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:58.912762    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:58.940750 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:58.924160    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:59.232620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.231769    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:41:59.232620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.231831    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 23:41:59.299619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.294936    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:59.456634 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.443675    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:59.464640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.462900    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:41:59.464640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.462961    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:41:59.529622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.497393    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" event={"ID":"6923aee3-e3d4-4aac-8b12-7815ea7e2afc","Type":"ContainerStarted","Data":"bf9196c0c339cb385b852e11e2e7be7a2187f68e0e79cf376a84fac3d9e68ae4"}
Oct 30 23:41:59.599727 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.585958    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:41:59.600332 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.600306    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:41:59.936198 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.924737    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:59.936198 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.928395    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:59.951622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.945721    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:59.951835 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.951697    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:59.968100 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.952013    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 23:41:59.994033 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.979817    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:41:59.994033 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.979878    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:41:59.994033 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.979897    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd" event={"ID":"f91240cc-16c4-406a-9db3-4f40de05e354","Type":"ContainerStarted","Data":"a2ca8f8842f11267f9db7aed6379a4e058ee1979313d8668f3cae9b0da43aa1b"}
Oct 30 23:41:59.994033 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.980017    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:41:59.994033 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.991975    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:41:59.994033 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.992490    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:41:59.994033 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.992882    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:41:59.994033 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:41:59.992934    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:42:00.187559 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:00.187405    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:42:00.187559 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:00.187459    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 23:42:00.349191 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:00.349087    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 23:42:00.606862 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:00.606772    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:01.021129 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:00.997759    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 23:42:01.269621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:01.249705    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 23:42:01.269621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:01.257891    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 23:42:01.395846 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:01.092518    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 23:42:01.502623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:01.449280    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 23:42:02.085622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:01.572151    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:42:02.085622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:01.572300    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:42:02.085622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:01.642665    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:42:02.085622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:01.092554    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:42:02.085622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:01.757338    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:42:02.085622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:02.072324    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 23:42:02.216622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:02.213565    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:02.278427 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:02.266721    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:02.278427 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:02.266872    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:02.361701 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:02.358028    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:02.509622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:02.505757    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js" podUID="257ac775-bcbb-4e52-a0a5-d9325172f2e4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:02.640348 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:02.638238    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:42:02.640348 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:02.638337    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:42:02.640348 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:02.638412    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:42:02.766198 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:02.766152    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": context deadline exceeded"
Oct 30 23:42:02.775629 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:42:02.768665    4921 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.893s"
Oct 30 23:42:02.846234 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:42:02.846193    4921 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a466c39_73fa_48a5_a599_1bdfcd5f5eb7.slice/crio-3b3c6d42354d9585bec31aa8c7097434fc52158761570a00b1cbfa7618dc4755\": RecentStats: unable to find data in memory cache]"
Oct 30 23:42:03.097791 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:03.075299    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:42:03.105077 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:03.101786    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 23:42:03.161269 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:03.161237    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:42:03.199549 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:03.199507    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 23:42:03.429724 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:03.429690    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 23:42:03.429968 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:03.429940    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn" podUID="dedc712d-832a-4a02-bbd6-83a7d728835c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 23:42:03.723684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:03.649012    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn" event={"ID":"dedc712d-832a-4a02-bbd6-83a7d728835c","Type":"ContainerStarted","Data":"a60500426d00451bc572110c0531e063d5002eee389b112992b7a9a7fdbd8560"}
Oct 30 23:42:03.723684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:03.649085    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:42:03.723684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:03.669653    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd" event={"ID":"f91240cc-16c4-406a-9db3-4f40de05e354","Type":"ContainerStarted","Data":"2da398b05d2e817f96d3d076abd29e78054787cabf09d10664a8e6ba11723e46"}
Oct 30 23:42:03.897423 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:03.895658    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"]
Oct 30 23:42:03.978812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:03.978709    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:03.979102 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:03.979077    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 23:42:03.979610 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:03.979553    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:42:03.980067 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:03.980041    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:03.980461 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:03.980437    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:42:03.984900 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:03.980978    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:42:03.992616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:03.981006    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 23:42:03.996616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:03.981027    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 23:42:04.011619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:03.981047    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 23:42:04.028027 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:04.006232    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn" podStartSLOduration=9.006194225 podStartE2EDuration="9.006194225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:41:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:42:03.479032529 +0000 UTC m=+1382.723888297" watchObservedRunningTime="2026-10-30 23:42:04.006194225 +0000 UTC m=+1383.251049995"
Oct 30 23:42:04.068856 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:04.068808    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:04.087619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:04.079740    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:04.147674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:04.088754    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": context deadline exceeded"
Oct 30 23:42:04.147674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:04.130025    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd" podStartSLOduration=8.130003193 podStartE2EDuration="8.130003193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:41:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:42:03.858066592 +0000 UTC m=+1383.102922433" watchObservedRunningTime="2026-10-30 23:42:04.130003193 +0000 UTC m=+1383.374858963"
Oct 30 23:42:04.184622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:04.173024    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:42:04.184622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:04.173083    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 23:42:04.209926 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:04.209881    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 23:42:04.210257 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:04.210202    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn" podUID="dedc712d-832a-4a02-bbd6-83a7d728835c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 23:42:04.599510 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:04.599414    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:42:04.600030 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:04.600002    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 23:42:04.600178 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:04.600153    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd" podUID="f91240cc-16c4-406a-9db3-4f40de05e354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 23:42:04.867674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:04.858853    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:42:04.867674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:04.858947    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg" podUID="da75f51e-ddb3-40a1-b475-b252bc8954d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:05.009154 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:04.988691    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:05.009154 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:04.989117    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 23:42:05.009154 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:04.989422    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:42:05.009154 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:04.989734    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:42:05.011739 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.011697    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:42:05.011983 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.011957    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc" podUID="1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:05.043620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.023911    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:42:05.102305 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.026049    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 23:42:05.230257 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.026110    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:05.231291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.030716    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 23:42:05.231802 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.101880    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 23:42:05.232225 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.147413    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:42:05.232423 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.232386    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 23:42:05.232554 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.163103    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 23:42:05.232716 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.232693    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c" podUID="8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 23:42:05.232865 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.212452    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 23:42:05.236616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.232983    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn" podUID="dedc712d-832a-4a02-bbd6-83a7d728835c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 23:42:05.414503 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.414443    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c" podStartSLOduration=9.414425015 podStartE2EDuration="9.414425015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:41:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:42:05.38962656 +0000 UTC m=+1384.634482334" watchObservedRunningTime="2026-10-30 23:42:05.414425015 +0000 UTC m=+1384.659280788"
Oct 30 23:42:05.435504 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.435475    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:42:05.435805 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.435768    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c" event={"ID":"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7","Type":"ContainerStarted","Data":"d07d9c6592ecb0eae271cb704cef28d3e3eba92c5822653321ce19fd03c59e45"}
Oct 30 23:42:05.436345 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.436320    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c" event={"ID":"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7","Type":"ContainerStarted","Data":"3b3c6d42354d9585bec31aa8c7097434fc52158761570a00b1cbfa7618dc4755"}
Oct 30 23:42:05.610684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.599854    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 23:42:05.610684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.599907    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd" podUID="f91240cc-16c4-406a-9db3-4f40de05e354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 23:42:05.737622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.712166    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:42:05.737935 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.737895    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j" podUID="b14e7bdd-df95-4c34-958c-3b023b9596fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:05.964807 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.964768    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:42:05.977734 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.977684    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq" podUID="31849433-47df-48bc-87c0-903660560055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:05.993771 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.993721    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:06.019626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.994321    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:42:06.023081 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:06.023038    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:06.023331 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.996721    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:42:06.035276 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:05.996691    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 23:42:06.163620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:06.162303    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 23:42:06.163620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:06.162366    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c" podUID="8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 23:42:06.190626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:06.164051    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:42:06.226680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:06.195710    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:42:06.226680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:06.195769    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 23:42:06.239620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:06.231994    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:06.244149 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:06.244090    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:06.275747 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:06.275682    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:06.325854 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:06.245674    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 23:42:06.426615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:06.423856    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:42:06.426615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:06.423932    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9" podUID="59a6ba32-e3e0-479f-8e87-5ee77a926503" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:06.426615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:06.424941    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 23:42:06.426615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:06.424981    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn" podUID="dedc712d-832a-4a02-bbd6-83a7d728835c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 23:42:06.571494 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:06.536420    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:06.753843 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:06.753803    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:42:07.010950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:07.007840    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:07.073800 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:07.073746    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:07.093509 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:07.079977    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:42:07.094942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:07.082620    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/health\": context deadline exceeded"
Oct 30 23:42:07.095170 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:07.083920    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:07.098794 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:07.098770    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 23:42:07.100233 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:07.100205    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c" podUID="8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 23:42:07.155060 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:07.155024    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:42:07.155301 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:07.155275    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 23:42:07.187822 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:07.187786    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 23:42:07.215934 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:07.215891    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd" podUID="f91240cc-16c4-406a-9db3-4f40de05e354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 23:42:07.216200 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:07.193156    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:42:07.216617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:07.201895    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 23:42:07.230152 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:07.230108    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn" podUID="dedc712d-832a-4a02-bbd6-83a7d728835c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 23:42:07.241407 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:07.241333    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:07.729309 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:07.713351    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:07.901620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:07.807392    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 23:42:07.901620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:07.850936    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 23:42:07.901620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:07.901535    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd" podUID="f91240cc-16c4-406a-9db3-4f40de05e354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 23:42:08.108677 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:08.011363    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:08.177621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:08.015935    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:08.177621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:08.101086    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:08.177621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:08.101176    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:42:08.177621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:08.101212    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:08.177621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:08.102788    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 23:42:08.177621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:08.146544    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c" podUID="8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 23:42:08.217622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:08.195224    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 23:42:08.217622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:08.195301    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn" podUID="dedc712d-832a-4a02-bbd6-83a7d728835c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 23:42:08.229221 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:08.229178    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:08.262058 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:08.250943    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 23:42:08.303630 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:08.291636    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:42:08.303630 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:08.291703    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 23:42:08.442619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:08.439334    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:08.623621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:08.622610    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 23:42:08.623621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:08.622686    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd" podUID="f91240cc-16c4-406a-9db3-4f40de05e354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 23:42:08.920621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:08.901663    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:08.920621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:08.901983    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 23:42:09.112620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:09.108733    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 23:42:09.112620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:09.108797    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c" podUID="8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 23:42:09.157623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:09.155685    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:09.157623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:09.156083    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:42:09.157623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:09.156363    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 23:42:09.157623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:09.156626    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 23:42:09.157623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:09.156878    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:42:09.157623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:09.157195    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:42:09.183676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:09.174706    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:42:09.183676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:09.174759    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 23:42:09.211645 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:09.189198    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 23:42:09.211645 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:09.189252    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn" podUID="dedc712d-832a-4a02-bbd6-83a7d728835c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 23:42:09.276640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:09.274690    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:09.276640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:09.275097    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:42:09.422953 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:09.394655    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:09.602292 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:09.602202    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 23:42:09.602669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:09.602639    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd" podUID="f91240cc-16c4-406a-9db3-4f40de05e354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 23:42:09.912674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:09.902779    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 23:42:09.912674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:09.903120    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 23:42:10.142626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:10.137549    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 23:42:10.143631 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:10.143165    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c" podUID="8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 23:42:10.164694 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:10.161412    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:42:10.164694 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:10.161465    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 23:42:10.164694 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:10.161540    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:10.164694 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:10.161830    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:42:10.164694 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:10.162056    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:42:10.164694 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:10.162268    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 23:42:10.164694 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:10.162485    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 23:42:10.210619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:10.210469    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 23:42:10.210619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:10.210530    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn" podUID="dedc712d-832a-4a02-bbd6-83a7d728835c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 23:42:10.280620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:10.277221    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:10.288835 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:10.277674    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:10.606886 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:10.606798    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 23:42:10.607345 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:10.607314    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd" podUID="f91240cc-16c4-406a-9db3-4f40de05e354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 23:42:10.941629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:10.938910    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:10.941629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:10.939667    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:10.941629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:10.939792    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:11.132619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.131847    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 23:42:11.132619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.131907    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c" podUID="8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 23:42:11.157632 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.156987    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:42:11.227674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.196647    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:42:11.227674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.196708    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 23:42:11.227674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.198300    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:42:11.227674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.198649    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:42:11.227674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.198891    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:42:11.227674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.199122    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 23:42:11.227674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.199350    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 23:42:11.227674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.211608    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 23:42:11.227674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.211649    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn" podUID="dedc712d-832a-4a02-bbd6-83a7d728835c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 23:42:11.231687 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.231659    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:42:11.289087 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.289038    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:11.317756 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.292695    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:11.677622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.663144    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:42:11.732622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.679447    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 23:42:11.736619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.733828    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd" podUID="f91240cc-16c4-406a-9db3-4f40de05e354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 23:42:11.946753 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.946651    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:11.949295 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:11.949253    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:11.989317 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:42:11.989278    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:42:12.128013 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.127980    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:42:12.131747 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.131704    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 23:42:12.131982 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.131957    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c" podUID="8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 23:42:12.209693 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.180529    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:42:12.209693 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.180651    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 23:42:12.209693 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.207704    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:12.209693 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.207956    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 23:42:12.209693 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.208036    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn" podUID="dedc712d-832a-4a02-bbd6-83a7d728835c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 23:42:12.209693 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.208124    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:12.210444 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.210003    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:12.211232 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.211202    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:42:12.211683 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.211221    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:12.259621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.246725    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:12.307619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.304694    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:42:12.307619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.306136    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:12.952681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.701982    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 23:42:12.952681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.702068    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd" podUID="f91240cc-16c4-406a-9db3-4f40de05e354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 23:42:12.952681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.858996    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:42:12.952681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.859981    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:42:12.952681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.868214    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:42:12.952681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:12.952665    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:13.199635 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:13.199581    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 23:42:13.228885 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:13.228737    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c" podUID="8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 23:42:13.230468 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:13.225053    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:13.230760 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:13.202367    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 23:42:13.230936 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:13.230915    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn" podUID="dedc712d-832a-4a02-bbd6-83a7d728835c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 23:42:13.233706 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:13.233664    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 23:42:13.242820 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:13.240700    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:13.310456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:13.310409    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:13.344054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:13.315231    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:42:13.345258 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:13.317966    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:42:13.346048 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:13.322736    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 23:42:13.346239 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:13.346216    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 23:42:13.346373 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:13.337297    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:13.379618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:13.358843    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:13.463939 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:13.463912    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:42:13.594718 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:13.593628    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 23:42:13.594718 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:13.593685    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd" podUID="f91240cc-16c4-406a-9db3-4f40de05e354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 23:42:13.997986 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:13.997957    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:42:14.091542 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:14.091501    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:14.101520 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:14.101447    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:14.135723 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:14.135689    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 23:42:14.135994 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:14.135965    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c" podUID="8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 23:42:14.258018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:14.257915    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:14.349607 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:14.349554    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:42:14.381455 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:14.379408    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:42:14.405787 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:14.396794    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:14.553322 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:14.553209    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:42:14.590258 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:14.590227    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 23:42:14.599052 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:14.590518    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd" podUID="f91240cc-16c4-406a-9db3-4f40de05e354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 23:42:14.961680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:14.961648    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:42:14.965318 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:14.965297    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:42:14.999491 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:14.999463    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:42:15.044434 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:15.044401    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:42:15.046500 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:15.046473    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:15.117735 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:15.117692    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 23:42:15.118079 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:15.118041    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c" podUID="8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 23:42:15.796678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:15.796638    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:42:15.798976 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:15.798909    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:42:16.100918 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:16.100840    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:42:16.102027 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:16.102007    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 30 23:42:16.232422 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:16.232380    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:18.599184 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:18.570452    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:18.961620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:18.940234    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:18.961620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:18.959974    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:19.003616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:19.002789    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:19.049617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:19.048519    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:19.082619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:19.081678    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:19.257798 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:19.256686    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 23:42:19.370280 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:19.369716    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:19.392180 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:19.392134    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:19.820112 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:19.820073    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:42:19.820762 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:19.820725    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg" podUID="da75f51e-ddb3-40a1-b475-b252bc8954d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:19.943732 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:19.943685    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:19.955622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:19.944581    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:42:19.985622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:19.968675    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:19.985622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:19.969433    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:42:20.201681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:20.112716    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:20.201681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:20.113176    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:20.201681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:20.113484    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:42:20.201681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:20.113616    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:42:20.201681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:20.113674    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:42:20.201681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:20.175712    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:42:20.201681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:20.176681    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:42:20.216648 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:20.203172    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:20.267755 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:20.267711    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:20.268796 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:20.268771    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:42:20.374810 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:20.374768    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:20.386142 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:20.386109    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:42:21.008651 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:21.008190    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:21.030618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:21.027845    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 23:42:21.155384 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:21.150917    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:21.155384 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:21.152734    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:42:21.155384 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:21.154147    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:42:21.178491 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:21.178448    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:21.311715 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:21.304076    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:21.365453 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:21.312499    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:21.388046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:21.387984    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:22.043615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:22.021526    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:22.043615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:22.035662    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:22.237623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:22.223261    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:42:22.309535 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:22.229128    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:42:22.311741 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:22.229281    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:42:22.342067 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:22.230309    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:22.346767 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:22.346719    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 23:42:22.472061 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:22.472002    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:22.588678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:22.573532    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:22.590248 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:42:22.590213    4921 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.491s"
Oct 30 23:42:22.590508 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:22.590491    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:42:22.590741 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:22.590725    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:42:22.891099 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:22.870722    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:42:23.030574 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:23.027757    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:42:23.030574 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:23.027867    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:42:23.030574 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:23.027902    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:42:23.030574 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:23.027933    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:42:23.030574 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:23.027968    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:42:23.030574 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:23.027998    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:42:23.030574 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:23.028030    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:42:23.030574 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:23.028060    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:42:23.242959 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:23.242802    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:25.069358 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:25.069321    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:25.902652 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:25.902620    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"]
Oct 30 23:42:25.907837 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:25.907811    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:25.929033 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:25.929004    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"]
Oct 30 23:42:26.043722 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.043676    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-workload-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.043910 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.043806    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdf6241b-c315-455e-961d-76564291e53f-istio-token\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.043910 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.043862    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-istio-envoy\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.044032 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.044014    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdf6241b-c315-455e-961d-76564291e53f-istiod-ca-cert\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.044132 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.044105    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-workload-certs\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.044258 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.044233    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdf6241b-c315-455e-961d-76564291e53f-istio-podinfo\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.044316 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.044296    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-credential-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.044360 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.044324    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-istio-data\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.044446 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.044430    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxd5q\" (UniqueName: \"kubernetes.io/projected/fdf6241b-c315-455e-961d-76564291e53f-kube-api-access-zxd5q\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.080274 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.080242    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"]
Oct 30 23:42:26.084715 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.084696    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.137890 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.137859    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"]
Oct 30 23:42:26.145805 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.145775    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-workload-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.145994 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.145830    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdf6241b-c315-455e-961d-76564291e53f-istio-token\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.145994 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.145917    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-istio-envoy\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.146125 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.145996    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdf6241b-c315-455e-961d-76564291e53f-istiod-ca-cert\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.146125 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.146073    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-workload-certs\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.146223 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.146137    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdf6241b-c315-455e-961d-76564291e53f-istio-podinfo\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.146223 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.146177    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-credential-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.146223 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.146200    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-istio-data\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.146390 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.146333    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxd5q\" (UniqueName: \"kubernetes.io/projected/fdf6241b-c315-455e-961d-76564291e53f-kube-api-access-zxd5q\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.146842 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.146815    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-credential-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.147012 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.146994    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-istio-data\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.147381 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.147357    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdf6241b-c315-455e-961d-76564291e53f-istiod-ca-cert\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.147707 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.147669    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-workload-certs\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.147789 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.147731    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-workload-socket\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.150028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.149996    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-istio-envoy\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.150487 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.150460    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdf6241b-c315-455e-961d-76564291e53f-istio-podinfo\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.162262 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.162200    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxd5q\" (UniqueName: \"kubernetes.io/projected/fdf6241b-c315-455e-961d-76564291e53f-kube-api-access-zxd5q\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.163325 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.163297    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdf6241b-c315-455e-961d-76564291e53f-istio-token\") pod \"e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") " pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.229038 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.229004    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:26.247950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.247924    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67756018-6320-4b57-9c9d-5087aae29907-istiod-ca-cert\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.248046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.247965    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-workload-socket\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.248101 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.248083    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-credential-socket\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.248188 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.248174    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-workload-certs\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.248281 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.248270    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67756018-6320-4b57-9c9d-5087aae29907-istio-token\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.248334 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.248319    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-istio-envoy\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.248377 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.248361    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wct9v\" (UniqueName: \"kubernetes.io/projected/67756018-6320-4b57-9c9d-5087aae29907-kube-api-access-wct9v\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.248459 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.248444    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-istio-data\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.248517 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.248476    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67756018-6320-4b57-9c9d-5087aae29907-istio-podinfo\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.350653 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.350620    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-istio-data\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.350836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.350665    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67756018-6320-4b57-9c9d-5087aae29907-istio-podinfo\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.350836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.350738    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67756018-6320-4b57-9c9d-5087aae29907-istiod-ca-cert\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.350836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.350771    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-workload-socket\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.350993 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.350850    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-credential-socket\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.350993 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.350936    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-workload-certs\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.351089 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.351058    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-istio-data\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.351089 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.351078    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67756018-6320-4b57-9c9d-5087aae29907-istio-token\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.351185 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.351129    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-istio-envoy\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.351235 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.351180    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wct9v\" (UniqueName: \"kubernetes.io/projected/67756018-6320-4b57-9c9d-5087aae29907-kube-api-access-wct9v\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.352033 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.351977    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-workload-socket\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.352425 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.352355    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67756018-6320-4b57-9c9d-5087aae29907-istiod-ca-cert\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.352743 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.352564    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-workload-certs\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.352743 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.352675    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-credential-socket\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.354075 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.354056    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67756018-6320-4b57-9c9d-5087aae29907-istio-podinfo\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.354216 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.354202    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-istio-envoy\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.376315 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.376260    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67756018-6320-4b57-9c9d-5087aae29907-istio-token\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.377117 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.377089    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wct9v\" (UniqueName: \"kubernetes.io/projected/67756018-6320-4b57-9c9d-5087aae29907-kube-api-access-wct9v\") pod \"e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") " pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.399005 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.398979    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:26.525622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.514023    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:26.646165 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.646127    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"]
Oct 30 23:42:26.648911 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:42:26.648883    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf6241b_c315_455e_961d_76564291e53f.slice/crio-ed5c41c07b5622678d353dc2eef37616ee3726e15d659bf63213d46a6f9aeb46 WatchSource:0}: Error finding container ed5c41c07b5622678d353dc2eef37616ee3726e15d659bf63213d46a6f9aeb46: Status 404 returned error can't find the container with id ed5c41c07b5622678d353dc2eef37616ee3726e15d659bf63213d46a6f9aeb46
Oct 30 23:42:26.652332 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.652289    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:42:26.652432 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.652378    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:42:26.652495 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.652423    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:42:26.799738 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.799555    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"]
Oct 30 23:42:26.801607 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:42:26.801561    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67756018_6320_4b57_9c9d_5087aae29907.slice/crio-dc49cfd256cc90aa60c828d2229e90643a7b2f4c759805fa648a0a5d96deb38c WatchSource:0}: Error finding container dc49cfd256cc90aa60c828d2229e90643a7b2f4c759805fa648a0a5d96deb38c: Status 404 returned error can't find the container with id dc49cfd256cc90aa60c828d2229e90643a7b2f4c759805fa648a0a5d96deb38c
Oct 30 23:42:26.804539 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.804504    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:42:26.804701 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.804571    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:42:26.804701 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:26.804673    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:42:27.127345 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:27.127203    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6" event={"ID":"fdf6241b-c315-455e-961d-76564291e53f","Type":"ContainerStarted","Data":"47da05efa7190f4498c7343bc3852a09fb76ee6ee9818d718e054c8285690106"}
Oct 30 23:42:27.127982 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:27.127920    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6" event={"ID":"fdf6241b-c315-455e-961d-76564291e53f","Type":"ContainerStarted","Data":"ed5c41c07b5622678d353dc2eef37616ee3726e15d659bf63213d46a6f9aeb46"}
Oct 30 23:42:27.129536 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:27.129510    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt" event={"ID":"67756018-6320-4b57-9c9d-5087aae29907","Type":"ContainerStarted","Data":"c71954f68fb773e46fbb1ab2215b5db67b9f0c2a99193d6e5965ff1f21acf460"}
Oct 30 23:42:27.129717 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:27.129583    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt" event={"ID":"67756018-6320-4b57-9c9d-5087aae29907","Type":"ContainerStarted","Data":"dc49cfd256cc90aa60c828d2229e90643a7b2f4c759805fa648a0a5d96deb38c"}
Oct 30 23:42:27.179609 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:27.177694    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6" podStartSLOduration=2.177674621 podStartE2EDuration="2.177674621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:42:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:42:27.177044026 +0000 UTC m=+1406.421899797" watchObservedRunningTime="2026-10-30 23:42:27.177674621 +0000 UTC m=+1406.422530388"
Oct 30 23:42:27.229396 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:27.229356    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:27.231902 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:27.231875    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 23:42:27.232017 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:27.231934    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6" podUID="fdf6241b-c315-455e-961d-76564291e53f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 23:42:27.407619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:27.404562    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:27.407619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:27.405436    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 23:42:27.407619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:27.405497    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt" podUID="67756018-6320-4b57-9c9d-5087aae29907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 23:42:28.108706 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:28.097045    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:28.240620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:28.234344    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 23:42:28.240620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:28.234406    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6" podUID="fdf6241b-c315-455e-961d-76564291e53f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 23:42:28.413619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:28.410714    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 23:42:28.413619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:28.410825    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt" podUID="67756018-6320-4b57-9c9d-5087aae29907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 23:42:29.229501 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:29.229474    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 23:42:29.229791 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:29.229762    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6" podUID="fdf6241b-c315-455e-961d-76564291e53f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 23:42:29.408619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:29.404203    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 23:42:29.408619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:29.404265    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt" podUID="67756018-6320-4b57-9c9d-5087aae29907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 23:42:29.492623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:29.492512    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:30.230372 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:30.229995    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 23:42:30.230372 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:30.230059    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6" podUID="fdf6241b-c315-455e-961d-76564291e53f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 23:42:30.409620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:30.408681    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 23:42:30.409620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:30.408751    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt" podUID="67756018-6320-4b57-9c9d-5087aae29907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 23:42:30.917239 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:30.917191    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:31.230497 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:31.230413    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 23:42:31.230497 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:31.230483    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6" podUID="fdf6241b-c315-455e-961d-76564291e53f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 23:42:31.419618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:31.418582    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 23:42:31.419618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:31.418668    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt" podUID="67756018-6320-4b57-9c9d-5087aae29907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 23:42:31.984614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:31.984563    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:32.234048 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:32.234011    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 23:42:32.234372 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:32.234329    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6" podUID="fdf6241b-c315-455e-961d-76564291e53f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 23:42:32.407624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:32.407332    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 23:42:32.407624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:32.407388    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt" podUID="67756018-6320-4b57-9c9d-5087aae29907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 23:42:33.191565 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:33.191520    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:33.231009 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:33.230973    4921 patch_prober.go:29] interesting pod/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 23:42:33.231320 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:33.231280    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6" podUID="fdf6241b-c315-455e-961d-76564291e53f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 23:42:33.400001 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:33.399964    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 23:42:33.400178 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:33.400031    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt" podUID="67756018-6320-4b57-9c9d-5087aae29907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 23:42:34.177613 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:34.177276    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:34.551841 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:34.551749    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:34.552315 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:34.552238    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:34.557697 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:34.557677    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:42:34.585516 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:34.585465    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt" podStartSLOduration=8.58544984 podStartE2EDuration="8.58544984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:42:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:42:27.278849168 +0000 UTC m=+1406.523704939" watchObservedRunningTime="2026-10-30 23:42:34.58544984 +0000 UTC m=+1413.830305607"
Oct 30 23:42:34.781817 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:34.781789    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:34.782227 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:34.782204    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:34.783259 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:34.783228    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:42:35.190981 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:35.190947    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:36.048685 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:36.048341    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:37.188896 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:37.185063    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:38.143014 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:38.142974    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:39.063862 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:39.063810    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:39.767001 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:39.766963    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:41.199427 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:41.198556    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:41.316737 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:41.316689    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:41.737206 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:42:41.737165    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:42:41.856746 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:41.856698    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:41.948620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:41.945669    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-11073-865688"]
Oct 30 23:42:41.974688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:41.948929    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:42:42.014679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:41.984687    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 23:42:42.014679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:41.985311    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:42.020765 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.020721    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:42.093622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.031152    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:42.093622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.090571    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-11073-865688"
Oct 30 23:42:42.199619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.199217    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:42.200123 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.199683    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:42:42.243617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.201963    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9hvz\" (UniqueName: \"kubernetes.io/projected/adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e-kube-api-access-g9hvz\") pod \"test-curl-11073-865688\" (UID: \"adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e\") " pod="opendatahub/test-curl-11073-865688"
Oct 30 23:42:42.243617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.207210    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:42.264819 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.264724    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-csqxw\""
Oct 30 23:42:42.292083 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.270655    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": context deadline exceeded"
Oct 30 23:42:42.384189 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.305836    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9hvz\" (UniqueName: \"kubernetes.io/projected/adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e-kube-api-access-g9hvz\") pod \"test-curl-11073-865688\" (UID: \"adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e\") " pod="opendatahub/test-curl-11073-865688"
Oct 30 23:42:42.384189 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.328706    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:42.384189 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.330494    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:42:42.716076 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.716043    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9hvz\" (UniqueName: \"kubernetes.io/projected/adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e-kube-api-access-g9hvz\") pod \"test-curl-11073-865688\" (UID: \"adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e\") " pod="opendatahub/test-curl-11073-865688"
Oct 30 23:42:42.716355 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.716334    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:42:42.716538 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.716509    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:42.753515 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.753484    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-11073-865688"]
Oct 30 23:42:42.883677 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.873443    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:42.887434 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.887410    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:42:42.945344 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.945317    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-11073-865688"
Oct 30 23:42:43.018995 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.981815    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:42:43.020396 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.992742    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:43.042652 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:42.992776    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 23:42:43.043758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:43.043719    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:43.048635 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:43.043834    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:43.248674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:43.224335    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:43.248674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:43.235677    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/health\": context deadline exceeded"
Oct 30 23:42:43.248674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:43.237485    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:43.360667 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:43.345403    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 23:42:43.490025 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:43.485748    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": context deadline exceeded"
Oct 30 23:42:43.616270 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:43.615760    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:42:43.616270 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:43.615834    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:43.877191 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:43.877086    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:43.884184 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:43.884152    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:42:43.915762 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:43.915726    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:42:43.998718 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:43.960825    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:42:43.998718 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:43.960883    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:42:43.998718 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:43.960919    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:42:43.998718 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:43.960954    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:42:44.071065 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:44.071021    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:44.099634 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:44.098284    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:44.116241 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:44.116199    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:42:44.117622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:44.117572    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:42:44.384352 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:44.276243    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:44.397878 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:44.295751    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:42:44.400632 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:44.295793    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:44.404616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:44.312544    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 23:42:44.405192 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:44.347956    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:44.594956 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:44.594919    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:42:44.598728 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:44.598688    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f" podUID="9927a847-b4b7-4c22-a3df-3ac672c98c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:44.697653 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:44.695378    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:42:44.813080 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:44.812975    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:42:44.813516 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:44.813466    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q" podUID="ac24a789-f285-4a46-8121-579b4b3bd264" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:44.934724 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:44.863989    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:42:45.016672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:45.011734    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:45.149722 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:45.118708    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:42:45.159629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:45.154677    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 23:42:45.203519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:45.176940    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:42:45.398559 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:45.398519    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:42:45.475084 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:45.474999    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:42:45.475377 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:45.475361    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:42:45.475536 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:45.475524    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:42:45.475698 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:45.475687    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:42:45.475841 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:45.475826    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-11073-865688"]
Oct 30 23:42:45.476015 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:45.475993    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:42:45.476150 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:45.476139    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:42:45.493576 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:45.493554    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:42:45.524178 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:45.524079    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-11073-865688" event={"ID":"adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e","Type":"ContainerStarted","Data":"fd519be0c4e1df2820d419403eb20242c5623977c1df776a5010c0e27c4574b1"}
Oct 30 23:42:45.924658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:45.924625    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:47.151505 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:47.151293    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:48.081622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:48.078232    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:49.039294 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:49.039212    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:49.559050 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:49.559010    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-11073-865688" event={"ID":"adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e","Type":"ContainerStarted","Data":"66fa42c56e883ca954cbe65f66912b54486da5d896b9256bda3b3723e0a8098a"}
Oct 30 23:42:49.575061 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:49.575014    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-11073-865688" podStartSLOduration=5.276523947 podStartE2EDuration="8.574999578s" totalImagesPullingTime="3.298475631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:42:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:42:49.574325596 +0000 UTC m=+1428.819181364" watchObservedRunningTime="2026-10-30 23:42:49.574999578 +0000 UTC m=+1428.819855347"
Oct 30 23:42:49.850026 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:49.849814    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:50.378751 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:50.378717    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-11073-865688"]
Oct 30 23:42:50.383988 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:50.383963    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-11073-865688"]
Oct 30 23:42:50.543976 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:50.543935    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-11073-f630c8"]
Oct 30 23:42:50.544653 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:50.544637    4921 cpu_manager.go:414] "containerMap: removing container" podUID="adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e" containerName="test-curl-11073-865688"
Oct 30 23:42:50.544711 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:50.544654    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e" containerName="test-curl-11073-865688"
Oct 30 23:42:50.544800 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:50.544791    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e" containerName="test-curl-11073-865688"
Oct 30 23:42:50.548473 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:50.548454    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-11073-f630c8"
Oct 30 23:42:50.562744 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:50.562715    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-11073-f630c8"]
Oct 30 23:42:50.683639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:50.680844    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lkrb\" (UniqueName: \"kubernetes.io/projected/2524c57d-3952-4476-8edd-ea3385a2df72-kube-api-access-9lkrb\") pod \"test-curl-11073-f630c8\" (UID: \"2524c57d-3952-4476-8edd-ea3385a2df72\") " pod="opendatahub/test-curl-11073-f630c8"
Oct 30 23:42:50.695345 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:50.695313    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:50.782125 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:50.782094    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lkrb\" (UniqueName: \"kubernetes.io/projected/2524c57d-3952-4476-8edd-ea3385a2df72-kube-api-access-9lkrb\") pod \"test-curl-11073-f630c8\" (UID: \"2524c57d-3952-4476-8edd-ea3385a2df72\") " pod="opendatahub/test-curl-11073-f630c8"
Oct 30 23:42:50.798397 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:50.798370    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lkrb\" (UniqueName: \"kubernetes.io/projected/2524c57d-3952-4476-8edd-ea3385a2df72-kube-api-access-9lkrb\") pod \"test-curl-11073-f630c8\" (UID: \"2524c57d-3952-4476-8edd-ea3385a2df72\") " pod="opendatahub/test-curl-11073-f630c8"
Oct 30 23:42:50.865151 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:50.865121    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-11073-f630c8"
Oct 30 23:42:51.154397 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:51.154369    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-11073-f630c8"]
Oct 30 23:42:51.154852 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:42:51.154822    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2524c57d_3952_4476_8edd_ea3385a2df72.slice/crio-e58a4aed0f4d169478ccc794f69116780eeecf14322750f2c00aefc50f4a5ddf WatchSource:0}: Error finding container e58a4aed0f4d169478ccc794f69116780eeecf14322750f2c00aefc50f4a5ddf: Status 404 returned error can't find the container with id e58a4aed0f4d169478ccc794f69116780eeecf14322750f2c00aefc50f4a5ddf
Oct 30 23:42:51.577718 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:51.577586    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-11073-f630c8" event={"ID":"2524c57d-3952-4476-8edd-ea3385a2df72","Type":"ContainerStarted","Data":"a4826293172cf868b0a72903ce62c911b43fd2a623c229b16a15eb2e07cb05ea"}
Oct 30 23:42:51.577718 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:51.577668    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-11073-f630c8" event={"ID":"2524c57d-3952-4476-8edd-ea3385a2df72","Type":"ContainerStarted","Data":"e58a4aed0f4d169478ccc794f69116780eeecf14322750f2c00aefc50f4a5ddf"}
Oct 30 23:42:51.578266 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:51.577713    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-11073-865688" podUID="adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e" containerName="test-curl-11073-865688" containerID="cri-o://66fa42c56e883ca954cbe65f66912b54486da5d896b9256bda3b3723e0a8098a" gracePeriod=2
Oct 30 23:42:51.596956 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:51.596912    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-11073-f630c8" podStartSLOduration=1.5968990600000001 podStartE2EDuration="1.59689906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:42:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:42:51.593181035 +0000 UTC m=+1430.838036802" watchObservedRunningTime="2026-10-30 23:42:51.59689906 +0000 UTC m=+1430.841754828"
Oct 30 23:42:51.737178 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:51.737140    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:52.085491 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:52.085463    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:52.362333 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:52.362087    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-11073-f630c8"]
Oct 30 23:42:52.367689 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:52.367662    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-11073-f630c8"]
Oct 30 23:42:52.532673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:52.532549    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:53.429710 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:53.429680    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:53.661149 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:53.661118    4921 generic.go:356] "Generic (PLEG): container finished" podID="adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e" containerID="66fa42c56e883ca954cbe65f66912b54486da5d896b9256bda3b3723e0a8098a" exitCode=137
Oct 30 23:42:53.661424 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:53.661405    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-11073-f630c8" podUID="2524c57d-3952-4476-8edd-ea3385a2df72" containerName="test-curl-11073-f630c8" containerID="cri-o://a4826293172cf868b0a72903ce62c911b43fd2a623c229b16a15eb2e07cb05ea" gracePeriod=2
Oct 30 23:42:53.813233 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:53.813202    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-11073-865688"
Oct 30 23:42:53.836457 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:53.836429    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e-kube-api-access-g9hvz\" (UniqueName: \"kubernetes.io/projected/adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e-kube-api-access-g9hvz\") pod \"adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e\" (UID: \"adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e\") "
Oct 30 23:42:53.839221 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:53.839197    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e-kube-api-access-g9hvz" pod "adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e" (UID: "adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e"). InnerVolumeSpecName "kube-api-access-g9hvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:42:53.939933 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:53.939899    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9hvz\" (UniqueName: \"kubernetes.io/projected/adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e-kube-api-access-g9hvz\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:42:54.398738 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:54.398695    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:54.670332 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:54.670237    4921 scope.go:122] "RemoveContainer" containerID="66fa42c56e883ca954cbe65f66912b54486da5d896b9256bda3b3723e0a8098a"
Oct 30 23:42:54.670332 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:54.670261    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-11073-865688"
Oct 30 23:42:54.681679 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:42:54.681658    4921 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-11073-865688\" is forbidden: User \"system:node:ip-10-0-142-208.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-208.us-east-2.compute.internal' and this object" podUID="adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e" pod="opendatahub/test-curl-11073-865688"
Oct 30 23:42:54.886896 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:54.886868    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e" path="/var/lib/kubelet/pods/adbd2a72-f3cd-4d4e-97a8-edfc61c37d4e/volumes"
Oct 30 23:42:54.918826 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:54.918780    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:55.070038 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:55.069943    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:55.362376 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:55.362257    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:55.646051 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:55.646017    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:55.797676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:55.797504    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:55.903244 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:55.895775    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-11073-f630c8"
Oct 30 23:42:55.951512 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:55.951392    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:56.027563 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:56.026430    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2524c57d-3952-4476-8edd-ea3385a2df72-kube-api-access-9lkrb\" (UniqueName: \"kubernetes.io/projected/2524c57d-3952-4476-8edd-ea3385a2df72-kube-api-access-9lkrb\") pod \"2524c57d-3952-4476-8edd-ea3385a2df72\" (UID: \"2524c57d-3952-4476-8edd-ea3385a2df72\") "
Oct 30 23:42:56.040770 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:56.034116    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2524c57d-3952-4476-8edd-ea3385a2df72-kube-api-access-9lkrb" pod "2524c57d-3952-4476-8edd-ea3385a2df72" (UID: "2524c57d-3952-4476-8edd-ea3385a2df72"). InnerVolumeSpecName "kube-api-access-9lkrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:42:56.136618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:56.133142    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lkrb\" (UniqueName: \"kubernetes.io/projected/2524c57d-3952-4476-8edd-ea3385a2df72-kube-api-access-9lkrb\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:42:56.283194 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:56.283095    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:56.570050 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:56.569972    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:56.708327 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:56.708290    4921 generic.go:356] "Generic (PLEG): container finished" podID="2524c57d-3952-4476-8edd-ea3385a2df72" containerID="a4826293172cf868b0a72903ce62c911b43fd2a623c229b16a15eb2e07cb05ea" exitCode=137
Oct 30 23:42:56.708491 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:56.708473    4921 scope.go:122] "RemoveContainer" containerID="a4826293172cf868b0a72903ce62c911b43fd2a623c229b16a15eb2e07cb05ea"
Oct 30 23:42:56.708617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:56.708581    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-11073-f630c8"
Oct 30 23:42:56.721561 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:56.721543    4921 scope.go:122] "RemoveContainer" containerID="a4826293172cf868b0a72903ce62c911b43fd2a623c229b16a15eb2e07cb05ea"
Oct 30 23:42:56.721843 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:42:56.721825    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4826293172cf868b0a72903ce62c911b43fd2a623c229b16a15eb2e07cb05ea\": container with ID starting with a4826293172cf868b0a72903ce62c911b43fd2a623c229b16a15eb2e07cb05ea not found: ID does not exist" containerID="a4826293172cf868b0a72903ce62c911b43fd2a623c229b16a15eb2e07cb05ea"
Oct 30 23:42:56.721941 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:56.721852    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4826293172cf868b0a72903ce62c911b43fd2a623c229b16a15eb2e07cb05ea"} err="failed to get container status \"a4826293172cf868b0a72903ce62c911b43fd2a623c229b16a15eb2e07cb05ea\": rpc error: code = NotFound desc = could not find container \"a4826293172cf868b0a72903ce62c911b43fd2a623c229b16a15eb2e07cb05ea\": container with ID starting with a4826293172cf868b0a72903ce62c911b43fd2a623c229b16a15eb2e07cb05ea not found: ID does not exist"
Oct 30 23:42:56.722165 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:42:56.722141    4921 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-11073-f630c8\" is forbidden: User \"system:node:ip-10-0-142-208.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-208.us-east-2.compute.internal' and this object" podUID="2524c57d-3952-4476-8edd-ea3385a2df72" pod="opendatahub/test-curl-11073-f630c8"
Oct 30 23:42:56.929292 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:56.911368    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2524c57d-3952-4476-8edd-ea3385a2df72" path="/var/lib/kubelet/pods/2524c57d-3952-4476-8edd-ea3385a2df72/volumes"
Oct 30 23:42:57.518415 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:57.518382    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:57.661499 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:57.661462    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:58.286858 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:58.286820    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:58.425434 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:58.425400    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:58.720779 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:58.720701    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:59.504928 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.504894    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:59.541758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.541731    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw"]
Oct 30 23:42:59.542454 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.542439    4921 cpu_manager.go:414] "containerMap: removing container" podUID="2524c57d-3952-4476-8edd-ea3385a2df72" containerName="test-curl-11073-f630c8"
Oct 30 23:42:59.542503 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.542454    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2524c57d-3952-4476-8edd-ea3385a2df72" containerName="test-curl-11073-f630c8"
Oct 30 23:42:59.542570 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.542561    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="2524c57d-3952-4476-8edd-ea3385a2df72" containerName="test-curl-11073-f630c8"
Oct 30 23:42:59.547692 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.547673    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw"
Oct 30 23:42:59.557314 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.557295    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ebbe654c\""
Oct 30 23:42:59.560417 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.558566    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ebbe654c-dockercfg-z97m6\""
Oct 30 23:42:59.560417 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.559103    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw"]
Oct 30 23:42:59.576417 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.576389    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q"]
Oct 30 23:42:59.582409 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.582377    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q"
Oct 30 23:42:59.592661 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.592626    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q"]
Oct 30 23:42:59.657452 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.657421    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:59.715619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.714286    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn6hk\" (UniqueName: \"kubernetes.io/projected/25d5d68f-0e57-4c79-8328-518cc4d8616d-kube-api-access-rn6hk\") pod \"payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw\" (UID: \"25d5d68f-0e57-4c79-8328-518cc4d8616d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw"
Oct 30 23:42:59.715619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.714380    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d5d68f-0e57-4c79-8328-518cc4d8616d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw\" (UID: \"25d5d68f-0e57-4c79-8328-518cc4d8616d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw"
Oct 30 23:42:59.715619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.714410    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f7da146-432f-468e-a84e-836ad6ed9b30-plugins-config-volume\") pod \"payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q\" (UID: \"7f7da146-432f-468e-a84e-836ad6ed9b30\") " pod="openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q"
Oct 30 23:42:59.715619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.714683    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29cqj\" (UniqueName: \"kubernetes.io/projected/7f7da146-432f-468e-a84e-836ad6ed9b30-kube-api-access-29cqj\") pod \"payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q\" (UID: \"7f7da146-432f-468e-a84e-836ad6ed9b30\") " pod="openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q"
Oct 30 23:42:59.839965 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.828438    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29cqj\" (UniqueName: \"kubernetes.io/projected/7f7da146-432f-468e-a84e-836ad6ed9b30-kube-api-access-29cqj\") pod \"payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q\" (UID: \"7f7da146-432f-468e-a84e-836ad6ed9b30\") " pod="openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q"
Oct 30 23:42:59.839965 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.828639    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn6hk\" (UniqueName: \"kubernetes.io/projected/25d5d68f-0e57-4c79-8328-518cc4d8616d-kube-api-access-rn6hk\") pod \"payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw\" (UID: \"25d5d68f-0e57-4c79-8328-518cc4d8616d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw"
Oct 30 23:42:59.839965 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.828718    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d5d68f-0e57-4c79-8328-518cc4d8616d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw\" (UID: \"25d5d68f-0e57-4c79-8328-518cc4d8616d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw"
Oct 30 23:42:59.839965 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.828747    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f7da146-432f-468e-a84e-836ad6ed9b30-plugins-config-volume\") pod \"payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q\" (UID: \"7f7da146-432f-468e-a84e-836ad6ed9b30\") " pod="openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q"
Oct 30 23:42:59.839965 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.832155    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d5d68f-0e57-4c79-8328-518cc4d8616d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw\" (UID: \"25d5d68f-0e57-4c79-8328-518cc4d8616d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw"
Oct 30 23:42:59.839965 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.836047    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f7da146-432f-468e-a84e-836ad6ed9b30-plugins-config-volume\") pod \"payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q\" (UID: \"7f7da146-432f-468e-a84e-836ad6ed9b30\") " pod="openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q"
Oct 30 23:42:59.854619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.850220    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:42:59.910206 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.895445    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29cqj\" (UniqueName: \"kubernetes.io/projected/7f7da146-432f-468e-a84e-836ad6ed9b30-kube-api-access-29cqj\") pod \"payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q\" (UID: \"7f7da146-432f-468e-a84e-836ad6ed9b30\") " pod="openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q"
Oct 30 23:42:59.910206 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.908164    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q"
Oct 30 23:42:59.914201 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:42:59.913936    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn6hk\" (UniqueName: \"kubernetes.io/projected/25d5d68f-0e57-4c79-8328-518cc4d8616d-kube-api-access-rn6hk\") pod \"payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw\" (UID: \"25d5d68f-0e57-4c79-8328-518cc4d8616d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw"
Oct 30 23:43:00.164456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:00.164421    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw"
Oct 30 23:43:00.322789 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:00.322754    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q"]
Oct 30 23:43:00.325486 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:43:00.325458    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f7da146_432f_468e_a84e_836ad6ed9b30.slice/crio-1b9531e4f9a2d753cb79d56e9861f7ebd5e620fb206192b8930cf3464b9160c2 WatchSource:0}: Error finding container 1b9531e4f9a2d753cb79d56e9861f7ebd5e620fb206192b8930cf3464b9160c2: Status 404 returned error can't find the container with id 1b9531e4f9a2d753cb79d56e9861f7ebd5e620fb206192b8930cf3464b9160c2
Oct 30 23:43:00.466871 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:00.466828    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw"]
Oct 30 23:43:00.467280 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:43:00.466912    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d5d68f_0e57_4c79_8328_518cc4d8616d.slice/crio-1ad86c7663e3b95d59ecb2bc037e6a415d16a63247d3de582a6578b049e1f19f WatchSource:0}: Error finding container 1ad86c7663e3b95d59ecb2bc037e6a415d16a63247d3de582a6578b049e1f19f: Status 404 returned error can't find the container with id 1ad86c7663e3b95d59ecb2bc037e6a415d16a63247d3de582a6578b049e1f19f
Oct 30 23:43:00.772221 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:00.772182    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:00.861922 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:00.861876    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q" event={"ID":"7f7da146-432f-468e-a84e-836ad6ed9b30","Type":"ContainerStarted","Data":"bb020f40e3f32a2354a2fc964cf53438345075837f290afe292782151b0342a9"}
Oct 30 23:43:00.862115 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:00.861998    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q"
Oct 30 23:43:00.862115 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:00.862025    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q" event={"ID":"7f7da146-432f-468e-a84e-836ad6ed9b30","Type":"ContainerStarted","Data":"1b9531e4f9a2d753cb79d56e9861f7ebd5e620fb206192b8930cf3464b9160c2"}
Oct 30 23:43:00.863788 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:00.863763    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw" event={"ID":"25d5d68f-0e57-4c79-8328-518cc4d8616d","Type":"ContainerStarted","Data":"7b41c6c1d7507a21c74f0a58f2a04b950b5d717ff4defea8dffe956527cd56a2"}
Oct 30 23:43:00.863950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:00.863804    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw" event={"ID":"25d5d68f-0e57-4c79-8328-518cc4d8616d","Type":"ContainerStarted","Data":"1ad86c7663e3b95d59ecb2bc037e6a415d16a63247d3de582a6578b049e1f19f"}
Oct 30 23:43:00.863950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:00.863845    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw"
Oct 30 23:43:00.882943 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:00.882883    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q" podStartSLOduration=1.8828705989999999 podStartE2EDuration="1.882870599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:43:00.882007122 +0000 UTC m=+1440.126862893" watchObservedRunningTime="2026-10-30 23:43:00.882870599 +0000 UTC m=+1440.127726366"
Oct 30 23:43:00.907024 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:00.906975    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw" podStartSLOduration=1.90696201 podStartE2EDuration="1.90696201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:43:00.902888551 +0000 UTC m=+1440.147744319" watchObservedRunningTime="2026-10-30 23:43:00.90696201 +0000 UTC m=+1440.151817821"
Oct 30 23:43:01.694611 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:01.686070    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:02.741420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:02.741389    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:03.084775 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:03.084695    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:03.239087 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:03.239052    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:03.492646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:03.492611    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:03.646623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:03.646162    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:04.010666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:04.010628    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:04.447656 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:04.444436    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:04.777681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:04.769259    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:05.809926 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:05.809879    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:05.949642 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:05.949574    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:05.965257 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:05.965223    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"]
Oct 30 23:43:05.973981 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:05.973689    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"
Oct 30 23:43:05.979529 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:05.979499    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"]
Oct 30 23:43:06.016142 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:06.016113    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ebbe654c-serving-cert\""
Oct 30 23:43:06.031354 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:06.031318    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7kp6\" (UniqueName: \"kubernetes.io/projected/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-kube-api-access-k7kp6\") pod \"maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln\" (UID: \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"
Oct 30 23:43:06.031821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:06.031792    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-metrics-certs\") pod \"maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln\" (UID: \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"
Oct 30 23:43:06.031947 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:06.031853    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-openshift-service-ca\") pod \"maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln\" (UID: \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"
Oct 30 23:43:06.031947 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:06.031926    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-maas-api-tls\") pod \"maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln\" (UID: \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"
Oct 30 23:43:06.093898 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:06.093814    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:06.159714 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:06.144692    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-maas-api-tls\") pod \"maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln\" (UID: \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"
Oct 30 23:43:06.159714 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:06.144787    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7kp6\" (UniqueName: \"kubernetes.io/projected/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-kube-api-access-k7kp6\") pod \"maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln\" (UID: \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"
Oct 30 23:43:06.159714 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:06.145199    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-metrics-certs\") pod \"maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln\" (UID: \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"
Oct 30 23:43:06.159714 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:06.145250    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-openshift-service-ca\") pod \"maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln\" (UID: \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"
Oct 30 23:43:06.159714 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:43:06.146019    4921 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-serving-cert: secret "maas-api-e2e-ait-ebbe654c-serving-cert" not found
Oct 30 23:43:06.159714 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:43:06.146081    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-maas-api-tls podName:b190d31a-96dd-4d6f-b87b-2e5d10eae95b nodeName:}" failed. No retries permitted until 2026-10-30 23:43:06.646059662 +0000 UTC m=+1445.890915408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-maas-api-tls") pod "maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln" (UID: "b190d31a-96dd-4d6f-b87b-2e5d10eae95b") : secret "maas-api-e2e-ait-ebbe654c-serving-cert" not found
Oct 30 23:43:06.159714 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:06.147349    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-openshift-service-ca\") pod \"maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln\" (UID: \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"
Oct 30 23:43:06.179638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:06.173994    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-metrics-certs\") pod \"maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln\" (UID: \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"
Oct 30 23:43:06.193612 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:06.191357    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7kp6\" (UniqueName: \"kubernetes.io/projected/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-kube-api-access-k7kp6\") pod \"maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln\" (UID: \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"
Oct 30 23:43:06.392369 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:06.392335    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:06.602056 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:06.602023    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:06.695708 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:06.682249    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-maas-api-tls\") pod \"maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln\" (UID: \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"
Oct 30 23:43:06.716622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:06.710743    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-maas-api-tls\") pod \"maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln\" (UID: \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"
Oct 30 23:43:06.770628 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:06.770209    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:06.901671 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:06.892037    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"
Oct 30 23:43:07.448694 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:07.448667    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"]
Oct 30 23:43:07.449356 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:43:07.449326    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb190d31a_96dd_4d6f_b87b_2e5d10eae95b.slice/crio-4ad09c61efc1419d7e1cae73a3e058c14a2eab99066b81bc8354be089ba6c2ce WatchSource:0}: Error finding container 4ad09c61efc1419d7e1cae73a3e058c14a2eab99066b81bc8354be089ba6c2ce: Status 404 returned error can't find the container with id 4ad09c61efc1419d7e1cae73a3e058c14a2eab99066b81bc8354be089ba6c2ce
Oct 30 23:43:07.665449 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:07.664538    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:07.967220 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:07.967183    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln" event={"ID":"b190d31a-96dd-4d6f-b87b-2e5d10eae95b","Type":"ContainerStarted","Data":"4ad09c61efc1419d7e1cae73a3e058c14a2eab99066b81bc8354be089ba6c2ce"}
Oct 30 23:43:08.286614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:08.285680    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:08.336617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:08.317792    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf"]
Oct 30 23:43:08.386963 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:08.386928    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf"]
Oct 30 23:43:08.387203 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:08.387180    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf"
Oct 30 23:43:08.507245 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:08.506436    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:08.507245 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:08.506492    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-d34ab3fd\""
Oct 30 23:43:08.650621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:08.636173    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf\" (UID: \"1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf"
Oct 30 23:43:08.693647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:08.689048    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd2rj\" (UniqueName: \"kubernetes.io/projected/1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4-kube-api-access-cd2rj\") pod \"payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf\" (UID: \"1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf"
Oct 30 23:43:08.893265 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:08.893235    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd2rj\" (UniqueName: \"kubernetes.io/projected/1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4-kube-api-access-cd2rj\") pod \"payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf\" (UID: \"1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf"
Oct 30 23:43:08.893467 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:08.893418    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf\" (UID: \"1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf"
Oct 30 23:43:08.894172 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:08.894151    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf\" (UID: \"1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf"
Oct 30 23:43:08.914439 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:08.914379    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd2rj\" (UniqueName: \"kubernetes.io/projected/1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4-kube-api-access-cd2rj\") pod \"payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf\" (UID: \"1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf"
Oct 30 23:43:08.975521 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:08.975482    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln" event={"ID":"b190d31a-96dd-4d6f-b87b-2e5d10eae95b","Type":"ContainerStarted","Data":"8e037a38b0faf9f9e893c433250c6723d13375bce492b42b10cf944836172213"}
Oct 30 23:43:08.976032 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:08.975553    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"
Oct 30 23:43:09.005317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:09.005266    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln" podStartSLOduration=3.573179799 podStartE2EDuration="4.00525271s" totalImagesPullingTime="432.072911ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:43:09.003195453 +0000 UTC m=+1448.248051216" watchObservedRunningTime="2026-10-30 23:43:09.00525271 +0000 UTC m=+1448.250108479"
Oct 30 23:43:09.087973 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:09.087942    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf"
Oct 30 23:43:09.207889 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:09.207811    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:09.412714 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:09.404865    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf"]
Oct 30 23:43:10.155622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:10.147116    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"]
Oct 30 23:43:10.155622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:10.147365    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq" podUID="70a3825d-af1d-4af8-99c5-710c36d226f3" containerName="istio-proxy" containerID="cri-o://d5cc7e5588fc99b608093bc7662e5d4c60e4ac51765c1e8bf1c4896fdfa8160d" gracePeriod=30
Oct 30 23:43:10.489457 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:10.489198    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf" event={"ID":"1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4","Type":"ContainerStarted","Data":"c515c5ea98badf928aa8f8930050e04dd24e6bc0db763c1911e36dc3464ed265"}
Oct 30 23:43:10.489457 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:10.489266    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf" event={"ID":"1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4","Type":"ContainerStarted","Data":"d52e11ee1df60a1e990c15f8eb078a8c8bea9f315df853fbc591b2584c68c5f2"}
Oct 30 23:43:10.489457 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:10.489310    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf"
Oct 30 23:43:10.738527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:10.738497    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:10.944686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:10.940904    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:11.107474 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:11.107421    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:11.139634 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:11.128584    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:11.199004 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:11.198869    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:11.295633 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:11.280027    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:11.402659 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:11.389785    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:43:11.411816 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:11.411764    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 23:43:11.413144 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:11.413112    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:11.424753 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:11.414515    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:11.921843 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:11.921737    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:12.002624 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:43:11.983873    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:43:12.021750 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.020776    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw"
Oct 30 23:43:12.073620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.072029    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q"
Oct 30 23:43:12.086686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.086623    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf" podStartSLOduration=4.086581277 podStartE2EDuration="4.086581277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:43:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:43:10.664918509 +0000 UTC m=+1449.909774279" watchObservedRunningTime="2026-10-30 23:43:12.086581277 +0000 UTC m=+1451.331437048"
Oct 30 23:43:12.393018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.170262    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:43:12.417027 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.417000    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:43:12.418171 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.200890    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:12.419190 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.200946    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:12.433664 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.398057    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:43:12.435083 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.435060    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:43:12.435306 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.435290    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:43:12.435459 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.435445    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:43:12.436556 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.400525    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:43:12.436980 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.414759    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:12.438134 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.398091    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": context deadline exceeded"
Oct 30 23:43:12.441629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.440245    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:43:12.441822 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.441805    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:43:12.455624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.414809    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:12.457535 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.457505    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:43:12.463017 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.462985    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 23:43:12.481379 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:12.480620    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:43:13.009641 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:13.003304    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:13.020719 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:13.016690    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:43:13.278171 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:13.207223    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:13.428625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:13.420779    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:13.524644 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:13.520049    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:43:13.534987 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:13.534882    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:13.543946 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:13.543904    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:13.565935 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:13.565881    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:13.588866 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:13.436941    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:14.021620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:14.015399    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:43:14.030620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:14.021921    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td" podUID="22dee8ec-69c0-4889-adb1-8ecde0d7b66a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:14.128159 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:14.128096    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:14.235939 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:14.235892    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:14.289706 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:14.289582    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2" podUID="09131a8c-6b33-4793-b624-24489d63e66a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/health\": context deadline exceeded"
Oct 30 23:43:14.377623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:14.340227    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:43:14.521622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:14.501046    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 23:43:14.527396 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:14.527355    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:14.549674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:14.489399    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:14.550213 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:14.478730    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 23:43:14.550626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:14.548697    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:14.577547 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:14.548736    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 23:43:14.577547 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:14.572705    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 23:43:14.710616 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:43:14.703575    4921 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.656s"
Oct 30 23:43:14.777742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:14.762708    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:43:14.777742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:14.762777    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f" podUID="9927a847-b4b7-4c22-a3df-3ac672c98c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:15.225243 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:15.220045    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:15.542920 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:15.542829    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:43:15.562656 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:15.557712    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:43:15.562656 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:15.558294    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:43:15.562656 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:15.558583    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 23:43:15.630376 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:15.600688    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:15.630376 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:15.601307    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"
Oct 30 23:43:15.769623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:15.719153    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 23:43:15.810180 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:15.501767    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:15.811069 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:15.776404    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:15.915310 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:15.915249    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:16.177832 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:16.007751    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:16.178130 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:16.077866    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:43:16.178997 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:16.178251    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:16.180690 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:16.109140    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:43:16.207509 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:16.207453    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn" podUID="dedc712d-832a-4a02-bbd6-83a7d728835c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:16.303183 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:16.303140    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 23:43:16.439467 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:16.438726    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-842fq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Oct 30 23:43:16.439467 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:16.438786    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq" podUID="70a3825d-af1d-4af8-99c5-710c36d226f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Oct 30 23:43:16.568652 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:16.520723    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:16.597852 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:16.597808    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:43:16.644013 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:16.602343    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:43:16.644013 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:16.607411    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:16.644013 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:16.602417    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 23:43:16.644013 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:16.602396    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:43:16.644013 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:16.609719    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:16.771792 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:16.771688    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:16.801454 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:16.801313    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:16.828739 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:16.828686    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:16.831418 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:16.831383    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:17.021967 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:17.021855    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:17.047120 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:17.047088    4921 generic.go:356] "Generic (PLEG): container finished" podID="70a3825d-af1d-4af8-99c5-710c36d226f3" containerID="d5cc7e5588fc99b608093bc7662e5d4c60e4ac51765c1e8bf1c4896fdfa8160d" exitCode=0
Oct 30 23:43:17.139252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:17.139197    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq" event={"ID":"70a3825d-af1d-4af8-99c5-710c36d226f3","Type":"ContainerDied","Data":"d5cc7e5588fc99b608093bc7662e5d4c60e4ac51765c1e8bf1c4896fdfa8160d"}
Oct 30 23:43:17.158764 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:17.158728    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:43:17.159080 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:17.159032    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c" podUID="8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:17.493618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:17.483408    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:17.540459 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:17.510144    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:17.696623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:17.632363    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:43:17.696623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:17.633145    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:43:17.696623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:17.634424    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 23:43:17.696623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:17.634752    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:43:17.696623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:17.635067    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 23:43:17.806798 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:17.773695    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 23:43:17.901623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:17.846573    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:17.901623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:17.846877    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:18.474522 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.474483    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:43:18.724812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.648763    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:18.724812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.650146    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:18.724812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.673902    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 23:43:18.847634 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.836982    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-podinfo\") pod \"70a3825d-af1d-4af8-99c5-710c36d226f3\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") "
Oct 30 23:43:18.920637 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.919852    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/70a3825d-af1d-4af8-99c5-710c36d226f3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70a3825d-af1d-4af8-99c5-710c36d226f3-istiod-ca-cert\") pod \"70a3825d-af1d-4af8-99c5-710c36d226f3\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") "
Oct 30 23:43:18.920637 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.919936    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-data\") pod \"70a3825d-af1d-4af8-99c5-710c36d226f3\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") "
Oct 30 23:43:18.920637 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.920082    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-workload-socket\") pod \"70a3825d-af1d-4af8-99c5-710c36d226f3\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") "
Oct 30 23:43:18.920637 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.920303    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-envoy\") pod \"70a3825d-af1d-4af8-99c5-710c36d226f3\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") "
Oct 30 23:43:18.920637 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.920395    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-credential-socket\") pod \"70a3825d-af1d-4af8-99c5-710c36d226f3\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") "
Oct 30 23:43:18.920637 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.920445    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-token\" (UniqueName: \"kubernetes.io/projected/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-token\") pod \"70a3825d-af1d-4af8-99c5-710c36d226f3\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") "
Oct 30 23:43:18.920637 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.920547    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/70a3825d-af1d-4af8-99c5-710c36d226f3-kube-api-access-4zj6h\" (UniqueName: \"kubernetes.io/projected/70a3825d-af1d-4af8-99c5-710c36d226f3-kube-api-access-4zj6h\") pod \"70a3825d-af1d-4af8-99c5-710c36d226f3\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") "
Oct 30 23:43:18.920637 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.920635    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-workload-certs\") pod \"70a3825d-af1d-4af8-99c5-710c36d226f3\" (UID: \"70a3825d-af1d-4af8-99c5-710c36d226f3\") "
Oct 30 23:43:18.951742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.951698    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 23:43:18.955973 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.890609    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 23:43:18.957140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.890688    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:43:18.958206 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.898493    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:18.958546 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.956172    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-workload-socket" pod "70a3825d-af1d-4af8-99c5-710c36d226f3" (UID: "70a3825d-af1d-4af8-99c5-710c36d226f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:43:18.960116 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.957412    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70a3825d-af1d-4af8-99c5-710c36d226f3-istiod-ca-cert" pod "70a3825d-af1d-4af8-99c5-710c36d226f3" (UID: "70a3825d-af1d-4af8-99c5-710c36d226f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:43:18.960244 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.958720    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-data" pod "70a3825d-af1d-4af8-99c5-710c36d226f3" (UID: "70a3825d-af1d-4af8-99c5-710c36d226f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:43:18.960377 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.913738    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:18.960777 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.908005    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:18.965662 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.964493    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-envoy" pod "70a3825d-af1d-4af8-99c5-710c36d226f3" (UID: "70a3825d-af1d-4af8-99c5-710c36d226f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:43:19.009863 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.992252    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70a3825d-af1d-4af8-99c5-710c36d226f3-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:19.009863 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.992285    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:19.009863 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.992308    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:19.009863 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:18.992322    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:19.020037 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.015893    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-workload-certs" pod "70a3825d-af1d-4af8-99c5-710c36d226f3" (UID: "70a3825d-af1d-4af8-99c5-710c36d226f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:43:19.039908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.039853    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-credential-socket" pod "70a3825d-af1d-4af8-99c5-710c36d226f3" (UID: "70a3825d-af1d-4af8-99c5-710c36d226f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:43:19.043764 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.043737    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-podinfo" pod "70a3825d-af1d-4af8-99c5-710c36d226f3" (UID: "70a3825d-af1d-4af8-99c5-710c36d226f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:43:19.112793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.106883    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:19.112793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.112663    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:19.112793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.112699    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70a3825d-af1d-4af8-99c5-710c36d226f3-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:19.112793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.107314    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-token" pod "70a3825d-af1d-4af8-99c5-710c36d226f3" (UID: "70a3825d-af1d-4af8-99c5-710c36d226f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:43:19.394129 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.394087    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:19.409348 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.407754    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70a3825d-af1d-4af8-99c5-710c36d226f3-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:19.422235 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.422199    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70a3825d-af1d-4af8-99c5-710c36d226f3-kube-api-access-4zj6h" pod "70a3825d-af1d-4af8-99c5-710c36d226f3" (UID: "70a3825d-af1d-4af8-99c5-710c36d226f3"). InnerVolumeSpecName "kube-api-access-4zj6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:43:19.453230 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.453203    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"
Oct 30 23:43:19.455453 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.455426    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:43:19.455655 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.455493    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:43:19.455655 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.455525    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:43:19.455655 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.455540    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq" event={"ID":"70a3825d-af1d-4af8-99c5-710c36d226f3","Type":"ContainerDied","Data":"53b5f09005485240f2fab2517defc0692584bce229f7e9fa0bc72f5e1d773c9d"}
Oct 30 23:43:19.455655 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.455623    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:43:19.455655 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.455657    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:43:19.455941 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.455687    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:43:19.455941 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.455719    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:43:19.455941 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.455750    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:43:19.455941 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.455783    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:43:19.456156 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.456104    4921 scope.go:122] "RemoveContainer" containerID="d5cc7e5588fc99b608093bc7662e5d4c60e4ac51765c1e8bf1c4896fdfa8160d"
Oct 30 23:43:19.508770 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.508737    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zj6h\" (UniqueName: \"kubernetes.io/projected/70a3825d-af1d-4af8-99c5-710c36d226f3-kube-api-access-4zj6h\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:19.778070 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.778032    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"]
Oct 30 23:43:19.782854 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:19.782826    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-842fq"]
Oct 30 23:43:20.124989 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:20.124909    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:20.780763 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:20.780728    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:20.887366 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:20.887336    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="70a3825d-af1d-4af8-99c5-710c36d226f3" path="/var/lib/kubelet/pods/70a3825d-af1d-4af8-99c5-710c36d226f3/volumes"
Oct 30 23:43:21.070667 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.069681    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:21.235521 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.235484    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"]
Oct 30 23:43:21.236641 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.236613    4921 cpu_manager.go:414] "containerMap: removing container" podUID="70a3825d-af1d-4af8-99c5-710c36d226f3" containerName="istio-proxy"
Oct 30 23:43:21.236641 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.236639    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="70a3825d-af1d-4af8-99c5-710c36d226f3" containerName="istio-proxy"
Oct 30 23:43:21.236918 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.236904    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="70a3825d-af1d-4af8-99c5-710c36d226f3" containerName="istio-proxy"
Oct 30 23:43:21.243110 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.243053    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.254054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.254025    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1dd98b91-openshift-default-dockercfg-6t5rm\""
Oct 30 23:43:21.255113 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.255082    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"]
Oct 30 23:43:21.357673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.348132    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:21.357673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.350003    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-token\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.357673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.350057    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-envoy\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.357673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.350117    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfxnd\" (UniqueName: \"kubernetes.io/projected/43f51846-de5d-4bdf-aaac-bca0a6bc46da-kube-api-access-pfxnd\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.357673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.350152    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-credential-socket\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.357673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.350203    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-data\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.357673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.350277    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-podinfo\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.357673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.350324    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-workload-socket\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.357673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.350366    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istiod-ca-cert\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.357673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.350501    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-workload-certs\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.479896 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.479854    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-podinfo\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.480141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.480126    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-workload-socket\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.480276 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.480262    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istiod-ca-cert\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.480475 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.480464    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-workload-certs\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.480662 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.480645    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-token\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.480777 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.480764    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-envoy\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.480914 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.480902    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfxnd\" (UniqueName: \"kubernetes.io/projected/43f51846-de5d-4bdf-aaac-bca0a6bc46da-kube-api-access-pfxnd\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.481017 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.481006    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-credential-socket\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.481169 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.481151    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-data\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.491645 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.481792    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-data\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.498619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.495419    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istiod-ca-cert\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.545064 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.499336    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-workload-certs\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.546057 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.499572    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-workload-socket\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.546251 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.499822    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-credential-socket\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.546467 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.524969    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-podinfo\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.568698 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.568585    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-token\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.576402 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.576366    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-envoy\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.595038 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.594475    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfxnd\" (UniqueName: \"kubernetes.io/projected/43f51846-de5d-4bdf-aaac-bca0a6bc46da-kube-api-access-pfxnd\") pod \"e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") " pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:21.669892 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.669856    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:21.675881 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.675852    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf"
Oct 30 23:43:21.869434 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:21.869397    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:22.250569 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:22.250540    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"]
Oct 30 23:43:22.251437 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:43:22.251400    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f51846_de5d_4bdf_aaac_bca0a6bc46da.slice/crio-446c9fadaed2d3e21e79c3c1f46edba17be1395727ca6543c7b3907422a571c1 WatchSource:0}: Error finding container 446c9fadaed2d3e21e79c3c1f46edba17be1395727ca6543c7b3907422a571c1: Status 404 returned error can't find the container with id 446c9fadaed2d3e21e79c3c1f46edba17be1395727ca6543c7b3907422a571c1
Oct 30 23:43:22.254292 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:22.254255    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:43:22.254376 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:22.254327    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:43:22.254376 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:22.254358    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:43:22.418717 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:22.416751    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:22.546104 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:22.546025    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf" event={"ID":"43f51846-de5d-4bdf-aaac-bca0a6bc46da","Type":"ContainerStarted","Data":"29c1493995ab745efb1086280e5e83e37721f408c4d6bdc60887a0bb65f9cfad"}
Oct 30 23:43:22.546104 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:22.546077    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf" event={"ID":"43f51846-de5d-4bdf-aaac-bca0a6bc46da","Type":"ContainerStarted","Data":"446c9fadaed2d3e21e79c3c1f46edba17be1395727ca6543c7b3907422a571c1"}
Oct 30 23:43:22.578922 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:22.578872    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf" podStartSLOduration=1.578855635 podStartE2EDuration="1.578855635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:43:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:43:22.574517375 +0000 UTC m=+1461.819373144" watchObservedRunningTime="2026-10-30 23:43:22.578855635 +0000 UTC m=+1461.823711404"
Oct 30 23:43:22.870729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:22.870630    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:23.381819 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:23.381785    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:23.875892 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:23.875860    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:24.100351 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:24.100314    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:24.264395 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:24.264360    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:24.650486 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:24.650455    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:24.662708 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:24.662551    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:24.662904 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:24.662846    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:43:24.887456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:24.887410    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"]
Oct 30 23:43:24.888011 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:24.887682    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9" podUID="a119696e-c906-4165-8ad5-c2564905dd39" containerName="istio-proxy" containerID="cri-o://c5e86926effffda425e295d82e073d4dafd5df02fbaf34c2206b775ddeab0a23" gracePeriod=30
Oct 30 23:43:25.596303 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:25.596264    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:25.610111 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:25.610078    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c"]
Oct 30 23:43:25.704062 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:25.704028    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c"]
Oct 30 23:43:25.704400 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:25.704379    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c"
Oct 30 23:43:25.724251 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:25.724223    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-1dd98b91-dockercfg-2lc7x\""
Oct 30 23:43:25.858679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:25.810675    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvtfn\" (UniqueName: \"kubernetes.io/projected/d7b6fff7-e212-41b7-817d-ebb838a75c16-kube-api-access-rvtfn\") pod \"payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c\" (UID: \"d7b6fff7-e212-41b7-817d-ebb838a75c16\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c"
Oct 30 23:43:25.878628 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:25.859425    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7b6fff7-e212-41b7-817d-ebb838a75c16-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c\" (UID: \"d7b6fff7-e212-41b7-817d-ebb838a75c16\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c"
Oct 30 23:43:25.879054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:25.818962    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-1dd98b91\""
Oct 30 23:43:25.992223 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:25.992179    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:26.028902 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.028858    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvtfn\" (UniqueName: \"kubernetes.io/projected/d7b6fff7-e212-41b7-817d-ebb838a75c16-kube-api-access-rvtfn\") pod \"payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c\" (UID: \"d7b6fff7-e212-41b7-817d-ebb838a75c16\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c"
Oct 30 23:43:26.029553 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.029526    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7b6fff7-e212-41b7-817d-ebb838a75c16-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c\" (UID: \"d7b6fff7-e212-41b7-817d-ebb838a75c16\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c"
Oct 30 23:43:26.031155 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.031130    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7b6fff7-e212-41b7-817d-ebb838a75c16-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c\" (UID: \"d7b6fff7-e212-41b7-817d-ebb838a75c16\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c"
Oct 30 23:43:26.081197 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.081163    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvtfn\" (UniqueName: \"kubernetes.io/projected/d7b6fff7-e212-41b7-817d-ebb838a75c16-kube-api-access-rvtfn\") pod \"payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c\" (UID: \"d7b6fff7-e212-41b7-817d-ebb838a75c16\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c"
Oct 30 23:43:26.352425 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.352388    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c"
Oct 30 23:43:26.497322 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.497230    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:26.721969 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.721934    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:26.726256 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.725866    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c"]
Oct 30 23:43:26.735050 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.735008    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"]
Oct 30 23:43:26.758936 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.758912    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.890621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.878048    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d32e7e03-43b2-463a-844f-b34c46203491-istio-token\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.890621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.878159    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-credential-socket\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.890621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.878205    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-istio-data\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.890621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.878251    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d32e7e03-43b2-463a-844f-b34c46203491-istio-podinfo\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.890621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.878376    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-workload-certs\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.890621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.878422    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d32e7e03-43b2-463a-844f-b34c46203491-istiod-ca-cert\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.890621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.878480    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv4bv\" (UniqueName: \"kubernetes.io/projected/d32e7e03-43b2-463a-844f-b34c46203491-kube-api-access-cv4bv\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.890621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.878584    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-workload-socket\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.890621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.878740    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-istio-envoy\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.890621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.758812    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"]
Oct 30 23:43:26.908700 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.908628    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:26.929255 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.928654    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c" event={"ID":"d7b6fff7-e212-41b7-817d-ebb838a75c16","Type":"ContainerStarted","Data":"456e9d88510fcc2d84f210140a5948d590e38e5814c9d50c6faa658a2227505a"}
Oct 30 23:43:26.929255 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.928719    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c" event={"ID":"d7b6fff7-e212-41b7-817d-ebb838a75c16","Type":"ContainerStarted","Data":"341a8592e9fc72e1b9e8431ea1221e2490b667ab1c9c85bdfb216079e0a6733f"}
Oct 30 23:43:26.929255 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.929121    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c"
Oct 30 23:43:26.957137 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.957038    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c" podStartSLOduration=1.9570256499999998 podStartE2EDuration="1.95702565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:43:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:43:26.956930529 +0000 UTC m=+1466.201786300" watchObservedRunningTime="2026-10-30 23:43:26.95702565 +0000 UTC m=+1466.201881419"
Oct 30 23:43:26.980673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.980641    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d32e7e03-43b2-463a-844f-b34c46203491-istio-token\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.980818 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.980797    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-credential-socket\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.980895 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.980871    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-istio-data\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.981016 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.980939    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d32e7e03-43b2-463a-844f-b34c46203491-istio-podinfo\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.981079 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.981055    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-workload-certs\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.981137 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.981091    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d32e7e03-43b2-463a-844f-b34c46203491-istiod-ca-cert\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.981283 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.981183    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv4bv\" (UniqueName: \"kubernetes.io/projected/d32e7e03-43b2-463a-844f-b34c46203491-kube-api-access-cv4bv\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.981283 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.981248    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-credential-socket\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.981424 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.981288    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-istio-data\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.981424 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.981390    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-workload-socket\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.981512 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.981499    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-istio-envoy\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.981730 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.981708    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-workload-socket\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.981907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.981884    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d32e7e03-43b2-463a-844f-b34c46203491-istiod-ca-cert\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.982065 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.982046    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-workload-certs\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.983847 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.983827    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-istio-envoy\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.983975 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.983956    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d32e7e03-43b2-463a-844f-b34c46203491-istio-podinfo\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.995498 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.995475    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d32e7e03-43b2-463a-844f-b34c46203491-istio-token\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:26.995862 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:26.995779    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv4bv\" (UniqueName: \"kubernetes.io/projected/d32e7e03-43b2-463a-844f-b34c46203491-kube-api-access-cv4bv\") pod \"e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") " pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:27.219667 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:27.214526    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:27.771239 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:27.771210    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"]
Oct 30 23:43:27.772310 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:43:27.772283    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32e7e03_43b2_463a_844f_b34c46203491.slice/crio-cb3d1849464c30573fea91f0a909434d34e4fa858b608255ac24f579afb2e818 WatchSource:0}: Error finding container cb3d1849464c30573fea91f0a909434d34e4fa858b608255ac24f579afb2e818: Status 404 returned error can't find the container with id cb3d1849464c30573fea91f0a909434d34e4fa858b608255ac24f579afb2e818
Oct 30 23:43:27.774982 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:27.774942    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:43:27.775056 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:27.775027    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:43:27.775094 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:27.775073    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:43:27.940088 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:27.940055    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7" event={"ID":"d32e7e03-43b2-463a-844f-b34c46203491","Type":"ContainerStarted","Data":"38af2ba2e052f2b2521a3c6835c6024fd3cdfc7df7124a9d2e6071a3de167793"}
Oct 30 23:43:27.940260 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:27.940103    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7" event={"ID":"d32e7e03-43b2-463a-844f-b34c46203491","Type":"ContainerStarted","Data":"cb3d1849464c30573fea91f0a909434d34e4fa858b608255ac24f579afb2e818"}
Oct 30 23:43:28.000630 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:27.999958    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:28.000630 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:28.000483    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7" podStartSLOduration=2.000463188 podStartE2EDuration="2.000463188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:43:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:43:27.997710948 +0000 UTC m=+1467.242566718" watchObservedRunningTime="2026-10-30 23:43:28.000463188 +0000 UTC m=+1467.245318957"
Oct 30 23:43:28.174937 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:28.174800    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:28.217123 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:28.215887    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:28.217313 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:28.217141    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 23:43:28.217313 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:28.217202    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7" podUID="d32e7e03-43b2-463a-844f-b34c46203491" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 23:43:28.554787 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:28.554706    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:28.945326 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:28.945297    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"]
Oct 30 23:43:28.950890 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:28.950865    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:28.961011 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:28.958371    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e4285d4a-openshift-default-dockercfg-dnz2q\""
Oct 30 23:43:29.018963 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.018933    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"]
Oct 30 23:43:29.089621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.089158    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-token\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.089621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.089335    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bml5\" (UniqueName: \"kubernetes.io/projected/186ab5a2-2953-437c-b1a2-b883c1a32dca-kube-api-access-8bml5\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.089621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.089380    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-podinfo\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.117621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.113839    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-data\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.117621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.113994    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-workload-certs\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.117621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.114164    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-credential-socket\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.117621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.114252    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-envoy\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.117621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.114280    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/186ab5a2-2953-437c-b1a2-b883c1a32dca-istiod-ca-cert\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.117621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.114312    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-workload-socket\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.254758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.217056    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-data\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.254758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.217169    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-workload-certs\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.254758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.217260    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-credential-socket\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.254758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.217309    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-envoy\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.254758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.217336    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/186ab5a2-2953-437c-b1a2-b883c1a32dca-istiod-ca-cert\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.254758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.217363    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-workload-socket\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.254758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.217419    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-token\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.254758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.217537    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bml5\" (UniqueName: \"kubernetes.io/projected/186ab5a2-2953-437c-b1a2-b883c1a32dca-kube-api-access-8bml5\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.254758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.217576    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-podinfo\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.254758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.247988    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:29.254758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.248125    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 23:43:29.254758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.248167    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7" podUID="d32e7e03-43b2-463a-844f-b34c46203491" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 23:43:29.285704 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.273672    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-workload-socket\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.285704 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.280931    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/186ab5a2-2953-437c-b1a2-b883c1a32dca-istiod-ca-cert\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.325617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.287794    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-workload-certs\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.325856 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.324377    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-envoy\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.348500 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.325242    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-credential-socket\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.348500 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.325858    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-data\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.397503 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.397215    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-token\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.397503 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.397317    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bml5\" (UniqueName: \"kubernetes.io/projected/186ab5a2-2953-437c-b1a2-b883c1a32dca-kube-api-access-8bml5\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.545660 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.540856    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-podinfo\") pod \"e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") " pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.615201 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.615164    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:29.697643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:29.691226    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:30.129950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.115509    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"]
Oct 30 23:43:30.202513 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.144534    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:30.209874 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:43:30.209842    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186ab5a2_2953_437c_b1a2_b883c1a32dca.slice/crio-bd922e2df42d6e23d5c4ab238e0477d2c3e10452819785484bda9c942bff4761 WatchSource:0}: Error finding container bd922e2df42d6e23d5c4ab238e0477d2c3e10452819785484bda9c942bff4761: Status 404 returned error can't find the container with id bd922e2df42d6e23d5c4ab238e0477d2c3e10452819785484bda9c942bff4761
Oct 30 23:43:30.213335 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.213295    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:43:30.213424 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.213388    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:43:30.213463 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.213430    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:43:30.216676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.216560    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 23:43:30.216676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.216629    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7" podUID="d32e7e03-43b2-463a-844f-b34c46203491" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 23:43:30.402773 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.402739    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:43:30.451614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.447196    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a119696e-c906-4165-8ad5-c2564905dd39-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a119696e-c906-4165-8ad5-c2564905dd39-istiod-ca-cert\") pod \"a119696e-c906-4165-8ad5-c2564905dd39\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") "
Oct 30 23:43:30.451614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.447340    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-workload-socket\") pod \"a119696e-c906-4165-8ad5-c2564905dd39\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") "
Oct 30 23:43:30.451614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.447402    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-istio-envoy\") pod \"a119696e-c906-4165-8ad5-c2564905dd39\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") "
Oct 30 23:43:30.451614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.448470    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a119696e-c906-4165-8ad5-c2564905dd39-istiod-ca-cert" pod "a119696e-c906-4165-8ad5-c2564905dd39" (UID: "a119696e-c906-4165-8ad5-c2564905dd39"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:43:30.451614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.449606    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-workload-socket" pod "a119696e-c906-4165-8ad5-c2564905dd39" (UID: "a119696e-c906-4165-8ad5-c2564905dd39"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:43:30.452013 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.451700    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a119696e-c906-4165-8ad5-c2564905dd39-kube-api-access-bndxv" pod "a119696e-c906-4165-8ad5-c2564905dd39" (UID: "a119696e-c906-4165-8ad5-c2564905dd39"). InnerVolumeSpecName "kube-api-access-bndxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:43:30.452013 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.447453    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a119696e-c906-4165-8ad5-c2564905dd39-kube-api-access-bndxv\" (UniqueName: \"kubernetes.io/projected/a119696e-c906-4165-8ad5-c2564905dd39-kube-api-access-bndxv\") pod \"a119696e-c906-4165-8ad5-c2564905dd39\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") "
Oct 30 23:43:30.452013 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.451984    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-istio-data\") pod \"a119696e-c906-4165-8ad5-c2564905dd39\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") "
Oct 30 23:43:30.452178 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.452075    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a119696e-c906-4165-8ad5-c2564905dd39-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a119696e-c906-4165-8ad5-c2564905dd39-istio-podinfo\") pod \"a119696e-c906-4165-8ad5-c2564905dd39\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") "
Oct 30 23:43:30.453851 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.453812    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-istio-data" pod "a119696e-c906-4165-8ad5-c2564905dd39" (UID: "a119696e-c906-4165-8ad5-c2564905dd39"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:43:30.479617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.461334    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-workload-certs\") pod \"a119696e-c906-4165-8ad5-c2564905dd39\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") "
Oct 30 23:43:30.479617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.461431    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a119696e-c906-4165-8ad5-c2564905dd39-istio-token\" (UniqueName: \"kubernetes.io/projected/a119696e-c906-4165-8ad5-c2564905dd39-istio-token\") pod \"a119696e-c906-4165-8ad5-c2564905dd39\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") "
Oct 30 23:43:30.479617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.461494    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-credential-socket\") pod \"a119696e-c906-4165-8ad5-c2564905dd39\" (UID: \"a119696e-c906-4165-8ad5-c2564905dd39\") "
Oct 30 23:43:30.479617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.462497    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a119696e-c906-4165-8ad5-c2564905dd39-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:30.479617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.462521    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:30.479617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.462535    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bndxv\" (UniqueName: \"kubernetes.io/projected/a119696e-c906-4165-8ad5-c2564905dd39-kube-api-access-bndxv\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:30.479617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.462551    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:30.479617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.463516    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-credential-socket" pod "a119696e-c906-4165-8ad5-c2564905dd39" (UID: "a119696e-c906-4165-8ad5-c2564905dd39"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:43:30.479617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.463747    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-workload-certs" pod "a119696e-c906-4165-8ad5-c2564905dd39" (UID: "a119696e-c906-4165-8ad5-c2564905dd39"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:43:30.479617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.463762    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a119696e-c906-4165-8ad5-c2564905dd39-istio-podinfo" pod "a119696e-c906-4165-8ad5-c2564905dd39" (UID: "a119696e-c906-4165-8ad5-c2564905dd39"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:43:30.511846 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.502471    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-istio-envoy" pod "a119696e-c906-4165-8ad5-c2564905dd39" (UID: "a119696e-c906-4165-8ad5-c2564905dd39"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:43:30.532624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.532385    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a119696e-c906-4165-8ad5-c2564905dd39-istio-token" pod "a119696e-c906-4165-8ad5-c2564905dd39" (UID: "a119696e-c906-4165-8ad5-c2564905dd39"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:43:30.565011 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.564980    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:30.565280 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.565257    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a119696e-c906-4165-8ad5-c2564905dd39-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:30.565488 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.565412    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:30.565664 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.565647    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a119696e-c906-4165-8ad5-c2564905dd39-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:30.565799 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.565784    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a119696e-c906-4165-8ad5-c2564905dd39-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:30.966305 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.966271    4921 generic.go:356] "Generic (PLEG): container finished" podID="a119696e-c906-4165-8ad5-c2564905dd39" containerID="c5e86926effffda425e295d82e073d4dafd5df02fbaf34c2206b775ddeab0a23" exitCode=0
Oct 30 23:43:30.966471 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.966319    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"
Oct 30 23:43:30.966471 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.966353    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9" event={"ID":"a119696e-c906-4165-8ad5-c2564905dd39","Type":"ContainerDied","Data":"c5e86926effffda425e295d82e073d4dafd5df02fbaf34c2206b775ddeab0a23"}
Oct 30 23:43:30.966471 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.966402    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9" event={"ID":"a119696e-c906-4165-8ad5-c2564905dd39","Type":"ContainerDied","Data":"7e99de7ba3c88b11f304a8830186a0aee5c1858ab88250a6099bd975799ce964"}
Oct 30 23:43:30.966471 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.966423    4921 scope.go:122] "RemoveContainer" containerID="c5e86926effffda425e295d82e073d4dafd5df02fbaf34c2206b775ddeab0a23"
Oct 30 23:43:30.996867 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.996774    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9" event={"ID":"186ab5a2-2953-437c-b1a2-b883c1a32dca","Type":"ContainerStarted","Data":"1dbc3746cd5d761b6a241c6cabfce113f33d7da3a3333499c5b76099e6f4065d"}
Oct 30 23:43:30.996867 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:30.996832    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9" event={"ID":"186ab5a2-2953-437c-b1a2-b883c1a32dca","Type":"ContainerStarted","Data":"bd922e2df42d6e23d5c4ab238e0477d2c3e10452819785484bda9c942bff4761"}
Oct 30 23:43:31.013936 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:31.013909    4921 scope.go:122] "RemoveContainer" containerID="c5e86926effffda425e295d82e073d4dafd5df02fbaf34c2206b775ddeab0a23"
Oct 30 23:43:31.014372 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:43:31.014341    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5e86926effffda425e295d82e073d4dafd5df02fbaf34c2206b775ddeab0a23\": container with ID starting with c5e86926effffda425e295d82e073d4dafd5df02fbaf34c2206b775ddeab0a23 not found: ID does not exist" containerID="c5e86926effffda425e295d82e073d4dafd5df02fbaf34c2206b775ddeab0a23"
Oct 30 23:43:31.014444 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:31.014387    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5e86926effffda425e295d82e073d4dafd5df02fbaf34c2206b775ddeab0a23"} err="failed to get container status \"c5e86926effffda425e295d82e073d4dafd5df02fbaf34c2206b775ddeab0a23\": rpc error: code = NotFound desc = could not find container \"c5e86926effffda425e295d82e073d4dafd5df02fbaf34c2206b775ddeab0a23\": container with ID starting with c5e86926effffda425e295d82e073d4dafd5df02fbaf34c2206b775ddeab0a23 not found: ID does not exist"
Oct 30 23:43:31.025744 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:31.025705    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9" podStartSLOduration=3.025691872 podStartE2EDuration="3.025691872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:43:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:43:31.024616934 +0000 UTC m=+1470.269472705" watchObservedRunningTime="2026-10-30 23:43:31.025691872 +0000 UTC m=+1470.270547634"
Oct 30 23:43:31.050373 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:31.050327    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"]
Oct 30 23:43:31.054202 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:31.054178    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxst9"]
Oct 30 23:43:31.221676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:31.217036    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 23:43:31.221676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:31.217206    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7" podUID="d32e7e03-43b2-463a-844f-b34c46203491" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 23:43:31.349617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:31.347189    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:31.615972 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:31.615887    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:31.622160 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:31.622133    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:32.005536 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:32.005504    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:32.006680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:32.006654    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:43:32.215450 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:32.215419    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 23:43:32.215672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:32.215483    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7" podUID="d32e7e03-43b2-463a-844f-b34c46203491" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 23:43:32.809622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:32.804554    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:32.910483 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:32.910440    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a119696e-c906-4165-8ad5-c2564905dd39" path="/var/lib/kubelet/pods/a119696e-c906-4165-8ad5-c2564905dd39/volumes"
Oct 30 23:43:33.215747 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:33.215718    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 23:43:33.215923 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:33.215779    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7" podUID="d32e7e03-43b2-463a-844f-b34c46203491" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 23:43:33.360839 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:33.360811    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:33.549474 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:33.549375    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:34.216214 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:34.216177    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 23:43:34.216776 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:34.216244    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7" podUID="d32e7e03-43b2-463a-844f-b34c46203491" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 23:43:34.346616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:34.330449    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:34.723095 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:34.723055    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:34.801228 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:34.801190    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs"]
Oct 30 23:43:34.802449 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:34.802425    4921 cpu_manager.go:414] "containerMap: removing container" podUID="a119696e-c906-4165-8ad5-c2564905dd39" containerName="istio-proxy"
Oct 30 23:43:34.802502 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:34.802453    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a119696e-c906-4165-8ad5-c2564905dd39" containerName="istio-proxy"
Oct 30 23:43:34.802719 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:34.802704    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="a119696e-c906-4165-8ad5-c2564905dd39" containerName="istio-proxy"
Oct 30 23:43:34.809249 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:34.809008    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs"
Oct 30 23:43:34.824531 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:34.819867    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-e4285d4a-dockercfg-zqj5w\""
Oct 30 23:43:34.827580 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:34.825857    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs"]
Oct 30 23:43:34.915619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:34.910612    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-e4285d4a\""
Oct 30 23:43:34.949822 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:34.944171    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:34.990006 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:34.972830    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gslhh\" (UniqueName: \"kubernetes.io/projected/37369cd4-f379-4ed8-8826-b0828b5f4374-kube-api-access-gslhh\") pod \"payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs\" (UID: \"37369cd4-f379-4ed8-8826-b0828b5f4374\") " pod="openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs"
Oct 30 23:43:34.990006 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:34.973135    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37369cd4-f379-4ed8-8826-b0828b5f4374-plugins-config-volume\") pod \"payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs\" (UID: \"37369cd4-f379-4ed8-8826-b0828b5f4374\") " pod="openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs"
Oct 30 23:43:35.081621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:35.077898    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37369cd4-f379-4ed8-8826-b0828b5f4374-plugins-config-volume\") pod \"payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs\" (UID: \"37369cd4-f379-4ed8-8826-b0828b5f4374\") " pod="openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs"
Oct 30 23:43:35.081621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:35.078104    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gslhh\" (UniqueName: \"kubernetes.io/projected/37369cd4-f379-4ed8-8826-b0828b5f4374-kube-api-access-gslhh\") pod \"payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs\" (UID: \"37369cd4-f379-4ed8-8826-b0828b5f4374\") " pod="openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs"
Oct 30 23:43:35.081621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:35.079951    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37369cd4-f379-4ed8-8826-b0828b5f4374-plugins-config-volume\") pod \"payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs\" (UID: \"37369cd4-f379-4ed8-8826-b0828b5f4374\") " pod="openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs"
Oct 30 23:43:35.167619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:35.163314    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gslhh\" (UniqueName: \"kubernetes.io/projected/37369cd4-f379-4ed8-8826-b0828b5f4374-kube-api-access-gslhh\") pod \"payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs\" (UID: \"37369cd4-f379-4ed8-8826-b0828b5f4374\") " pod="openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs"
Oct 30 23:43:35.265663 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:35.263257    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs"
Oct 30 23:43:35.296949 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:35.291683    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 23:43:35.296949 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:35.291786    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7" podUID="d32e7e03-43b2-463a-844f-b34c46203491" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 23:43:35.661751 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:35.661725    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs"]
Oct 30 23:43:35.664245 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:43:35.664208    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37369cd4_f379_4ed8_8826_b0828b5f4374.slice/crio-0f76bf4eec6e5374ec9eed9de0513431d0d57b45686be74c17a6124f8ed90483 WatchSource:0}: Error finding container 0f76bf4eec6e5374ec9eed9de0513431d0d57b45686be74c17a6124f8ed90483: Status 404 returned error can't find the container with id 0f76bf4eec6e5374ec9eed9de0513431d0d57b45686be74c17a6124f8ed90483
Oct 30 23:43:36.061711 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:36.060141    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:36.338052 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:36.337951    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:36.338857 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:36.338837    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:36.340117 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:36.340094    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 30 23:43:36.375494 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:36.375392    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs" event={"ID":"37369cd4-f379-4ed8-8826-b0828b5f4374","Type":"ContainerStarted","Data":"74ca3d456f7060b1df5a8550e8b6bc67b8c9636329d7c530c5b6d4825f399b5a"}
Oct 30 23:43:36.375494 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:36.375460    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs" event={"ID":"37369cd4-f379-4ed8-8826-b0828b5f4374","Type":"ContainerStarted","Data":"0f76bf4eec6e5374ec9eed9de0513431d0d57b45686be74c17a6124f8ed90483"}
Oct 30 23:43:36.375877 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:36.375715    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs"
Oct 30 23:43:36.446927 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:36.446864    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs" podStartSLOduration=2.446847821 podStartE2EDuration="2.446847821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:43:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:43:36.442452374 +0000 UTC m=+1475.687308142" watchObservedRunningTime="2026-10-30 23:43:36.446847821 +0000 UTC m=+1475.691703589"
Oct 30 23:43:37.200615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:37.198445    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:37.945703 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:37.943181    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c"
Oct 30 23:43:37.949074 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:37.949045    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"]
Oct 30 23:43:37.954246 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:37.954225    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"
Oct 30 23:43:37.969454 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:37.969430    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-1dd98b91-serving-cert\""
Oct 30 23:43:37.976120 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:37.976096    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"]
Oct 30 23:43:38.027511 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:38.027469    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff6708a-f84c-410e-b74a-05743d11fe24-maas-api-tls\") pod \"maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27\" (UID: \"9ff6708a-f84c-410e-b74a-05743d11fe24\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"
Oct 30 23:43:38.027722 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:38.027669    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff6708a-f84c-410e-b74a-05743d11fe24-openshift-service-ca\") pod \"maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27\" (UID: \"9ff6708a-f84c-410e-b74a-05743d11fe24\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"
Oct 30 23:43:38.027722 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:38.027706    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zls2h\" (UniqueName: \"kubernetes.io/projected/9ff6708a-f84c-410e-b74a-05743d11fe24-kube-api-access-zls2h\") pod \"maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27\" (UID: \"9ff6708a-f84c-410e-b74a-05743d11fe24\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"
Oct 30 23:43:38.027993 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:38.027972    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff6708a-f84c-410e-b74a-05743d11fe24-metrics-certs\") pod \"maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27\" (UID: \"9ff6708a-f84c-410e-b74a-05743d11fe24\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"
Oct 30 23:43:38.092021 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:38.091986    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:38.129813 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:38.129779    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff6708a-f84c-410e-b74a-05743d11fe24-openshift-service-ca\") pod \"maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27\" (UID: \"9ff6708a-f84c-410e-b74a-05743d11fe24\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"
Oct 30 23:43:38.129988 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:38.129829    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zls2h\" (UniqueName: \"kubernetes.io/projected/9ff6708a-f84c-410e-b74a-05743d11fe24-kube-api-access-zls2h\") pod \"maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27\" (UID: \"9ff6708a-f84c-410e-b74a-05743d11fe24\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"
Oct 30 23:43:38.130062 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:38.130000    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff6708a-f84c-410e-b74a-05743d11fe24-metrics-certs\") pod \"maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27\" (UID: \"9ff6708a-f84c-410e-b74a-05743d11fe24\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"
Oct 30 23:43:38.130150 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:38.130134    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff6708a-f84c-410e-b74a-05743d11fe24-maas-api-tls\") pod \"maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27\" (UID: \"9ff6708a-f84c-410e-b74a-05743d11fe24\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"
Oct 30 23:43:38.148676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:38.130568    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff6708a-f84c-410e-b74a-05743d11fe24-openshift-service-ca\") pod \"maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27\" (UID: \"9ff6708a-f84c-410e-b74a-05743d11fe24\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"
Oct 30 23:43:38.205678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:38.199398    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff6708a-f84c-410e-b74a-05743d11fe24-maas-api-tls\") pod \"maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27\" (UID: \"9ff6708a-f84c-410e-b74a-05743d11fe24\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"
Oct 30 23:43:38.205678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:38.201957    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff6708a-f84c-410e-b74a-05743d11fe24-metrics-certs\") pod \"maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27\" (UID: \"9ff6708a-f84c-410e-b74a-05743d11fe24\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"
Oct 30 23:43:38.233139 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:38.228508    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zls2h\" (UniqueName: \"kubernetes.io/projected/9ff6708a-f84c-410e-b74a-05743d11fe24-kube-api-access-zls2h\") pod \"maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27\" (UID: \"9ff6708a-f84c-410e-b74a-05743d11fe24\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"
Oct 30 23:43:38.273616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:38.270678    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"
Oct 30 23:43:38.312659 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:38.308168    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:38.676751 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:38.676718    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"]
Oct 30 23:43:38.678876 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:43:38.678848    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff6708a_f84c_410e_b74a_05743d11fe24.slice/crio-9232af520d96fd76c2429aa938cb610d4607bc3b7f345ba84323bbe31ef6f672 WatchSource:0}: Error finding container 9232af520d96fd76c2429aa938cb610d4607bc3b7f345ba84323bbe31ef6f672: Status 404 returned error can't find the container with id 9232af520d96fd76c2429aa938cb610d4607bc3b7f345ba84323bbe31ef6f672
Oct 30 23:43:39.208183 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:39.208159    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:39.406861 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:39.406831    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27" event={"ID":"9ff6708a-f84c-410e-b74a-05743d11fe24","Type":"ContainerStarted","Data":"98736f49d341aefaef98605bf1f8a3d68099afc4b29013bcb7a65962abd1efcd"}
Oct 30 23:43:39.407049 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:39.406892    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27" event={"ID":"9ff6708a-f84c-410e-b74a-05743d11fe24","Type":"ContainerStarted","Data":"9232af520d96fd76c2429aa938cb610d4607bc3b7f345ba84323bbe31ef6f672"}
Oct 30 23:43:39.407049 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:39.406932    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"
Oct 30 23:43:39.432212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:39.432163    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27" podStartSLOduration=1.905262616 podStartE2EDuration="2.43214894s" totalImagesPullingTime="526.886324ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:43:39.430767089 +0000 UTC m=+1478.675622860" watchObservedRunningTime="2026-10-30 23:43:39.43214894 +0000 UTC m=+1478.677004709"
Oct 30 23:43:40.244629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:40.237718    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:41.311616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:41.306678    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:41.445189 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:43:41.445156    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:43:42.567184 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:42.567148    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:43.545619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:43.528032    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:44.652870 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:44.652842    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:44.891062 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:44.891025    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:45.194556 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:45.194522    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q"]
Oct 30 23:43:45.204005 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:45.203978    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw"]
Oct 30 23:43:45.333176 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:45.333105    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:45.422698 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:45.422674    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"
Oct 30 23:43:45.553670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:45.546100    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:46.250694 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:46.250616    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:46.471451 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:46.471412    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:47.386479 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:47.386454    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs"
Oct 30 23:43:47.602913 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:47.602875    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:49.413269 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:49.413228    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/health\": context deadline exceeded"
Oct 30 23:43:49.510191 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:49.510147    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:49.541689 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:49.538149    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:43:49.577335 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:49.577285    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:49.605705 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:49.587576    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 23:43:49.606188 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:49.604715    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:49.616619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:49.611347    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:50.071616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:50.059672    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:50.407613 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:50.397508    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q" podUID="7f7da146-432f-468e-a84e-836ad6ed9b30" containerName="payload-processing" containerID="cri-o://bb020f40e3f32a2354a2fc964cf53438345075837f290afe292782151b0342a9" gracePeriod=25
Oct 30 23:43:50.407613 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:50.399320    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw" podUID="25d5d68f-0e57-4c79-8328-518cc4d8616d" containerName="payload-pre-processing" containerID="cri-o://7b41c6c1d7507a21c74f0a58f2a04b950b5d717ff4defea8dffe956527cd56a2" gracePeriod=25
Oct 30 23:43:50.517096 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:50.517024    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:50.525792 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:50.524043    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:43:50.542137 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:50.542101    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:50.573640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:50.561050    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:43:50.573640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:50.562302    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:43:50.573640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:50.562356    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8" podUID="8adef569-361f-4e2b-82c2-43610bd3a7b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:50.661631 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:50.589269    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:43:50.661631 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:50.618294    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:43:50.661631 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:50.618709    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 23:43:50.661631 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:50.649921    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:43:50.666626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:50.662105    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:50.693854 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:50.690558    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:50.925729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:50.925633    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:43:51.070874 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:51.070831    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:51.117960 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:51.117917    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:43:51.118255 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:51.118226    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq" podUID="31849433-47df-48bc-87c0-903660560055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:51.508646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:51.493524    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:43:51.508646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:51.493617    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:43:51.508646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:51.493659    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:43:51.534620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:51.528458    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:51.629484 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:51.622107    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:51.823451 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:51.807241    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 23:43:51.823451 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:51.807643    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:43:51.823451 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:51.807982    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:43:52.169955 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.169913    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:43:52.373051 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.170229    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:52.383633 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:43:52.196162    4921 logging.go:55] [core] [Channel #881 SubChannel #882]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.97:50052", ServerName: "10.132.0.97:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.97:50052: connect: connection refused"
Oct 30 23:43:52.383633 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.225058    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:43:52.383633 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.381082    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q" event={"ID":"7f7da146-432f-468e-a84e-836ad6ed9b30","Type":"ContainerDied","Data":"bb020f40e3f32a2354a2fc964cf53438345075837f290afe292782151b0342a9"}
Oct 30 23:43:52.383633 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.227438    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 23:43:52.384653 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:43:52.293905    4921 logging.go:55] [core] [Channel #883 SubChannel #884]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.96:50052", ServerName: "10.132.0.96:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.96:50052: connect: connection refused"
Oct 30 23:43:52.384849 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.294276    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:43:52.385104 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.317911    4921 generic.go:356] "Generic (PLEG): container finished" podID="7f7da146-432f-468e-a84e-836ad6ed9b30" containerID="bb020f40e3f32a2354a2fc964cf53438345075837f290afe292782151b0342a9" exitCode=0
Oct 30 23:43:52.385349 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.333695    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:43:52.429907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.228498    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:52.429907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.227402    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": context deadline exceeded"
Oct 30 23:43:52.459613 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.453685    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:43:52.468036 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.467862    4921 generic.go:356] "Generic (PLEG): container finished" podID="25d5d68f-0e57-4c79-8328-518cc4d8616d" containerID="7b41c6c1d7507a21c74f0a58f2a04b950b5d717ff4defea8dffe956527cd56a2" exitCode=0
Oct 30 23:43:52.487936 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.487874    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw" event={"ID":"25d5d68f-0e57-4c79-8328-518cc4d8616d","Type":"ContainerDied","Data":"7b41c6c1d7507a21c74f0a58f2a04b950b5d717ff4defea8dffe956527cd56a2"}
Oct 30 23:43:52.550926 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.523648    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:43:52.558231 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.558202    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:43:52.558448 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:43:52.488521    4921 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f7da146_432f_468e_a84e_836ad6ed9b30.slice/crio-conmon-bb020f40e3f32a2354a2fc964cf53438345075837f290afe292782151b0342a9.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 23:43:52.565972 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.565880    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:43:52.566475 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.566451    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:43:52.567976 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.567955    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:43:52.569949 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.569929    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:43:52.635846 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.635684    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:52.667464 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.667427    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q"
Oct 30 23:43:52.752843 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.751973    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f7da146-432f-468e-a84e-836ad6ed9b30-kube-api-access-29cqj\" (UniqueName: \"kubernetes.io/projected/7f7da146-432f-468e-a84e-836ad6ed9b30-kube-api-access-29cqj\") pod \"7f7da146-432f-468e-a84e-836ad6ed9b30\" (UID: \"7f7da146-432f-468e-a84e-836ad6ed9b30\") "
Oct 30 23:43:52.752843 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.752110    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7f7da146-432f-468e-a84e-836ad6ed9b30-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f7da146-432f-468e-a84e-836ad6ed9b30-plugins-config-volume\") pod \"7f7da146-432f-468e-a84e-836ad6ed9b30\" (UID: \"7f7da146-432f-468e-a84e-836ad6ed9b30\") "
Oct 30 23:43:52.753070 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.752841    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f7da146-432f-468e-a84e-836ad6ed9b30-plugins-config-volume" pod "7f7da146-432f-468e-a84e-836ad6ed9b30" (UID: "7f7da146-432f-468e-a84e-836ad6ed9b30"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:43:52.753778 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.753743    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f7da146-432f-468e-a84e-836ad6ed9b30-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:52.756791 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.756764    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f7da146-432f-468e-a84e-836ad6ed9b30-kube-api-access-29cqj" pod "7f7da146-432f-468e-a84e-836ad6ed9b30" (UID: "7f7da146-432f-468e-a84e-836ad6ed9b30"). InnerVolumeSpecName "kube-api-access-29cqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:43:52.851017 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.849398    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw"
Oct 30 23:43:52.854245 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.854216    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/25d5d68f-0e57-4c79-8328-518cc4d8616d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d5d68f-0e57-4c79-8328-518cc4d8616d-plugins-config-volume\") pod \"25d5d68f-0e57-4c79-8328-518cc4d8616d\" (UID: \"25d5d68f-0e57-4c79-8328-518cc4d8616d\") "
Oct 30 23:43:52.854519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.854503    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25d5d68f-0e57-4c79-8328-518cc4d8616d-kube-api-access-rn6hk\" (UniqueName: \"kubernetes.io/projected/25d5d68f-0e57-4c79-8328-518cc4d8616d-kube-api-access-rn6hk\") pod \"25d5d68f-0e57-4c79-8328-518cc4d8616d\" (UID: \"25d5d68f-0e57-4c79-8328-518cc4d8616d\") "
Oct 30 23:43:52.857504 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.855046    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29cqj\" (UniqueName: \"kubernetes.io/projected/7f7da146-432f-468e-a84e-836ad6ed9b30-kube-api-access-29cqj\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:52.857504 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.856618    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25d5d68f-0e57-4c79-8328-518cc4d8616d-plugins-config-volume" pod "25d5d68f-0e57-4c79-8328-518cc4d8616d" (UID: "25d5d68f-0e57-4c79-8328-518cc4d8616d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:43:52.858507 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.858205    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25d5d68f-0e57-4c79-8328-518cc4d8616d-kube-api-access-rn6hk" pod "25d5d68f-0e57-4c79-8328-518cc4d8616d" (UID: "25d5d68f-0e57-4c79-8328-518cc4d8616d"). InnerVolumeSpecName "kube-api-access-rn6hk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:43:52.958409 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.957527    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn6hk\" (UniqueName: \"kubernetes.io/projected/25d5d68f-0e57-4c79-8328-518cc4d8616d-kube-api-access-rn6hk\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:52.958409 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:52.957669    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25d5d68f-0e57-4c79-8328-518cc4d8616d-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:53.171252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:53.171207    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q" podUID="7f7da146-432f-468e-a84e-836ad6ed9b30" containerName="payload-processing" probeResult="failure" output="timeout: failed to connect service \"10.132.0.97:50052\" within 1s: context deadline exceeded"
Oct 30 23:43:53.233036 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:53.232980    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw" podUID="25d5d68f-0e57-4c79-8328-518cc4d8616d" containerName="payload-pre-processing" probeResult="failure" output="timeout: failed to connect service \"10.132.0.96:50052\" within 1s: context deadline exceeded"
Oct 30 23:43:53.544500 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:53.544398    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q" event={"ID":"7f7da146-432f-468e-a84e-836ad6ed9b30","Type":"ContainerDied","Data":"1b9531e4f9a2d753cb79d56e9861f7ebd5e620fb206192b8930cf3464b9160c2"}
Oct 30 23:43:53.544500 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:53.544478    4921 scope.go:122] "RemoveContainer" containerID="bb020f40e3f32a2354a2fc964cf53438345075837f290afe292782151b0342a9"
Oct 30 23:43:53.546499 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:53.544744    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q"
Oct 30 23:43:53.547095 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:53.546983    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw"
Oct 30 23:43:53.547177 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:53.547125    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw" event={"ID":"25d5d68f-0e57-4c79-8328-518cc4d8616d","Type":"ContainerDied","Data":"1ad86c7663e3b95d59ecb2bc037e6a415d16a63247d3de582a6578b049e1f19f"}
Oct 30 23:43:53.561246 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:53.561227    4921 scope.go:122] "RemoveContainer" containerID="7b41c6c1d7507a21c74f0a58f2a04b950b5d717ff4defea8dffe956527cd56a2"
Oct 30 23:43:53.561664 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:53.561640    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:53.581587 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:53.581562    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q"]
Oct 30 23:43:53.586245 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:53.586217    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ebbe654c-547f9b66f9-lr94q"]
Oct 30 23:43:53.630529 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:53.630494    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw"]
Oct 30 23:43:53.636504 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:53.636475    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ebbe654c-f56c899f9-jjcfw"]
Oct 30 23:43:54.484615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:54.475632    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:54.903018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:54.902989    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="25d5d68f-0e57-4c79-8328-518cc4d8616d" path="/var/lib/kubelet/pods/25d5d68f-0e57-4c79-8328-518cc4d8616d/volumes"
Oct 30 23:43:54.903422 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:54.903401    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7f7da146-432f-468e-a84e-836ad6ed9b30" path="/var/lib/kubelet/pods/7f7da146-432f-468e-a84e-836ad6ed9b30/volumes"
Oct 30 23:43:55.286490 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:55.286134    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:56.540869 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:56.534483    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:57.706782 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:57.706748    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:58.500657 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:58.500586    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:59.034475 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.034441    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"]
Oct 30 23:43:59.035007 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.034689    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln" podUID="b190d31a-96dd-4d6f-b87b-2e5d10eae95b" containerName="maas-api" containerID="cri-o://8e037a38b0faf9f9e893c433250c6723d13375bce492b42b10cf944836172213" gracePeriod=30
Oct 30 23:43:59.102485 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.102452    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:59.343672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.340218    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:59.609469 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.609223    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:59.732617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.729203    4921 generic.go:356] "Generic (PLEG): container finished" podID="b190d31a-96dd-4d6f-b87b-2e5d10eae95b" containerID="8e037a38b0faf9f9e893c433250c6723d13375bce492b42b10cf944836172213" exitCode=0
Oct 30 23:43:59.732617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.729329    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln" event={"ID":"b190d31a-96dd-4d6f-b87b-2e5d10eae95b","Type":"ContainerDied","Data":"8e037a38b0faf9f9e893c433250c6723d13375bce492b42b10cf944836172213"}
Oct 30 23:43:59.732617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.729383    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln" event={"ID":"b190d31a-96dd-4d6f-b87b-2e5d10eae95b","Type":"ContainerDied","Data":"4ad09c61efc1419d7e1cae73a3e058c14a2eab99066b81bc8354be089ba6c2ce"}
Oct 30 23:43:59.732617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.729408    4921 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ad09c61efc1419d7e1cae73a3e058c14a2eab99066b81bc8354be089ba6c2ce"
Oct 30 23:43:59.732617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.730771    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"
Oct 30 23:43:59.785441 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.783677    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-kube-api-access-k7kp6\" (UniqueName: \"kubernetes.io/projected/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-kube-api-access-k7kp6\") pod \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\" (UID: \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\") "
Oct 30 23:43:59.785441 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.783736    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-openshift-service-ca\") pod \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\" (UID: \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\") "
Oct 30 23:43:59.785441 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.783873    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-metrics-certs\") pod \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\" (UID: \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\") "
Oct 30 23:43:59.785441 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.783957    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-maas-api-tls\") pod \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\" (UID: \"b190d31a-96dd-4d6f-b87b-2e5d10eae95b\") "
Oct 30 23:43:59.786205 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.786038    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:43:59.786793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.786469    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-openshift-service-ca" pod "b190d31a-96dd-4d6f-b87b-2e5d10eae95b" (UID: "b190d31a-96dd-4d6f-b87b-2e5d10eae95b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:43:59.788224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.788186    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-maas-api-tls" pod "b190d31a-96dd-4d6f-b87b-2e5d10eae95b" (UID: "b190d31a-96dd-4d6f-b87b-2e5d10eae95b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:43:59.802001 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.801945    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-kube-api-access-k7kp6" pod "b190d31a-96dd-4d6f-b87b-2e5d10eae95b" (UID: "b190d31a-96dd-4d6f-b87b-2e5d10eae95b"). InnerVolumeSpecName "kube-api-access-k7kp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:43:59.804271 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.804223    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-metrics-certs" pod "b190d31a-96dd-4d6f-b87b-2e5d10eae95b" (UID: "b190d31a-96dd-4d6f-b87b-2e5d10eae95b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:43:59.887328 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.887295    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7kp6\" (UniqueName: \"kubernetes.io/projected/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-kube-api-access-k7kp6\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:59.887328 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.887326    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:59.887532 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.887337    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:59.887532 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.887347    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b190d31a-96dd-4d6f-b87b-2e5d10eae95b-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:43:59.958732 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:43:59.952763    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:00.664662 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:00.664583    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:00.737320 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:00.737278    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"
Oct 30 23:44:00.774630 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:00.774581    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"]
Oct 30 23:44:00.783855 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:00.783829    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ebbe654c-5d89c49947-pdjln"]
Oct 30 23:44:00.852168 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:00.852109    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:00.893123 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:00.893095    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b190d31a-96dd-4d6f-b87b-2e5d10eae95b" path="/var/lib/kubelet/pods/b190d31a-96dd-4d6f-b87b-2e5d10eae95b/volumes"
Oct 30 23:44:00.987865 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:00.987766    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:01.053565 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.053540    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 30 23:44:01.056401 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.056375    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 30 23:44:01.289674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.278368    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:01.438985 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.438952    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"]
Oct 30 23:44:01.440153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.440128    4921 cpu_manager.go:414] "containerMap: removing container" podUID="7f7da146-432f-468e-a84e-836ad6ed9b30" containerName="payload-processing"
Oct 30 23:44:01.440153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.440152    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f7da146-432f-468e-a84e-836ad6ed9b30" containerName="payload-processing"
Oct 30 23:44:01.440355 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.440182    4921 cpu_manager.go:414] "containerMap: removing container" podUID="25d5d68f-0e57-4c79-8328-518cc4d8616d" containerName="payload-pre-processing"
Oct 30 23:44:01.440355 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.440190    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25d5d68f-0e57-4c79-8328-518cc4d8616d" containerName="payload-pre-processing"
Oct 30 23:44:01.440355 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.440218    4921 cpu_manager.go:414] "containerMap: removing container" podUID="b190d31a-96dd-4d6f-b87b-2e5d10eae95b" containerName="maas-api"
Oct 30 23:44:01.440355 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.440225    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b190d31a-96dd-4d6f-b87b-2e5d10eae95b" containerName="maas-api"
Oct 30 23:44:01.440551 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.440373    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="b190d31a-96dd-4d6f-b87b-2e5d10eae95b" containerName="maas-api"
Oct 30 23:44:01.440551 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.440399    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="7f7da146-432f-468e-a84e-836ad6ed9b30" containerName="payload-processing"
Oct 30 23:44:01.440551 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.440411    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="25d5d68f-0e57-4c79-8328-518cc4d8616d" containerName="payload-pre-processing"
Oct 30 23:44:01.445903 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.445876    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.455545 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.455517    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-6cad1110-gw-openshift-default-dockercfg-bkjbd\""
Oct 30 23:44:01.467720 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.460226    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"]
Oct 30 23:44:01.540148 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.540059    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:01.555985 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.555951    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-workload-certs\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.556175 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.556011    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-data\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.556220 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.556160    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-credential-socket\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.556288 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.556269    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48vdn\" (UniqueName: \"kubernetes.io/projected/21ae1c1b-7826-48da-bb7a-21863aa658e6-kube-api-access-48vdn\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.556356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.556342    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-token\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.556455 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.556434    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-envoy\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.556583 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.556565    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-podinfo\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.556720 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.556701    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21ae1c1b-7826-48da-bb7a-21863aa658e6-istiod-ca-cert\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.556776 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.556763    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-workload-socket\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.705619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.697372    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-workload-certs\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.705619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.697450    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-data\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.705619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.697524    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-credential-socket\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.705619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.697618    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48vdn\" (UniqueName: \"kubernetes.io/projected/21ae1c1b-7826-48da-bb7a-21863aa658e6-kube-api-access-48vdn\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.705619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.697667    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-token\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.705619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.697725    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-envoy\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.705619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.697815    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-podinfo\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.705619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.697870    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21ae1c1b-7826-48da-bb7a-21863aa658e6-istiod-ca-cert\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.705619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.697924    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-workload-socket\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.705619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.699162    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:01.705619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.699726    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-data\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.727740 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.720501    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21ae1c1b-7826-48da-bb7a-21863aa658e6-istiod-ca-cert\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.727740 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.722192    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-credential-socket\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.748621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.740862    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-workload-certs\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.790667 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.774724    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-podinfo\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.792626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.791271    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-workload-socket\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.825303 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.824187    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-token\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.855800 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.853265    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48vdn\" (UniqueName: \"kubernetes.io/projected/21ae1c1b-7826-48da-bb7a-21863aa658e6-kube-api-access-48vdn\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:01.859617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:01.856309    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-envoy\") pod \"e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") " pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:02.073757 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:02.073678    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:02.370034 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:02.370008    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"]
Oct 30 23:44:02.371268 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:44:02.371240    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21ae1c1b_7826_48da_bb7a_21863aa658e6.slice/crio-ceeaf1949b1919309184e9cc07a4f16cb939bd191defc5de8bbe68d276b24a66 WatchSource:0}: Error finding container ceeaf1949b1919309184e9cc07a4f16cb939bd191defc5de8bbe68d276b24a66: Status 404 returned error can't find the container with id ceeaf1949b1919309184e9cc07a4f16cb939bd191defc5de8bbe68d276b24a66
Oct 30 23:44:02.374436 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:02.374402    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:02.374533 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:02.374470    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:02.374533 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:02.374502    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:02.484753 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:02.483843    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:02.801717 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:02.801676    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t" event={"ID":"21ae1c1b-7826-48da-bb7a-21863aa658e6","Type":"ContainerStarted","Data":"e6dae0f46a0ee94223a9d0f6213f318c0ac9989409dac0b0f26812d4503a10d6"}
Oct 30 23:44:02.802230 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:02.801736    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t" event={"ID":"21ae1c1b-7826-48da-bb7a-21863aa658e6","Type":"ContainerStarted","Data":"ceeaf1949b1919309184e9cc07a4f16cb939bd191defc5de8bbe68d276b24a66"}
Oct 30 23:44:02.843213 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:02.843150    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t" podStartSLOduration=1.843131306 podStartE2EDuration="1.843131306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:44:02.839049585 +0000 UTC m=+1502.083905377" watchObservedRunningTime="2026-10-30 23:44:02.843131306 +0000 UTC m=+1502.087987076"
Oct 30 23:44:03.080678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:03.077707    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:03.102616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:03.099039    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:04.034035 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:03.977939    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:04.034715 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:04.034664    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:44:04.325887 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:04.325769    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:05.171763 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:05.171713    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:05.353131 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:05.353097    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:05.504040 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:05.503951    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:05.862007 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:05.861900    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:05.996220 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:05.996180    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9"]
Oct 30 23:44:06.002452 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.002430    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj"]
Oct 30 23:44:06.002641 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.002560    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9"
Oct 30 23:44:06.032847 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.032811    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-6cad1110\""
Oct 30 23:44:06.039630 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.039256    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-6cad1110-dockercfg-4cnfx\""
Oct 30 23:44:06.039980 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.039958    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9"]
Oct 30 23:44:06.040219 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.040205    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj"
Oct 30 23:44:06.080145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.080068    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj"]
Oct 30 23:44:06.080906 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.080881    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:06.114443 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.112861    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9dac6af-3e9a-4aa4-9849-68a96eee0791-plugins-config-volume\") pod \"payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj\" (UID: \"c9dac6af-3e9a-4aa4-9849-68a96eee0791\") " pod="openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj"
Oct 30 23:44:06.114443 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.113129    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snqsf\" (UniqueName: \"kubernetes.io/projected/45557842-4e1c-4a7d-b6f1-bb1a9080503f-kube-api-access-snqsf\") pod \"payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9\" (UID: \"45557842-4e1c-4a7d-b6f1-bb1a9080503f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9"
Oct 30 23:44:06.114443 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.113227    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45557842-4e1c-4a7d-b6f1-bb1a9080503f-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9\" (UID: \"45557842-4e1c-4a7d-b6f1-bb1a9080503f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9"
Oct 30 23:44:06.114443 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.113255    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h2ts\" (UniqueName: \"kubernetes.io/projected/c9dac6af-3e9a-4aa4-9849-68a96eee0791-kube-api-access-2h2ts\") pod \"payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj\" (UID: \"c9dac6af-3e9a-4aa4-9849-68a96eee0791\") " pod="openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj"
Oct 30 23:44:06.252145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.252107    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9dac6af-3e9a-4aa4-9849-68a96eee0791-plugins-config-volume\") pod \"payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj\" (UID: \"c9dac6af-3e9a-4aa4-9849-68a96eee0791\") " pod="openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj"
Oct 30 23:44:06.264961 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.264920    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snqsf\" (UniqueName: \"kubernetes.io/projected/45557842-4e1c-4a7d-b6f1-bb1a9080503f-kube-api-access-snqsf\") pod \"payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9\" (UID: \"45557842-4e1c-4a7d-b6f1-bb1a9080503f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9"
Oct 30 23:44:06.265329 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.265308    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45557842-4e1c-4a7d-b6f1-bb1a9080503f-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9\" (UID: \"45557842-4e1c-4a7d-b6f1-bb1a9080503f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9"
Oct 30 23:44:06.271625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.265458    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h2ts\" (UniqueName: \"kubernetes.io/projected/c9dac6af-3e9a-4aa4-9849-68a96eee0791-kube-api-access-2h2ts\") pod \"payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj\" (UID: \"c9dac6af-3e9a-4aa4-9849-68a96eee0791\") " pod="openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj"
Oct 30 23:44:06.282618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.261480    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9dac6af-3e9a-4aa4-9849-68a96eee0791-plugins-config-volume\") pod \"payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj\" (UID: \"c9dac6af-3e9a-4aa4-9849-68a96eee0791\") " pod="openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj"
Oct 30 23:44:06.295617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.284136    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45557842-4e1c-4a7d-b6f1-bb1a9080503f-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9\" (UID: \"45557842-4e1c-4a7d-b6f1-bb1a9080503f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9"
Oct 30 23:44:06.342240 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.337652    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snqsf\" (UniqueName: \"kubernetes.io/projected/45557842-4e1c-4a7d-b6f1-bb1a9080503f-kube-api-access-snqsf\") pod \"payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9\" (UID: \"45557842-4e1c-4a7d-b6f1-bb1a9080503f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9"
Oct 30 23:44:06.347066 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.347005    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h2ts\" (UniqueName: \"kubernetes.io/projected/c9dac6af-3e9a-4aa4-9849-68a96eee0791-kube-api-access-2h2ts\") pod \"payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj\" (UID: \"c9dac6af-3e9a-4aa4-9849-68a96eee0791\") " pod="openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj"
Oct 30 23:44:06.431691 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.408763    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9"
Oct 30 23:44:06.497682 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.497442    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj"
Oct 30 23:44:06.802502 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.802475    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9"]
Oct 30 23:44:06.803023 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:44:06.803000    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45557842_4e1c_4a7d_b6f1_bb1a9080503f.slice/crio-8d5e6c2115693458c951fabf3648a1b63418d9372512e36881d962fee48bbda6 WatchSource:0}: Error finding container 8d5e6c2115693458c951fabf3648a1b63418d9372512e36881d962fee48bbda6: Status 404 returned error can't find the container with id 8d5e6c2115693458c951fabf3648a1b63418d9372512e36881d962fee48bbda6
Oct 30 23:44:06.855536 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.855507    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj"]
Oct 30 23:44:06.856687 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:44:06.856655    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9dac6af_3e9a_4aa4_9849_68a96eee0791.slice/crio-c9195131d43e3917b2a2cfb64b0008774908d99266bccf75ef5e821d5792faa7 WatchSource:0}: Error finding container c9195131d43e3917b2a2cfb64b0008774908d99266bccf75ef5e821d5792faa7: Status 404 returned error can't find the container with id c9195131d43e3917b2a2cfb64b0008774908d99266bccf75ef5e821d5792faa7
Oct 30 23:44:06.970727 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:06.970699    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:07.053668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:07.040377    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj" event={"ID":"c9dac6af-3e9a-4aa4-9849-68a96eee0791","Type":"ContainerStarted","Data":"3f9c3fe7424bd2d33331f66ce0736133cd6b06b3f297f08c43e7748486667a4f"}
Oct 30 23:44:07.053668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:07.040447    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj" event={"ID":"c9dac6af-3e9a-4aa4-9849-68a96eee0791","Type":"ContainerStarted","Data":"c9195131d43e3917b2a2cfb64b0008774908d99266bccf75ef5e821d5792faa7"}
Oct 30 23:44:07.053668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:07.041851    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj"
Oct 30 23:44:07.053668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:07.051538    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9" event={"ID":"45557842-4e1c-4a7d-b6f1-bb1a9080503f","Type":"ContainerStarted","Data":"57af1844cd9f17a48d715a2bf84f4b5170dfd9168668e849c5271409adf7ffe4"}
Oct 30 23:44:07.053668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:07.051622    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9" event={"ID":"45557842-4e1c-4a7d-b6f1-bb1a9080503f","Type":"ContainerStarted","Data":"8d5e6c2115693458c951fabf3648a1b63418d9372512e36881d962fee48bbda6"}
Oct 30 23:44:07.053668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:07.052612    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9"
Oct 30 23:44:07.076622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:07.075340    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj" podStartSLOduration=2.075318338 podStartE2EDuration="2.075318338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:44:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:44:07.065038378 +0000 UTC m=+1506.309894146" watchObservedRunningTime="2026-10-30 23:44:07.075318338 +0000 UTC m=+1506.320174108"
Oct 30 23:44:07.129046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:07.128963    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9" podStartSLOduration=2.128940481 podStartE2EDuration="2.128940481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:44:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:44:07.112820925 +0000 UTC m=+1506.357676694" watchObservedRunningTime="2026-10-30 23:44:07.128940481 +0000 UTC m=+1506.373796250"
Oct 30 23:44:07.529883 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:07.529849    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:08.098627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:08.098142    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:09.020272 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:09.020197    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:09.068204 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:09.068173    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf"]
Oct 30 23:44:09.213007 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:09.212954    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:09.355610 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:09.355471    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:09.544622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:09.539963    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:09.964266 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:09.964240    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:10.090661 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.090621    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"]
Oct 30 23:44:10.095513 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.095490    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.144201 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.144170    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"]
Oct 30 23:44:10.149197 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.149131    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"]
Oct 30 23:44:10.154303 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.154279    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.170463 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.169412    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:10.185774 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.185749    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"]
Oct 30 23:44:10.191885 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.191856    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.192028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.191940    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.192081 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.192035    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.192134 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.192093    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.192185 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.192148    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.192185 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.192177    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.192301 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.192286    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.192343 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.192321    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.200668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.192489    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65nhl\" (UniqueName: \"kubernetes.io/projected/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-kube-api-access-65nhl\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.294624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.294519    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b175126-9bea-4fd8-8139-7e392c602a9e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.294624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.294568    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b175126-9bea-4fd8-8139-7e392c602a9e-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.294872 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.294648    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b175126-9bea-4fd8-8139-7e392c602a9e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.294872 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.294718    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.294872 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.294769    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.294872 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.294805    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.295094 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.294896    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b175126-9bea-4fd8-8139-7e392c602a9e-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.295094 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.294924    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.295094 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.294967    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.295094 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.295040    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b175126-9bea-4fd8-8139-7e392c602a9e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.295262 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.295095    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b175126-9bea-4fd8-8139-7e392c602a9e-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.295262 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.295113    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.295262 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.295232    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.295262 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.295235    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b175126-9bea-4fd8-8139-7e392c602a9e-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.295409 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.295297    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65nhl\" (UniqueName: \"kubernetes.io/projected/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-kube-api-access-65nhl\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.295409 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.295323    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbcrd\" (UniqueName: \"kubernetes.io/projected/9b175126-9bea-4fd8-8139-7e392c602a9e-kube-api-access-fbcrd\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.295501 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.295425    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.295501 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.295432    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.295582 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.295525    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.295662 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.295587    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.295662 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.295646    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b175126-9bea-4fd8-8139-7e392c602a9e-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.295771 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.295735    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.296196 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.296171    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.297292 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.297273    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.298252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.298229    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.315181 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.315159    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.316435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.316409    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65nhl\" (UniqueName: \"kubernetes.io/projected/31f7fe08-e50d-4112-ad82-34d9d4ccf5c1-kube-api-access-65nhl\") pod \"maas-default-gateway-openshift-default-5df48fcc99-ghblg\" (UID: \"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.398015 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.397984    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b175126-9bea-4fd8-8139-7e392c602a9e-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.398205 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.398041    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b175126-9bea-4fd8-8139-7e392c602a9e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.398205 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.398071    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b175126-9bea-4fd8-8139-7e392c602a9e-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.398205 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.398109    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b175126-9bea-4fd8-8139-7e392c602a9e-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.398387 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.398224    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbcrd\" (UniqueName: \"kubernetes.io/projected/9b175126-9bea-4fd8-8139-7e392c602a9e-kube-api-access-fbcrd\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.398491 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.398466    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b175126-9bea-4fd8-8139-7e392c602a9e-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.398564 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.398472    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b175126-9bea-4fd8-8139-7e392c602a9e-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.398564 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.398505    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b175126-9bea-4fd8-8139-7e392c602a9e-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.398564 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.398559    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b175126-9bea-4fd8-8139-7e392c602a9e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.398750 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.398587    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b175126-9bea-4fd8-8139-7e392c602a9e-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.398750 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.398633    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b175126-9bea-4fd8-8139-7e392c602a9e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.398750 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.398741    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b175126-9bea-4fd8-8139-7e392c602a9e-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.398965 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.398943    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b175126-9bea-4fd8-8139-7e392c602a9e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.399035 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.398968    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b175126-9bea-4fd8-8139-7e392c602a9e-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.401097 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.401067    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b175126-9bea-4fd8-8139-7e392c602a9e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.401392 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.401374    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b175126-9bea-4fd8-8139-7e392c602a9e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.411786 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.411754    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:10.423115 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.423088    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b175126-9bea-4fd8-8139-7e392c602a9e-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.423250 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.423100    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbcrd\" (UniqueName: \"kubernetes.io/projected/9b175126-9bea-4fd8-8139-7e392c602a9e-kube-api-access-fbcrd\") pod \"maas-default-gateway-openshift-default-5df48fcc99-kr9zt\" (UID: \"9b175126-9bea-4fd8-8139-7e392c602a9e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.484838 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.484811    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:10.641740 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.641701    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:10.723259 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.723229    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"]
Oct 30 23:44:10.724132 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:44:10.724101    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f7fe08_e50d_4112_ad82_34d9d4ccf5c1.slice/crio-f0a35b19239df5b7e7c3bcfee9760ab31a0fe1dd92ce448f15ca1ff0bc12d227 WatchSource:0}: Error finding container f0a35b19239df5b7e7c3bcfee9760ab31a0fe1dd92ce448f15ca1ff0bc12d227: Status 404 returned error can't find the container with id f0a35b19239df5b7e7c3bcfee9760ab31a0fe1dd92ce448f15ca1ff0bc12d227
Oct 30 23:44:10.726934 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.726894    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:10.727052 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.726993    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:10.727052 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.727026    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:10.821980 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.821280    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:10.905623 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:44:10.904535    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b175126_9bea_4fd8_8139_7e392c602a9e.slice/crio-0e2e3efd21973a9d3260d738f769ab0386c8349d8a8edacd9e1bb516b89239f5 WatchSource:0}: Error finding container 0e2e3efd21973a9d3260d738f769ab0386c8349d8a8edacd9e1bb516b89239f5: Status 404 returned error can't find the container with id 0e2e3efd21973a9d3260d738f769ab0386c8349d8a8edacd9e1bb516b89239f5
Oct 30 23:44:10.919026 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.918873    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"]
Oct 30 23:44:10.921725 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.921686    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:10.921849 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.921782    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:10.921849 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:10.921818    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:11.076567 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:11.075233    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c"]
Oct 30 23:44:11.094578 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:11.093953    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg" event={"ID":"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1","Type":"ContainerStarted","Data":"129b8ca9c5d3bbb13d0ccb5c73fbaa9e4ab1696b9d10db19ab7bd0f29c51876d"}
Oct 30 23:44:11.094578 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:11.094018    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg" event={"ID":"31f7fe08-e50d-4112-ad82-34d9d4ccf5c1","Type":"ContainerStarted","Data":"f0a35b19239df5b7e7c3bcfee9760ab31a0fe1dd92ce448f15ca1ff0bc12d227"}
Oct 30 23:44:11.100626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:11.099678    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt" event={"ID":"9b175126-9bea-4fd8-8139-7e392c602a9e","Type":"ContainerStarted","Data":"718484c110e4a7f3c1c4ed35078ebf2f3a59e7e98bea99e61b343de77df9ab29"}
Oct 30 23:44:11.100626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:11.099740    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt" event={"ID":"9b175126-9bea-4fd8-8139-7e392c602a9e","Type":"ContainerStarted","Data":"0e2e3efd21973a9d3260d738f769ab0386c8349d8a8edacd9e1bb516b89239f5"}
Oct 30 23:44:11.155907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:11.155841    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg" podStartSLOduration=1.155821875 podStartE2EDuration="1.155821875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:44:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:44:11.148027179 +0000 UTC m=+1510.392882947" watchObservedRunningTime="2026-10-30 23:44:11.155821875 +0000 UTC m=+1510.400677644"
Oct 30 23:44:11.197935 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:11.197895    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:11.391762 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:11.391728    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:11.497620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:11.477531    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:11.497620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:11.477728    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-ghblg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 23:44:11.497620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:11.477777    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg" podUID="31f7fe08-e50d-4112-ad82-34d9d4ccf5c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 23:44:11.497620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:11.488106    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:11.606398 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:44:11.606363    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:44:12.192620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:12.189373    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:12.424212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:12.424174    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-ghblg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 23:44:12.424469 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:12.424441    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg" podUID="31f7fe08-e50d-4112-ad82-34d9d4ccf5c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 23:44:12.494704 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:12.488481    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-kr9zt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 23:44:12.494704 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:12.488548    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt" podUID="9b175126-9bea-4fd8-8139-7e392c602a9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 23:44:13.120184 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:13.120046    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:13.415614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:13.414936    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-ghblg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 23:44:13.415614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:13.414995    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg" podUID="31f7fe08-e50d-4112-ad82-34d9d4ccf5c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 23:44:13.492615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:13.488655    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-kr9zt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 23:44:13.492615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:13.488736    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt" podUID="9b175126-9bea-4fd8-8139-7e392c602a9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 23:44:13.593950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:13.592438    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:13.767670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:13.763243    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:14.082072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:14.073679    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf" podUID="1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4" containerName="payload-pre-processing" containerID="cri-o://c515c5ea98badf928aa8f8930050e04dd24e6bc0db763c1911e36dc3464ed265" gracePeriod=25
Oct 30 23:44:14.418370 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:14.414853    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-ghblg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 23:44:14.418370 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:14.414918    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg" podUID="31f7fe08-e50d-4112-ad82-34d9d4ccf5c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 23:44:14.651184 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:14.642898    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-kr9zt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 23:44:14.651184 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:14.642975    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt" podUID="9b175126-9bea-4fd8-8139-7e392c602a9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 23:44:14.675923 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:14.675249    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:14.940866 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:14.940807    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf"
Oct 30 23:44:15.008776 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.008712    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt" podStartSLOduration=5.008689193 podStartE2EDuration="5.008689193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:44:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:44:11.193020153 +0000 UTC m=+1510.437875922" watchObservedRunningTime="2026-10-30 23:44:15.008689193 +0000 UTC m=+1514.253544965"
Oct 30 23:44:15.038355 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.038317    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4-kube-api-access-cd2rj\" (UniqueName: \"kubernetes.io/projected/1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4-kube-api-access-cd2rj\") pod \"1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4\" (UID: \"1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4\") "
Oct 30 23:44:15.038518 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.038399    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4-plugins-config-volume\") pod \"1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4\" (UID: \"1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4\") "
Oct 30 23:44:15.039257 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.039214    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4-plugins-config-volume" pod "1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4" (UID: "1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:44:15.039552 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.039402    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:15.041346 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.041322    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4-kube-api-access-cd2rj" pod "1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4" (UID: "1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4"). InnerVolumeSpecName "kube-api-access-cd2rj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:44:15.141113 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.141070    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cd2rj\" (UniqueName: \"kubernetes.io/projected/1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4-kube-api-access-cd2rj\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:15.239306 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.239217    4921 generic.go:356] "Generic (PLEG): container finished" podID="1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4" containerID="c515c5ea98badf928aa8f8930050e04dd24e6bc0db763c1911e36dc3464ed265" exitCode=0
Oct 30 23:44:15.239306 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.239259    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf"
Oct 30 23:44:15.239306 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.239283    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf" event={"ID":"1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4","Type":"ContainerDied","Data":"c515c5ea98badf928aa8f8930050e04dd24e6bc0db763c1911e36dc3464ed265"}
Oct 30 23:44:15.239535 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.239338    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf" event={"ID":"1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4","Type":"ContainerDied","Data":"d52e11ee1df60a1e990c15f8eb078a8c8bea9f315df853fbc591b2584c68c5f2"}
Oct 30 23:44:15.239535 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.239366    4921 scope.go:122] "RemoveContainer" containerID="c515c5ea98badf928aa8f8930050e04dd24e6bc0db763c1911e36dc3464ed265"
Oct 30 23:44:15.250850 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.250827    4921 scope.go:122] "RemoveContainer" containerID="c515c5ea98badf928aa8f8930050e04dd24e6bc0db763c1911e36dc3464ed265"
Oct 30 23:44:15.251167 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:44:15.251141    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c515c5ea98badf928aa8f8930050e04dd24e6bc0db763c1911e36dc3464ed265\": container with ID starting with c515c5ea98badf928aa8f8930050e04dd24e6bc0db763c1911e36dc3464ed265 not found: ID does not exist" containerID="c515c5ea98badf928aa8f8930050e04dd24e6bc0db763c1911e36dc3464ed265"
Oct 30 23:44:15.251212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.251181    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c515c5ea98badf928aa8f8930050e04dd24e6bc0db763c1911e36dc3464ed265"} err="failed to get container status \"c515c5ea98badf928aa8f8930050e04dd24e6bc0db763c1911e36dc3464ed265\": rpc error: code = NotFound desc = could not find container \"c515c5ea98badf928aa8f8930050e04dd24e6bc0db763c1911e36dc3464ed265\": container with ID starting with c515c5ea98badf928aa8f8930050e04dd24e6bc0db763c1911e36dc3464ed265 not found: ID does not exist"
Oct 30 23:44:15.323605 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.323566    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf"]
Oct 30 23:44:15.329373 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.329345    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d34ab3fd-f8c565c9f-288jf"]
Oct 30 23:44:15.432627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.430491    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-ghblg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 23:44:15.432627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.430545    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg" podUID="31f7fe08-e50d-4112-ad82-34d9d4ccf5c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 23:44:15.527814 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.527714    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-kr9zt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 23:44:15.535656 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.528121    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt" podUID="9b175126-9bea-4fd8-8139-7e392c602a9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 23:44:15.684618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:15.674375    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:16.094314 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:16.094271    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c" podUID="d7b6fff7-e212-41b7-817d-ebb838a75c16" containerName="payload-pre-processing" containerID="cri-o://456e9d88510fcc2d84f210140a5948d590e38e5814c9d50c6faa658a2227505a" gracePeriod=25
Oct 30 23:44:16.251279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:16.251251    4921 generic.go:356] "Generic (PLEG): container finished" podID="d7b6fff7-e212-41b7-817d-ebb838a75c16" containerID="456e9d88510fcc2d84f210140a5948d590e38e5814c9d50c6faa658a2227505a" exitCode=0
Oct 30 23:44:16.251279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:16.251281    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c" event={"ID":"d7b6fff7-e212-41b7-817d-ebb838a75c16","Type":"ContainerDied","Data":"456e9d88510fcc2d84f210140a5948d590e38e5814c9d50c6faa658a2227505a"}
Oct 30 23:44:16.289617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:16.286042    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:16.496608 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:16.495539    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-kr9zt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 23:44:16.496608 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:16.495628    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt" podUID="9b175126-9bea-4fd8-8139-7e392c602a9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 23:44:16.497655 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:16.497530    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:16.511625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:16.508377    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-ghblg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 23:44:16.511625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:16.508434    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg" podUID="31f7fe08-e50d-4112-ad82-34d9d4ccf5c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 23:44:16.859619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:16.855811    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c"
Oct 30 23:44:16.936766 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:16.929390    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d7b6fff7-e212-41b7-817d-ebb838a75c16-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7b6fff7-e212-41b7-817d-ebb838a75c16-plugins-config-volume\") pod \"d7b6fff7-e212-41b7-817d-ebb838a75c16\" (UID: \"d7b6fff7-e212-41b7-817d-ebb838a75c16\") "
Oct 30 23:44:16.936766 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:16.929836    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d7b6fff7-e212-41b7-817d-ebb838a75c16-kube-api-access-rvtfn\" (UniqueName: \"kubernetes.io/projected/d7b6fff7-e212-41b7-817d-ebb838a75c16-kube-api-access-rvtfn\") pod \"d7b6fff7-e212-41b7-817d-ebb838a75c16\" (UID: \"d7b6fff7-e212-41b7-817d-ebb838a75c16\") "
Oct 30 23:44:16.957698 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:16.941894    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7b6fff7-e212-41b7-817d-ebb838a75c16-kube-api-access-rvtfn" pod "d7b6fff7-e212-41b7-817d-ebb838a75c16" (UID: "d7b6fff7-e212-41b7-817d-ebb838a75c16"). InnerVolumeSpecName "kube-api-access-rvtfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:44:16.958110 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:16.958076    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7b6fff7-e212-41b7-817d-ebb838a75c16-plugins-config-volume" pod "d7b6fff7-e212-41b7-817d-ebb838a75c16" (UID: "d7b6fff7-e212-41b7-817d-ebb838a75c16"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:44:17.027621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:17.024008    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4" path="/var/lib/kubelet/pods/1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4/volumes"
Oct 30 23:44:17.052620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:17.052539    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvtfn\" (UniqueName: \"kubernetes.io/projected/d7b6fff7-e212-41b7-817d-ebb838a75c16-kube-api-access-rvtfn\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:17.052620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:17.052576    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7b6fff7-e212-41b7-817d-ebb838a75c16-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:17.303937 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:17.284952    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:17.413617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:17.413131    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-ghblg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 23:44:17.413617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:17.413189    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg" podUID="31f7fe08-e50d-4112-ad82-34d9d4ccf5c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 23:44:17.516615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:17.515283    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-kr9zt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 23:44:17.516615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:17.515345    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt" podUID="9b175126-9bea-4fd8-8139-7e392c602a9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 23:44:17.614856 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:17.605474    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c" event={"ID":"d7b6fff7-e212-41b7-817d-ebb838a75c16","Type":"ContainerDied","Data":"341a8592e9fc72e1b9e8431ea1221e2490b667ab1c9c85bdfb216079e0a6733f"}
Oct 30 23:44:17.614856 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:17.605552    4921 scope.go:122] "RemoveContainer" containerID="456e9d88510fcc2d84f210140a5948d590e38e5814c9d50c6faa658a2227505a"
Oct 30 23:44:17.614856 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:17.605728    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c"
Oct 30 23:44:17.735619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:17.732130    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c"]
Oct 30 23:44:17.817111 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:17.800650    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1dd98b91-86c754f59-x5r6c"]
Oct 30 23:44:17.997618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:17.996200    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:18.418619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:18.418380    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-ghblg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 23:44:18.418619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:18.418441    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg" podUID="31f7fe08-e50d-4112-ad82-34d9d4ccf5c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 23:44:18.503620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:18.502721    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-kr9zt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 23:44:18.503620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:18.502794    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt" podUID="9b175126-9bea-4fd8-8139-7e392c602a9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 23:44:18.640893 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:18.640861    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:18.876676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:18.874511    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:18.938619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:18.938198    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d7b6fff7-e212-41b7-817d-ebb838a75c16" path="/var/lib/kubelet/pods/d7b6fff7-e212-41b7-817d-ebb838a75c16/volumes"
Oct 30 23:44:19.092689 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.092653    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj"
Oct 30 23:44:19.095903 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.095782    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9"
Oct 30 23:44:19.103712 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.101273    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"]
Oct 30 23:44:19.103712 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.102952    4921 cpu_manager.go:414] "containerMap: removing container" podUID="d7b6fff7-e212-41b7-817d-ebb838a75c16" containerName="payload-pre-processing"
Oct 30 23:44:19.103712 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.102975    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d7b6fff7-e212-41b7-817d-ebb838a75c16" containerName="payload-pre-processing"
Oct 30 23:44:19.103712 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.103043    4921 cpu_manager.go:414] "containerMap: removing container" podUID="1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4" containerName="payload-pre-processing"
Oct 30 23:44:19.103712 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.103052    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4" containerName="payload-pre-processing"
Oct 30 23:44:19.103712 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.103348    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="d7b6fff7-e212-41b7-817d-ebb838a75c16" containerName="payload-pre-processing"
Oct 30 23:44:19.103712 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.103375    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="1b0cbff0-b9b7-4c35-9d2e-cab36c6206a4" containerName="payload-pre-processing"
Oct 30 23:44:19.112642 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.110931    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"
Oct 30 23:44:19.116888 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.116862    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-6cad1110-serving-cert\""
Oct 30 23:44:19.122066 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.122032    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"]
Oct 30 23:44:19.204163 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.204127    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkgxx\" (UniqueName: \"kubernetes.io/projected/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-kube-api-access-qkgxx\") pod \"maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5\" (UID: \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"
Oct 30 23:44:19.204361 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.204216    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-openshift-service-ca\") pod \"maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5\" (UID: \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"
Oct 30 23:44:19.204361 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.204245    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-maas-api-tls\") pod \"maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5\" (UID: \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"
Oct 30 23:44:19.204361 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.204334    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-metrics-certs\") pod \"maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5\" (UID: \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"
Oct 30 23:44:19.253486 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.253445    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:19.270514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.270481    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"]
Oct 30 23:44:19.276335 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.276309    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.293464 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.293437    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"]
Oct 30 23:44:19.307581 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.306714    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.307581 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.306889    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zglr5\" (UniqueName: \"kubernetes.io/projected/ad2dd69d-1500-464c-9da4-92351faa35e7-kube-api-access-zglr5\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.307581 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.306948    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.307581 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.307031    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkgxx\" (UniqueName: \"kubernetes.io/projected/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-kube-api-access-qkgxx\") pod \"maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5\" (UID: \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"
Oct 30 23:44:19.307581 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.307118    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-openshift-service-ca\") pod \"maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5\" (UID: \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"
Oct 30 23:44:19.307581 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.307144    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-maas-api-tls\") pod \"maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5\" (UID: \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"
Oct 30 23:44:19.307581 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.307230    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-metrics-certs\") pod \"maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5\" (UID: \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"
Oct 30 23:44:19.307581 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.307281    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.307581 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.307318    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.307581 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.307375    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.307581 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.307483    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad2dd69d-1500-464c-9da4-92351faa35e7-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.308842 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.308814    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-openshift-service-ca\") pod \"maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5\" (UID: \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"
Oct 30 23:44:19.314286 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.314220    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-maas-api-tls\") pod \"maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5\" (UID: \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"
Oct 30 23:44:19.376617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.376483    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkgxx\" (UniqueName: \"kubernetes.io/projected/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-kube-api-access-qkgxx\") pod \"maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5\" (UID: \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"
Oct 30 23:44:19.451678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.433113    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-ghblg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 23:44:19.529929 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.529887    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg" podUID="31f7fe08-e50d-4112-ad82-34d9d4ccf5c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 23:44:19.530226 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.523170    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:19.536490 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.496795    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.536845 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.536820    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zglr5\" (UniqueName: \"kubernetes.io/projected/ad2dd69d-1500-464c-9da4-92351faa35e7-kube-api-access-zglr5\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.558579 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.558540    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.559103 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.559078    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.559283 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.559266    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.559442 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.559425    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.559671 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.559649    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad2dd69d-1500-464c-9da4-92351faa35e7-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.586617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.570232    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.586617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.578768    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.586617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.526653    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-kr9zt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 23:44:19.586617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.578858    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt" podUID="9b175126-9bea-4fd8-8139-7e392c602a9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 23:44:19.592090 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.590879    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.601867 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.601836    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zglr5\" (UniqueName: \"kubernetes.io/projected/ad2dd69d-1500-464c-9da4-92351faa35e7-kube-api-access-zglr5\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.606731 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.606706    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.620553 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.620530    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad2dd69d-1500-464c-9da4-92351faa35e7-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.621287 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.621269    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-metrics-certs\") pod \"maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5\" (UID: \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"
Oct 30 23:44:19.625348 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.625314    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6555k\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:19.746837 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.746757    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"
Oct 30 23:44:19.941877 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:19.917411    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:20.184789 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:20.184741    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"]
Oct 30 23:44:20.334125 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:20.334089    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:20.418140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:20.413730    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-ghblg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 23:44:20.418140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:20.413801    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg" podUID="31f7fe08-e50d-4112-ad82-34d9d4ccf5c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 23:44:20.485392 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:20.485306    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:20.486755 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:20.486732    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-kr9zt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 23:44:20.486942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:20.486917    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt" podUID="9b175126-9bea-4fd8-8139-7e392c602a9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 23:44:20.631216 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:44:20.631180    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad2dd69d_1500_464c_9da4_92351faa35e7.slice/crio-dd4a08e7235d9db1f1b7c3e2c08a97c971bf3a7864a97f77e846a1c26f92cb3d WatchSource:0}: Error finding container dd4a08e7235d9db1f1b7c3e2c08a97c971bf3a7864a97f77e846a1c26f92cb3d: Status 404 returned error can't find the container with id dd4a08e7235d9db1f1b7c3e2c08a97c971bf3a7864a97f77e846a1c26f92cb3d
Oct 30 23:44:20.636163 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:20.636119    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:20.636277 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:20.636208    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:20.642557 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:20.642399    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"]
Oct 30 23:44:20.671854 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:20.671825    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5" event={"ID":"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0","Type":"ContainerStarted","Data":"ec0f8c863882ed1d58c6cd2adff6f9b21105d1ee76ff48dbac424647124ac3fa"}
Oct 30 23:44:20.674301 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:20.674267    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k" event={"ID":"ad2dd69d-1500-464c-9da4-92351faa35e7","Type":"ContainerStarted","Data":"dd4a08e7235d9db1f1b7c3e2c08a97c971bf3a7864a97f77e846a1c26f92cb3d"}
Oct 30 23:44:20.827522 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:20.816523    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:21.424182 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:21.424140    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-ghblg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 23:44:21.424419 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:21.424206    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg" podUID="31f7fe08-e50d-4112-ad82-34d9d4ccf5c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 23:44:21.486354 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:21.486316    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-kr9zt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 23:44:21.486536 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:21.486379    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt" podUID="9b175126-9bea-4fd8-8139-7e392c602a9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 23:44:21.768086 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:21.767994    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k" event={"ID":"ad2dd69d-1500-464c-9da4-92351faa35e7","Type":"ContainerStarted","Data":"fec8884d2fc86ad23d5bf2f161c9867cde1321bd7a9fcd6df32f4393b5fcca64"}
Oct 30 23:44:21.770911 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:21.770890    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:21.773555 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:21.773533    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5" event={"ID":"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0","Type":"ContainerStarted","Data":"88e40b8516e36864ec61094dfc2e821bacf24ab12b270b997a68745f682e7b04"}
Oct 30 23:44:21.774506 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:21.774487    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"
Oct 30 23:44:21.784547 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:21.784526    4921 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-6555k container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:44:21.785010 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:21.784991    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k" podUID="ad2dd69d-1500-464c-9da4-92351faa35e7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:44:21.816805 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:21.816614    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k" podStartSLOduration=2.816576237 podStartE2EDuration="2.816576237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:44:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:44:21.81435636 +0000 UTC m=+1521.059212130" watchObservedRunningTime="2026-10-30 23:44:21.816576237 +0000 UTC m=+1521.061432006"
Oct 30 23:44:21.832176 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:21.832130    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:22.067672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:22.067124    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:22.586355 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:22.575504    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:22.804563 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:22.804522    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 30 23:44:22.842984 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:22.841967    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5" podStartSLOduration=3.362951387 podStartE2EDuration="3.841953605s" totalImagesPullingTime="479.002218ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:44:21.854978299 +0000 UTC m=+1521.099834066" watchObservedRunningTime="2026-10-30 23:44:22.841953605 +0000 UTC m=+1522.086809417"
Oct 30 23:44:23.280319 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:23.280276    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:23.280821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:23.280784    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:23.281895 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:23.281874    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg"
Oct 30 23:44:23.483711 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:23.483678    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:23.484185 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:23.484163    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:23.484994 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:23.484976    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt"
Oct 30 23:44:23.642754 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:23.642727    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:24.679690 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:24.679641    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:25.313459 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:25.313427    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"]
Oct 30 23:44:25.314012 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:25.313716    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27" podUID="9ff6708a-f84c-410e-b74a-05743d11fe24" containerName="maas-api" containerID="cri-o://98736f49d341aefaef98605bf1f8a3d68099afc4b29013bcb7a65962abd1efcd" gracePeriod=30
Oct 30 23:44:25.402298 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:25.402272    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:25.417774 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:25.417744    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27" podUID="9ff6708a-f84c-410e-b74a-05743d11fe24" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.105:8443/health\": dial tcp 10.132.0.105:8443: connect: connection refused"
Oct 30 23:44:25.642842 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:25.593100    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:25.919034 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:25.916057    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:25.971660 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:25.958458    4921 generic.go:356] "Generic (PLEG): container finished" podID="9ff6708a-f84c-410e-b74a-05743d11fe24" containerID="98736f49d341aefaef98605bf1f8a3d68099afc4b29013bcb7a65962abd1efcd" exitCode=0
Oct 30 23:44:25.971660 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:25.958515    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27" event={"ID":"9ff6708a-f84c-410e-b74a-05743d11fe24","Type":"ContainerDied","Data":"98736f49d341aefaef98605bf1f8a3d68099afc4b29013bcb7a65962abd1efcd"}
Oct 30 23:44:25.990629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:25.986927    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"
Oct 30 23:44:26.104229 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:26.104198    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ff6708a-f84c-410e-b74a-05743d11fe24-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff6708a-f84c-410e-b74a-05743d11fe24-metrics-certs\") pod \"9ff6708a-f84c-410e-b74a-05743d11fe24\" (UID: \"9ff6708a-f84c-410e-b74a-05743d11fe24\") "
Oct 30 23:44:26.104432 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:26.104293    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ff6708a-f84c-410e-b74a-05743d11fe24-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff6708a-f84c-410e-b74a-05743d11fe24-maas-api-tls\") pod \"9ff6708a-f84c-410e-b74a-05743d11fe24\" (UID: \"9ff6708a-f84c-410e-b74a-05743d11fe24\") "
Oct 30 23:44:26.104432 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:26.104354    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9ff6708a-f84c-410e-b74a-05743d11fe24-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff6708a-f84c-410e-b74a-05743d11fe24-openshift-service-ca\") pod \"9ff6708a-f84c-410e-b74a-05743d11fe24\" (UID: \"9ff6708a-f84c-410e-b74a-05743d11fe24\") "
Oct 30 23:44:26.104432 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:26.104417    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ff6708a-f84c-410e-b74a-05743d11fe24-kube-api-access-zls2h\" (UniqueName: \"kubernetes.io/projected/9ff6708a-f84c-410e-b74a-05743d11fe24-kube-api-access-zls2h\") pod \"9ff6708a-f84c-410e-b74a-05743d11fe24\" (UID: \"9ff6708a-f84c-410e-b74a-05743d11fe24\") "
Oct 30 23:44:26.104864 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:26.104807    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ff6708a-f84c-410e-b74a-05743d11fe24-openshift-service-ca" pod "9ff6708a-f84c-410e-b74a-05743d11fe24" (UID: "9ff6708a-f84c-410e-b74a-05743d11fe24"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:44:26.105375 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:26.105353    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff6708a-f84c-410e-b74a-05743d11fe24-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:26.107856 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:26.107826    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff6708a-f84c-410e-b74a-05743d11fe24-kube-api-access-zls2h" pod "9ff6708a-f84c-410e-b74a-05743d11fe24" (UID: "9ff6708a-f84c-410e-b74a-05743d11fe24"). InnerVolumeSpecName "kube-api-access-zls2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:44:26.108582 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:26.108560    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ff6708a-f84c-410e-b74a-05743d11fe24-maas-api-tls" pod "9ff6708a-f84c-410e-b74a-05743d11fe24" (UID: "9ff6708a-f84c-410e-b74a-05743d11fe24"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:44:26.109015 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:26.108988    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ff6708a-f84c-410e-b74a-05743d11fe24-metrics-certs" pod "9ff6708a-f84c-410e-b74a-05743d11fe24" (UID: "9ff6708a-f84c-410e-b74a-05743d11fe24"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:44:26.174752 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:26.174645    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:26.211208 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:26.211161    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff6708a-f84c-410e-b74a-05743d11fe24-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:26.211208 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:26.211204    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zls2h\" (UniqueName: \"kubernetes.io/projected/9ff6708a-f84c-410e-b74a-05743d11fe24-kube-api-access-zls2h\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:26.211435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:26.211218    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff6708a-f84c-410e-b74a-05743d11fe24-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:26.735570 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:26.735527    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"]
Oct 30 23:44:26.735836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:26.735799    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf" podUID="43f51846-de5d-4bdf-aaac-bca0a6bc46da" containerName="istio-proxy" containerID="cri-o://29c1493995ab745efb1086280e5e83e37721f408c4d6bdc60887a0bb65f9cfad" gracePeriod=30
Oct 30 23:44:26.806270 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:26.806241    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:27.117664 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:27.116368    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27" event={"ID":"9ff6708a-f84c-410e-b74a-05743d11fe24","Type":"ContainerDied","Data":"9232af520d96fd76c2429aa938cb610d4607bc3b7f345ba84323bbe31ef6f672"}
Oct 30 23:44:27.117664 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:27.116445    4921 scope.go:122] "RemoveContainer" containerID="98736f49d341aefaef98605bf1f8a3d68099afc4b29013bcb7a65962abd1efcd"
Oct 30 23:44:27.117664 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:27.116629    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"
Oct 30 23:44:27.217688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:27.217641    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"]
Oct 30 23:44:27.229138 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:27.229108    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1dd98b91-6f49f95999-pgh27"]
Oct 30 23:44:27.445924 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:27.445885    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:27.808675 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:27.795644    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:27.976561 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:27.961018    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:28.961004 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:28.960965    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ff6708a-f84c-410e-b74a-05743d11fe24" path="/var/lib/kubelet/pods/9ff6708a-f84c-410e-b74a-05743d11fe24/volumes"
Oct 30 23:44:28.961555 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:28.961531    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"
Oct 30 23:44:29.067996 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:29.067962    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:29.241947 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:29.241750    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:30.448876 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:30.448813    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:31.694221 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:31.694184    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:32.108673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.108647    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:44:32.144081 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.144050    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-envoy\") pod \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") "
Oct 30 23:44:32.144279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.144238    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-data\") pod \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") "
Oct 30 23:44:32.144355 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.144301    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-workload-socket\") pod \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") "
Oct 30 23:44:32.144355 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.144345    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-workload-certs\") pod \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") "
Oct 30 23:44:32.144469 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.144382    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43f51846-de5d-4bdf-aaac-bca0a6bc46da-kube-api-access-pfxnd\" (UniqueName: \"kubernetes.io/projected/43f51846-de5d-4bdf-aaac-bca0a6bc46da-kube-api-access-pfxnd\") pod \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") "
Oct 30 23:44:32.144565 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.144515    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-data" pod "43f51846-de5d-4bdf-aaac-bca0a6bc46da" (UID: "43f51846-de5d-4bdf-aaac-bca0a6bc46da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:44:32.144744 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.144587    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-credential-socket\") pod \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") "
Oct 30 23:44:32.144842 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.144632    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-workload-socket" pod "43f51846-de5d-4bdf-aaac-bca0a6bc46da" (UID: "43f51846-de5d-4bdf-aaac-bca0a6bc46da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:44:32.144908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.144721    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-workload-certs" pod "43f51846-de5d-4bdf-aaac-bca0a6bc46da" (UID: "43f51846-de5d-4bdf-aaac-bca0a6bc46da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:44:32.144908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.144786    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-credential-socket" pod "43f51846-de5d-4bdf-aaac-bca0a6bc46da" (UID: "43f51846-de5d-4bdf-aaac-bca0a6bc46da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:44:32.144908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.144824    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-token\" (UniqueName: \"kubernetes.io/projected/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-token\") pod \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") "
Oct 30 23:44:32.144908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.144899    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-podinfo\") pod \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") "
Oct 30 23:44:32.145281 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.144935    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istiod-ca-cert\") pod \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\" (UID: \"43f51846-de5d-4bdf-aaac-bca0a6bc46da\") "
Oct 30 23:44:32.145541 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.145515    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istiod-ca-cert" pod "43f51846-de5d-4bdf-aaac-bca0a6bc46da" (UID: "43f51846-de5d-4bdf-aaac-bca0a6bc46da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:44:32.145925 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.145827    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:32.145925 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.145853    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:32.145925 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.145869    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:32.145925 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.145885    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:32.145925 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.145901    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:32.147454 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.147425    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-envoy" pod "43f51846-de5d-4bdf-aaac-bca0a6bc46da" (UID: "43f51846-de5d-4bdf-aaac-bca0a6bc46da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:44:32.147566 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.147472    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43f51846-de5d-4bdf-aaac-bca0a6bc46da-kube-api-access-pfxnd" pod "43f51846-de5d-4bdf-aaac-bca0a6bc46da" (UID: "43f51846-de5d-4bdf-aaac-bca0a6bc46da"). InnerVolumeSpecName "kube-api-access-pfxnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:44:32.147566 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.147504    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-token" pod "43f51846-de5d-4bdf-aaac-bca0a6bc46da" (UID: "43f51846-de5d-4bdf-aaac-bca0a6bc46da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:44:32.147703 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.147629    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-podinfo" pod "43f51846-de5d-4bdf-aaac-bca0a6bc46da" (UID: "43f51846-de5d-4bdf-aaac-bca0a6bc46da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:44:32.247827 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.247746    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:32.247827 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.247774    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:32.247827 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.247783    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43f51846-de5d-4bdf-aaac-bca0a6bc46da-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:32.247827 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.247795    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfxnd\" (UniqueName: \"kubernetes.io/projected/43f51846-de5d-4bdf-aaac-bca0a6bc46da-kube-api-access-pfxnd\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:32.300948 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.300911    4921 generic.go:356] "Generic (PLEG): container finished" podID="43f51846-de5d-4bdf-aaac-bca0a6bc46da" containerID="29c1493995ab745efb1086280e5e83e37721f408c4d6bdc60887a0bb65f9cfad" exitCode=0
Oct 30 23:44:32.301154 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.300966    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"
Oct 30 23:44:32.301154 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.301010    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf" event={"ID":"43f51846-de5d-4bdf-aaac-bca0a6bc46da","Type":"ContainerDied","Data":"29c1493995ab745efb1086280e5e83e37721f408c4d6bdc60887a0bb65f9cfad"}
Oct 30 23:44:32.301154 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.301062    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf" event={"ID":"43f51846-de5d-4bdf-aaac-bca0a6bc46da","Type":"ContainerDied","Data":"446c9fadaed2d3e21e79c3c1f46edba17be1395727ca6543c7b3907422a571c1"}
Oct 30 23:44:32.301154 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.301092    4921 scope.go:122] "RemoveContainer" containerID="29c1493995ab745efb1086280e5e83e37721f408c4d6bdc60887a0bb65f9cfad"
Oct 30 23:44:32.317390 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.317365    4921 scope.go:122] "RemoveContainer" containerID="29c1493995ab745efb1086280e5e83e37721f408c4d6bdc60887a0bb65f9cfad"
Oct 30 23:44:32.317741 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:44:32.317718    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29c1493995ab745efb1086280e5e83e37721f408c4d6bdc60887a0bb65f9cfad\": container with ID starting with 29c1493995ab745efb1086280e5e83e37721f408c4d6bdc60887a0bb65f9cfad not found: ID does not exist" containerID="29c1493995ab745efb1086280e5e83e37721f408c4d6bdc60887a0bb65f9cfad"
Oct 30 23:44:32.317815 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.317747    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29c1493995ab745efb1086280e5e83e37721f408c4d6bdc60887a0bb65f9cfad"} err="failed to get container status \"29c1493995ab745efb1086280e5e83e37721f408c4d6bdc60887a0bb65f9cfad\": rpc error: code = NotFound desc = could not find container \"29c1493995ab745efb1086280e5e83e37721f408c4d6bdc60887a0bb65f9cfad\": container with ID starting with 29c1493995ab745efb1086280e5e83e37721f408c4d6bdc60887a0bb65f9cfad not found: ID does not exist"
Oct 30 23:44:32.328575 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.328550    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"]
Oct 30 23:44:32.332708 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.332685    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1dd98b91-openshift-default-646748464f-q4ntf"]
Oct 30 23:44:32.793573 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.793535    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:33.044180 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:32.960158    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:33.115419 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:33.115369    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="43f51846-de5d-4bdf-aaac-bca0a6bc46da" path="/var/lib/kubelet/pods/43f51846-de5d-4bdf-aaac-bca0a6bc46da/volumes"
Oct 30 23:44:34.240633 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:34.240579    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:35.331891 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:35.331835    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:36.316630 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:36.309904    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:37.145111 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:37.145078    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:37.843612 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:37.843556    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:38.619621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:38.619556    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:39.326774 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:39.326736    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:40.021030 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:40.020948    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:40.508775 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:40.508739    4921 generic.go:356] "Generic (PLEG): container finished" podID="186ab5a2-2953-437c-b1a2-b883c1a32dca" containerID="1dbc3746cd5d761b6a241c6cabfce113f33d7da3a3333499c5b76099e6f4065d" exitCode=0
Oct 30 23:44:40.509073 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:40.509050    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9" event={"ID":"186ab5a2-2953-437c-b1a2-b883c1a32dca","Type":"ContainerDied","Data":"1dbc3746cd5d761b6a241c6cabfce113f33d7da3a3333499c5b76099e6f4065d"}
Oct 30 23:44:40.509852 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:40.509829    4921 scope.go:122] "RemoveContainer" containerID="1dbc3746cd5d761b6a241c6cabfce113f33d7da3a3333499c5b76099e6f4065d"
Oct 30 23:44:40.519638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:40.515579    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:40.531617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:40.521273    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:40.531963 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:40.531924    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:44:41.334459 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:41.334420    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:41.618671 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:41.594337    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9" event={"ID":"186ab5a2-2953-437c-b1a2-b883c1a32dca","Type":"ContainerStarted","Data":"8eddc99eb967172fe760eff7c191adce43c25b399c7b406b688ff7604253a091"}
Oct 30 23:44:41.618671 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:41.615786    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:44:41.618671 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:41.615898    4921 patch_prober.go:29] interesting pod/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 23:44:41.618671 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:41.615941    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9" podUID="186ab5a2-2953-437c-b1a2-b883c1a32dca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 23:44:41.745365 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:44:41.745318    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:44:41.985617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:41.985488    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:42.615806 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:42.615775    4921 patch_prober.go:29] interesting pod/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 23:44:42.616307 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:42.615840    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9" podUID="186ab5a2-2953-437c-b1a2-b883c1a32dca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 23:44:42.642586 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:42.642547    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:43.616438 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:43.616403    4921 patch_prober.go:29] interesting pod/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 23:44:43.616881 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:43.616462    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9" podUID="186ab5a2-2953-437c-b1a2-b883c1a32dca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 23:44:43.697405 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:43.697371    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:44.624235 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:44.624200    4921 patch_prober.go:29] interesting pod/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 23:44:44.624897 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:44.624853    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9" podUID="186ab5a2-2953-437c-b1a2-b883c1a32dca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 23:44:44.938853 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:44.905008    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:45.615833 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:45.615798    4921 patch_prober.go:29] interesting pod/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 23:44:45.616025 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:45.615855    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9" podUID="186ab5a2-2953-437c-b1a2-b883c1a32dca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 23:44:45.943772 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:45.943734    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:46.616189 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:46.616153    4921 patch_prober.go:29] interesting pod/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 23:44:46.616385 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:46.616207    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9" podUID="186ab5a2-2953-437c-b1a2-b883c1a32dca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 23:44:46.738366 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:46.738336    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:47.005475 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:47.005443    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:44:47.647618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:47.642977    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:47.651304 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:47.651267    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:44:47.675775 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:47.675745    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:44:48.549917 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:48.549872    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:49.191470 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:49.191423    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:49.345930 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:49.345890    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:50.089737 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:50.086499    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:50.828544 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:50.828508    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj"]
Oct 30 23:44:50.842814 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:50.842779    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9"]
Oct 30 23:44:50.960271 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:50.960232    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:51.127674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:51.126963    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:51.749673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:51.749636    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:52.370215 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:52.370181    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:52.554619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:52.546938    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:53.129169 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:53.129137    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:53.647248 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:53.647212    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"]
Oct 30 23:44:53.647789 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:53.647530    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5" podUID="2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0" containerName="maas-api" containerID="cri-o://88e40b8516e36864ec61094dfc2e821bacf24ab12b270b997a68745f682e7b04" gracePeriod=30
Oct 30 23:44:53.662090 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:53.662056    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:53.839609 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:53.838285    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:53.864500 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:53.864454    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5" podUID="2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.111:8443/health\": dial tcp 10.132.0.111:8443: connect: connection refused"
Oct 30 23:44:54.007327 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.005701    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:54.044326 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.044257    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4"]
Oct 30 23:44:54.058669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.058499    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3818c7fb-dmbp4"]
Oct 30 23:44:54.208640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.205771    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:54.288535 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.276753    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"
Oct 30 23:44:54.358675 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.355555    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:54.376650 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.376389    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"]
Oct 30 23:44:54.376844 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.376654    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t" podUID="21ae1c1b-7826-48da-bb7a-21863aa658e6" containerName="istio-proxy" containerID="cri-o://e6dae0f46a0ee94223a9d0f6213f318c0ac9989409dac0b0f26812d4503a10d6" gracePeriod=30
Oct 30 23:44:54.483642 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.480302    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-kube-api-access-qkgxx\" (UniqueName: \"kubernetes.io/projected/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-kube-api-access-qkgxx\") pod \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\" (UID: \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\") "
Oct 30 23:44:54.483642 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.480434    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-maas-api-tls\") pod \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\" (UID: \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\") "
Oct 30 23:44:54.483642 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.480705    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-openshift-service-ca\") pod \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\" (UID: \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\") "
Oct 30 23:44:54.483642 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.480766    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-metrics-certs\") pod \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\" (UID: \"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0\") "
Oct 30 23:44:54.492624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.492234    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-maas-api-tls" pod "2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0" (UID: "2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:44:54.508620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.504047    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:54.508620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.505506    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-openshift-service-ca" pod "2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0" (UID: "2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:44:54.520826 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.517157    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:54.520826 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.517196    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:54.562537 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.562477    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-metrics-certs" pod "2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0" (UID: "2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:44:54.562972 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.562932    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-kube-api-access-qkgxx" pod "2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0" (UID: "2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0"). InnerVolumeSpecName "kube-api-access-qkgxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:44:54.630387 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.630314    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkgxx\" (UniqueName: \"kubernetes.io/projected/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-kube-api-access-qkgxx\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:54.630387 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.630353    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:54.806521 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.806436    4921 generic.go:356] "Generic (PLEG): container finished" podID="2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0" containerID="88e40b8516e36864ec61094dfc2e821bacf24ab12b270b997a68745f682e7b04" exitCode=0
Oct 30 23:44:54.807259 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.807231    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5" event={"ID":"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0","Type":"ContainerDied","Data":"88e40b8516e36864ec61094dfc2e821bacf24ab12b270b997a68745f682e7b04"}
Oct 30 23:44:54.807415 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.807397    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5" event={"ID":"2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0","Type":"ContainerDied","Data":"ec0f8c863882ed1d58c6cd2adff6f9b21105d1ee76ff48dbac424647124ac3fa"}
Oct 30 23:44:54.807664 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.807647    4921 scope.go:122] "RemoveContainer" containerID="88e40b8516e36864ec61094dfc2e821bacf24ab12b270b997a68745f682e7b04"
Oct 30 23:44:54.807984 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.807967    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"
Oct 30 23:44:54.836286 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.836267    4921 scope.go:122] "RemoveContainer" containerID="88e40b8516e36864ec61094dfc2e821bacf24ab12b270b997a68745f682e7b04"
Oct 30 23:44:54.838811 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:44:54.838781    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88e40b8516e36864ec61094dfc2e821bacf24ab12b270b997a68745f682e7b04\": container with ID starting with 88e40b8516e36864ec61094dfc2e821bacf24ab12b270b997a68745f682e7b04 not found: ID does not exist" containerID="88e40b8516e36864ec61094dfc2e821bacf24ab12b270b997a68745f682e7b04"
Oct 30 23:44:54.838944 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.838818    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88e40b8516e36864ec61094dfc2e821bacf24ab12b270b997a68745f682e7b04"} err="failed to get container status \"88e40b8516e36864ec61094dfc2e821bacf24ab12b270b997a68745f682e7b04\": rpc error: code = NotFound desc = could not find container \"88e40b8516e36864ec61094dfc2e821bacf24ab12b270b997a68745f682e7b04\": container with ID starting with 88e40b8516e36864ec61094dfc2e821bacf24ab12b270b997a68745f682e7b04 not found: ID does not exist"
Oct 30 23:44:54.851122 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.851080    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"]
Oct 30 23:44:54.857534 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.857508    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6cad1110-56fd87bfff-4qjq5"]
Oct 30 23:44:54.886025 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.885995    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0" path="/var/lib/kubelet/pods/2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0/volumes"
Oct 30 23:44:54.886833 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:54.886811    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="75e8f197-3170-4261-8454-f6bab23c0152" path="/var/lib/kubelet/pods/75e8f197-3170-4261-8454-f6bab23c0152/volumes"
Oct 30 23:44:55.256481 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:55.243383    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:55.605723 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:55.605640    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:55.771623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:55.764109    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:55.842618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:55.841752    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj" podUID="c9dac6af-3e9a-4aa4-9849-68a96eee0791" containerName="payload-processing" containerID="cri-o://3f9c3fe7424bd2d33331f66ce0736133cd6b06b3f297f08c43e7748486667a4f" gracePeriod=25
Oct 30 23:44:55.846614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:55.844524    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9" podUID="45557842-4e1c-4a7d-b6f1-bb1a9080503f" containerName="payload-pre-processing" containerID="cri-o://57af1844cd9f17a48d715a2bf84f4b5170dfd9168668e849c5271409adf7ffe4" gracePeriod=25
Oct 30 23:44:56.339076 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.339046    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj"
Oct 30 23:44:56.377085 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.373130    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:56.377085 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.373210    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c9dac6af-3e9a-4aa4-9849-68a96eee0791-kube-api-access-2h2ts\" (UniqueName: \"kubernetes.io/projected/c9dac6af-3e9a-4aa4-9849-68a96eee0791-kube-api-access-2h2ts\") pod \"c9dac6af-3e9a-4aa4-9849-68a96eee0791\" (UID: \"c9dac6af-3e9a-4aa4-9849-68a96eee0791\") "
Oct 30 23:44:56.377085 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.373336    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c9dac6af-3e9a-4aa4-9849-68a96eee0791-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9dac6af-3e9a-4aa4-9849-68a96eee0791-plugins-config-volume\") pod \"c9dac6af-3e9a-4aa4-9849-68a96eee0791\" (UID: \"c9dac6af-3e9a-4aa4-9849-68a96eee0791\") "
Oct 30 23:44:56.377085 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.375524    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9dac6af-3e9a-4aa4-9849-68a96eee0791-plugins-config-volume" pod "c9dac6af-3e9a-4aa4-9849-68a96eee0791" (UID: "c9dac6af-3e9a-4aa4-9849-68a96eee0791"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:44:56.426340 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.425836    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9dac6af-3e9a-4aa4-9849-68a96eee0791-kube-api-access-2h2ts" pod "c9dac6af-3e9a-4aa4-9849-68a96eee0791" (UID: "c9dac6af-3e9a-4aa4-9849-68a96eee0791"). InnerVolumeSpecName "kube-api-access-2h2ts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:44:56.448790 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.448751    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9"
Oct 30 23:44:56.484836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.484807    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/45557842-4e1c-4a7d-b6f1-bb1a9080503f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45557842-4e1c-4a7d-b6f1-bb1a9080503f-plugins-config-volume\") pod \"45557842-4e1c-4a7d-b6f1-bb1a9080503f\" (UID: \"45557842-4e1c-4a7d-b6f1-bb1a9080503f\") "
Oct 30 23:44:56.485307 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.485278    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45557842-4e1c-4a7d-b6f1-bb1a9080503f-plugins-config-volume" pod "45557842-4e1c-4a7d-b6f1-bb1a9080503f" (UID: "45557842-4e1c-4a7d-b6f1-bb1a9080503f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:44:56.485549 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.485518    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45557842-4e1c-4a7d-b6f1-bb1a9080503f-kube-api-access-snqsf\" (UniqueName: \"kubernetes.io/projected/45557842-4e1c-4a7d-b6f1-bb1a9080503f-kube-api-access-snqsf\") pod \"45557842-4e1c-4a7d-b6f1-bb1a9080503f\" (UID: \"45557842-4e1c-4a7d-b6f1-bb1a9080503f\") "
Oct 30 23:44:56.486947 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.486911    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45557842-4e1c-4a7d-b6f1-bb1a9080503f-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:56.487091 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.487072    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h2ts\" (UniqueName: \"kubernetes.io/projected/c9dac6af-3e9a-4aa4-9849-68a96eee0791-kube-api-access-2h2ts\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:56.487200 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.487096    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9dac6af-3e9a-4aa4-9849-68a96eee0791-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:56.505679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.489472    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45557842-4e1c-4a7d-b6f1-bb1a9080503f-kube-api-access-snqsf" pod "45557842-4e1c-4a7d-b6f1-bb1a9080503f" (UID: "45557842-4e1c-4a7d-b6f1-bb1a9080503f"). InnerVolumeSpecName "kube-api-access-snqsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:44:56.588737 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.588700    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snqsf\" (UniqueName: \"kubernetes.io/projected/45557842-4e1c-4a7d-b6f1-bb1a9080503f-kube-api-access-snqsf\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:44:56.965077 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.965045    4921 generic.go:356] "Generic (PLEG): container finished" podID="c9dac6af-3e9a-4aa4-9849-68a96eee0791" containerID="3f9c3fe7424bd2d33331f66ce0736133cd6b06b3f297f08c43e7748486667a4f" exitCode=0
Oct 30 23:44:56.965509 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.965091    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj"
Oct 30 23:44:56.965509 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.965123    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj" event={"ID":"c9dac6af-3e9a-4aa4-9849-68a96eee0791","Type":"ContainerDied","Data":"3f9c3fe7424bd2d33331f66ce0736133cd6b06b3f297f08c43e7748486667a4f"}
Oct 30 23:44:56.965509 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.965178    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj" event={"ID":"c9dac6af-3e9a-4aa4-9849-68a96eee0791","Type":"ContainerDied","Data":"c9195131d43e3917b2a2cfb64b0008774908d99266bccf75ef5e821d5792faa7"}
Oct 30 23:44:56.965509 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.965208    4921 scope.go:122] "RemoveContainer" containerID="3f9c3fe7424bd2d33331f66ce0736133cd6b06b3f297f08c43e7748486667a4f"
Oct 30 23:44:56.966622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.966575    4921 generic.go:356] "Generic (PLEG): container finished" podID="45557842-4e1c-4a7d-b6f1-bb1a9080503f" containerID="57af1844cd9f17a48d715a2bf84f4b5170dfd9168668e849c5271409adf7ffe4" exitCode=0
Oct 30 23:44:56.966803 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.966788    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9" event={"ID":"45557842-4e1c-4a7d-b6f1-bb1a9080503f","Type":"ContainerDied","Data":"57af1844cd9f17a48d715a2bf84f4b5170dfd9168668e849c5271409adf7ffe4"}
Oct 30 23:44:56.966856 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.966831    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9" event={"ID":"45557842-4e1c-4a7d-b6f1-bb1a9080503f","Type":"ContainerDied","Data":"8d5e6c2115693458c951fabf3648a1b63418d9372512e36881d962fee48bbda6"}
Oct 30 23:44:56.966914 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.966897    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9"
Oct 30 23:44:56.978916 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.978881    4921 scope.go:122] "RemoveContainer" containerID="3f9c3fe7424bd2d33331f66ce0736133cd6b06b3f297f08c43e7748486667a4f"
Oct 30 23:44:56.979236 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:44:56.979215    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f9c3fe7424bd2d33331f66ce0736133cd6b06b3f297f08c43e7748486667a4f\": container with ID starting with 3f9c3fe7424bd2d33331f66ce0736133cd6b06b3f297f08c43e7748486667a4f not found: ID does not exist" containerID="3f9c3fe7424bd2d33331f66ce0736133cd6b06b3f297f08c43e7748486667a4f"
Oct 30 23:44:56.979321 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.979242    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f9c3fe7424bd2d33331f66ce0736133cd6b06b3f297f08c43e7748486667a4f"} err="failed to get container status \"3f9c3fe7424bd2d33331f66ce0736133cd6b06b3f297f08c43e7748486667a4f\": rpc error: code = NotFound desc = could not find container \"3f9c3fe7424bd2d33331f66ce0736133cd6b06b3f297f08c43e7748486667a4f\": container with ID starting with 3f9c3fe7424bd2d33331f66ce0736133cd6b06b3f297f08c43e7748486667a4f not found: ID does not exist"
Oct 30 23:44:56.979321 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.979258    4921 scope.go:122] "RemoveContainer" containerID="57af1844cd9f17a48d715a2bf84f4b5170dfd9168668e849c5271409adf7ffe4"
Oct 30 23:44:56.989780 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.989751    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9"]
Oct 30 23:44:56.990257 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.990236    4921 scope.go:122] "RemoveContainer" containerID="57af1844cd9f17a48d715a2bf84f4b5170dfd9168668e849c5271409adf7ffe4"
Oct 30 23:44:56.990580 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:44:56.990562    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57af1844cd9f17a48d715a2bf84f4b5170dfd9168668e849c5271409adf7ffe4\": container with ID starting with 57af1844cd9f17a48d715a2bf84f4b5170dfd9168668e849c5271409adf7ffe4 not found: ID does not exist" containerID="57af1844cd9f17a48d715a2bf84f4b5170dfd9168668e849c5271409adf7ffe4"
Oct 30 23:44:56.990745 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.990586    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57af1844cd9f17a48d715a2bf84f4b5170dfd9168668e849c5271409adf7ffe4"} err="failed to get container status \"57af1844cd9f17a48d715a2bf84f4b5170dfd9168668e849c5271409adf7ffe4\": rpc error: code = NotFound desc = could not find container \"57af1844cd9f17a48d715a2bf84f4b5170dfd9168668e849c5271409adf7ffe4\": container with ID starting with 57af1844cd9f17a48d715a2bf84f4b5170dfd9168668e849c5271409adf7ffe4 not found: ID does not exist"
Oct 30 23:44:56.996880 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:56.996860    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6cad1110-5887c99ff5-w9cg9"]
Oct 30 23:44:57.007930 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:57.007910    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj"]
Oct 30 23:44:57.014819 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:57.014799    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6cad1110-5dbf448699-wgxzj"]
Oct 30 23:44:57.152006 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:57.151912    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:57.847236 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:57.847206    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:58.602504 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:58.602469    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:44:58.885205 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:58.885177    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="45557842-4e1c-4a7d-b6f1-bb1a9080503f" path="/var/lib/kubelet/pods/45557842-4e1c-4a7d-b6f1-bb1a9080503f/volumes"
Oct 30 23:44:58.885716 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:58.885695    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c9dac6af-3e9a-4aa4-9849-68a96eee0791" path="/var/lib/kubelet/pods/c9dac6af-3e9a-4aa4-9849-68a96eee0791/volumes"
Oct 30 23:44:59.271496 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:44:59.271390    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:00.021822 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.021791    4921 generic.go:356] "Generic (PLEG): container finished" podID="21ae1c1b-7826-48da-bb7a-21863aa658e6" containerID="e6dae0f46a0ee94223a9d0f6213f318c0ac9989409dac0b0f26812d4503a10d6" exitCode=0
Oct 30 23:45:00.022288 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.021900    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t" event={"ID":"21ae1c1b-7826-48da-bb7a-21863aa658e6","Type":"ContainerDied","Data":"e6dae0f46a0ee94223a9d0f6213f318c0ac9989409dac0b0f26812d4503a10d6"}
Oct 30 23:45:00.120630 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.101644    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:00.237901 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.237872    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg"]
Oct 30 23:45:00.241060 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.241027    4921 cpu_manager.go:414] "containerMap: removing container" podUID="45557842-4e1c-4a7d-b6f1-bb1a9080503f" containerName="payload-pre-processing"
Oct 30 23:45:00.241060 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.241059    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45557842-4e1c-4a7d-b6f1-bb1a9080503f" containerName="payload-pre-processing"
Oct 30 23:45:00.241257 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.241080    4921 cpu_manager.go:414] "containerMap: removing container" podUID="9ff6708a-f84c-410e-b74a-05743d11fe24" containerName="maas-api"
Oct 30 23:45:00.241257 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.241088    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ff6708a-f84c-410e-b74a-05743d11fe24" containerName="maas-api"
Oct 30 23:45:00.241257 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.241140    4921 cpu_manager.go:414] "containerMap: removing container" podUID="43f51846-de5d-4bdf-aaac-bca0a6bc46da" containerName="istio-proxy"
Oct 30 23:45:00.241409 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.241378    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43f51846-de5d-4bdf-aaac-bca0a6bc46da" containerName="istio-proxy"
Oct 30 23:45:00.241527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.241432    4921 cpu_manager.go:414] "containerMap: removing container" podUID="2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0" containerName="maas-api"
Oct 30 23:45:00.241527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.241440    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0" containerName="maas-api"
Oct 30 23:45:00.241527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.241489    4921 cpu_manager.go:414] "containerMap: removing container" podUID="c9dac6af-3e9a-4aa4-9849-68a96eee0791" containerName="payload-processing"
Oct 30 23:45:00.241527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.241496    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c9dac6af-3e9a-4aa4-9849-68a96eee0791" containerName="payload-processing"
Oct 30 23:45:00.241770 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.241709    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="c9dac6af-3e9a-4aa4-9849-68a96eee0791" containerName="payload-processing"
Oct 30 23:45:00.241770 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.241727    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="45557842-4e1c-4a7d-b6f1-bb1a9080503f" containerName="payload-pre-processing"
Oct 30 23:45:00.241770 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.241738    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ff6708a-f84c-410e-b74a-05743d11fe24" containerName="maas-api"
Oct 30 23:45:00.241770 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.241756    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="43f51846-de5d-4bdf-aaac-bca0a6bc46da" containerName="istio-proxy"
Oct 30 23:45:00.241770 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.241771    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="2c3d3c85-4620-4026-9a3c-c1bf6b7cfcd0" containerName="maas-api"
Oct 30 23:45:00.246326 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.246306    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg"
Oct 30 23:45:00.246635 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.246584    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:45:00.248820 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.247062    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg"]
Oct 30 23:45:00.254787 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.254766    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f"]
Oct 30 23:45:00.255926 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.255906    4921 cpu_manager.go:414] "containerMap: removing container" podUID="21ae1c1b-7826-48da-bb7a-21863aa658e6" containerName="istio-proxy"
Oct 30 23:45:00.256053 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.256041    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="21ae1c1b-7826-48da-bb7a-21863aa658e6" containerName="istio-proxy"
Oct 30 23:45:00.256342 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.256329    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="21ae1c1b-7826-48da-bb7a-21863aa658e6" containerName="istio-proxy"
Oct 30 23:45:00.264654 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.264634    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2"]
Oct 30 23:45:00.268177 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.268160    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f"
Oct 30 23:45:00.273469 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.272835    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f"]
Oct 30 23:45:00.273469 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.272935    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2"
Oct 30 23:45:00.273749 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.273729    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2"]
Oct 30 23:45:00.297947 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.297926    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bmrd2\""
Oct 30 23:45:00.318503 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.318473    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-token\" (UniqueName: \"kubernetes.io/projected/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-token\") pod \"21ae1c1b-7826-48da-bb7a-21863aa658e6\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") "
Oct 30 23:45:00.318684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.318544    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/21ae1c1b-7826-48da-bb7a-21863aa658e6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21ae1c1b-7826-48da-bb7a-21863aa658e6-istiod-ca-cert\") pod \"21ae1c1b-7826-48da-bb7a-21863aa658e6\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") "
Oct 30 23:45:00.318684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.318584    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-workload-certs\") pod \"21ae1c1b-7826-48da-bb7a-21863aa658e6\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") "
Oct 30 23:45:00.318684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.318651    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-credential-socket\") pod \"21ae1c1b-7826-48da-bb7a-21863aa658e6\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") "
Oct 30 23:45:00.318883 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.318726    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-workload-socket\") pod \"21ae1c1b-7826-48da-bb7a-21863aa658e6\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") "
Oct 30 23:45:00.318883 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.318746    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-podinfo\") pod \"21ae1c1b-7826-48da-bb7a-21863aa658e6\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") "
Oct 30 23:45:00.318883 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.318770    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-envoy\") pod \"21ae1c1b-7826-48da-bb7a-21863aa658e6\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") "
Oct 30 23:45:00.318883 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.318801    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/21ae1c1b-7826-48da-bb7a-21863aa658e6-kube-api-access-48vdn\" (UniqueName: \"kubernetes.io/projected/21ae1c1b-7826-48da-bb7a-21863aa658e6-kube-api-access-48vdn\") pod \"21ae1c1b-7826-48da-bb7a-21863aa658e6\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") "
Oct 30 23:45:00.318883 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.318850    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-data\") pod \"21ae1c1b-7826-48da-bb7a-21863aa658e6\" (UID: \"21ae1c1b-7826-48da-bb7a-21863aa658e6\") "
Oct 30 23:45:00.319158 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.319094    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc4sq\" (UniqueName: \"kubernetes.io/projected/59eb5777-0d57-4a60-8e83-692d5b7a4b62-kube-api-access-dc4sq\") pod \"maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg\" (UID: \"59eb5777-0d57-4a60-8e83-692d5b7a4b62\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg"
Oct 30 23:45:00.319280 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.319257    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59eb5777-0d57-4a60-8e83-692d5b7a4b62-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg\" (UID: \"59eb5777-0d57-4a60-8e83-692d5b7a4b62\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg"
Oct 30 23:45:00.319352 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.319292    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-workload-socket" pod "21ae1c1b-7826-48da-bb7a-21863aa658e6" (UID: "21ae1c1b-7826-48da-bb7a-21863aa658e6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:45:00.319638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.319614    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21ae1c1b-7826-48da-bb7a-21863aa658e6-istiod-ca-cert" pod "21ae1c1b-7826-48da-bb7a-21863aa658e6" (UID: "21ae1c1b-7826-48da-bb7a-21863aa658e6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:45:00.319758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.319737    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qskf7\" (UniqueName: \"kubernetes.io/projected/367f9225-5b26-41ee-9eeb-bcdd9b667439-kube-api-access-qskf7\") pod \"maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f\" (UID: \"367f9225-5b26-41ee-9eeb-bcdd9b667439\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f"
Oct 30 23:45:00.319825 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.319807    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/367f9225-5b26-41ee-9eeb-bcdd9b667439-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f\" (UID: \"367f9225-5b26-41ee-9eeb-bcdd9b667439\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f"
Oct 30 23:45:00.320030 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.320010    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21ae1c1b-7826-48da-bb7a-21863aa658e6-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:45:00.320140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.320033    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:45:00.320381 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.320344    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-workload-certs" pod "21ae1c1b-7826-48da-bb7a-21863aa658e6" (UID: "21ae1c1b-7826-48da-bb7a-21863aa658e6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:45:00.320563 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.320543    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-credential-socket" pod "21ae1c1b-7826-48da-bb7a-21863aa658e6" (UID: "21ae1c1b-7826-48da-bb7a-21863aa658e6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:45:00.320796 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.320774    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-data" pod "21ae1c1b-7826-48da-bb7a-21863aa658e6" (UID: "21ae1c1b-7826-48da-bb7a-21863aa658e6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:45:00.322548 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.322521    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-podinfo" pod "21ae1c1b-7826-48da-bb7a-21863aa658e6" (UID: "21ae1c1b-7826-48da-bb7a-21863aa658e6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:45:00.322661 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.322566    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-token" pod "21ae1c1b-7826-48da-bb7a-21863aa658e6" (UID: "21ae1c1b-7826-48da-bb7a-21863aa658e6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:45:00.323205 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.323176    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-envoy" pod "21ae1c1b-7826-48da-bb7a-21863aa658e6" (UID: "21ae1c1b-7826-48da-bb7a-21863aa658e6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:45:00.324400 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.324360    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21ae1c1b-7826-48da-bb7a-21863aa658e6-kube-api-access-48vdn" pod "21ae1c1b-7826-48da-bb7a-21863aa658e6" (UID: "21ae1c1b-7826-48da-bb7a-21863aa658e6"). InnerVolumeSpecName "kube-api-access-48vdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:45:00.382364 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.382318    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:00.421205 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.421174    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qskf7\" (UniqueName: \"kubernetes.io/projected/367f9225-5b26-41ee-9eeb-bcdd9b667439-kube-api-access-qskf7\") pod \"maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f\" (UID: \"367f9225-5b26-41ee-9eeb-bcdd9b667439\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f"
Oct 30 23:45:00.421388 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.421227    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/367f9225-5b26-41ee-9eeb-bcdd9b667439-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f\" (UID: \"367f9225-5b26-41ee-9eeb-bcdd9b667439\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f"
Oct 30 23:45:00.421388 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.421314    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlzmc\" (UniqueName: \"kubernetes.io/projected/103409fa-7294-4741-8d40-786f667499b3-kube-api-access-jlzmc\") pod \"maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2\" (UID: \"103409fa-7294-4741-8d40-786f667499b3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2"
Oct 30 23:45:00.421388 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.421355    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc4sq\" (UniqueName: \"kubernetes.io/projected/59eb5777-0d57-4a60-8e83-692d5b7a4b62-kube-api-access-dc4sq\") pod \"maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg\" (UID: \"59eb5777-0d57-4a60-8e83-692d5b7a4b62\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg"
Oct 30 23:45:00.421553 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.421456    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/103409fa-7294-4741-8d40-786f667499b3-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2\" (UID: \"103409fa-7294-4741-8d40-786f667499b3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2"
Oct 30 23:45:00.421553 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.421516    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59eb5777-0d57-4a60-8e83-692d5b7a4b62-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg\" (UID: \"59eb5777-0d57-4a60-8e83-692d5b7a4b62\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg"
Oct 30 23:45:00.422032 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.422008    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:45:00.422108 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.422038    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:45:00.422108 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.422053    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/367f9225-5b26-41ee-9eeb-bcdd9b667439-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f\" (UID: \"367f9225-5b26-41ee-9eeb-bcdd9b667439\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f"
Oct 30 23:45:00.422108 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.422055    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48vdn\" (UniqueName: \"kubernetes.io/projected/21ae1c1b-7826-48da-bb7a-21863aa658e6-kube-api-access-48vdn\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:45:00.422108 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.422102    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:45:00.422313 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.422114    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21ae1c1b-7826-48da-bb7a-21863aa658e6-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:45:00.422313 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.422123    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:45:00.422313 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.422132    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ae1c1b-7826-48da-bb7a-21863aa658e6-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:45:00.422313 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.422208    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59eb5777-0d57-4a60-8e83-692d5b7a4b62-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg\" (UID: \"59eb5777-0d57-4a60-8e83-692d5b7a4b62\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg"
Oct 30 23:45:00.437407 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.437350    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qskf7\" (UniqueName: \"kubernetes.io/projected/367f9225-5b26-41ee-9eeb-bcdd9b667439-kube-api-access-qskf7\") pod \"maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f\" (UID: \"367f9225-5b26-41ee-9eeb-bcdd9b667439\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f"
Oct 30 23:45:00.437407 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.437402    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc4sq\" (UniqueName: \"kubernetes.io/projected/59eb5777-0d57-4a60-8e83-692d5b7a4b62-kube-api-access-dc4sq\") pod \"maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg\" (UID: \"59eb5777-0d57-4a60-8e83-692d5b7a4b62\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg"
Oct 30 23:45:00.523382 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.523345    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlzmc\" (UniqueName: \"kubernetes.io/projected/103409fa-7294-4741-8d40-786f667499b3-kube-api-access-jlzmc\") pod \"maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2\" (UID: \"103409fa-7294-4741-8d40-786f667499b3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2"
Oct 30 23:45:00.523577 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.523448    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/103409fa-7294-4741-8d40-786f667499b3-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2\" (UID: \"103409fa-7294-4741-8d40-786f667499b3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2"
Oct 30 23:45:00.524263 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.524227    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/103409fa-7294-4741-8d40-786f667499b3-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2\" (UID: \"103409fa-7294-4741-8d40-786f667499b3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2"
Oct 30 23:45:00.536174 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.536149    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlzmc\" (UniqueName: \"kubernetes.io/projected/103409fa-7294-4741-8d40-786f667499b3-kube-api-access-jlzmc\") pod \"maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2\" (UID: \"103409fa-7294-4741-8d40-786f667499b3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2"
Oct 30 23:45:00.567086 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.567055    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg"
Oct 30 23:45:00.590538 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.590511    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f"
Oct 30 23:45:00.595575 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.595550    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2"
Oct 30 23:45:00.859573 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.859535    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg"]
Oct 30 23:45:00.859781 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:45:00.859759    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59eb5777_0d57_4a60_8e83_692d5b7a4b62.slice/crio-b3b27d1b7b5a69de496f3b102212c4dd85bf8920085b093d97e02fbe1d24942f WatchSource:0}: Error finding container b3b27d1b7b5a69de496f3b102212c4dd85bf8920085b093d97e02fbe1d24942f: Status 404 returned error can't find the container with id b3b27d1b7b5a69de496f3b102212c4dd85bf8920085b093d97e02fbe1d24942f
Oct 30 23:45:00.897090 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.897065    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f"]
Oct 30 23:45:00.902190 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:45:00.902157    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod367f9225_5b26_41ee_9eeb_bcdd9b667439.slice/crio-28f812a1a0cb7c6ac13eec950646e20143680da7a39d7a63c378fd9fd342a349 WatchSource:0}: Error finding container 28f812a1a0cb7c6ac13eec950646e20143680da7a39d7a63c378fd9fd342a349: Status 404 returned error can't find the container with id 28f812a1a0cb7c6ac13eec950646e20143680da7a39d7a63c378fd9fd342a349
Oct 30 23:45:00.918971 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:00.918944    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2"]
Oct 30 23:45:01.031746 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:01.031705    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg" event={"ID":"59eb5777-0d57-4a60-8e83-692d5b7a4b62","Type":"ContainerStarted","Data":"b3b27d1b7b5a69de496f3b102212c4dd85bf8920085b093d97e02fbe1d24942f"}
Oct 30 23:45:01.033490 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:01.033430    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f" event={"ID":"367f9225-5b26-41ee-9eeb-bcdd9b667439","Type":"ContainerStarted","Data":"28f812a1a0cb7c6ac13eec950646e20143680da7a39d7a63c378fd9fd342a349"}
Oct 30 23:45:01.035037 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:01.035007    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t" event={"ID":"21ae1c1b-7826-48da-bb7a-21863aa658e6","Type":"ContainerDied","Data":"ceeaf1949b1919309184e9cc07a4f16cb939bd191defc5de8bbe68d276b24a66"}
Oct 30 23:45:01.035167 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:01.035012    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"
Oct 30 23:45:01.035245 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:01.035061    4921 scope.go:122] "RemoveContainer" containerID="e6dae0f46a0ee94223a9d0f6213f318c0ac9989409dac0b0f26812d4503a10d6"
Oct 30 23:45:01.037009 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:01.036985    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2" event={"ID":"103409fa-7294-4741-8d40-786f667499b3","Type":"ContainerStarted","Data":"9794ab3939ff50d21bb82c261e5b0a6f2d890bcb912073c8024651a039a00685"}
Oct 30 23:45:01.079623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:01.065574    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:01.109965 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:01.109240    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"]
Oct 30 23:45:01.127619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:01.123106    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-6cad1110-gw-openshift-default-665d985b9-qhd5t"]
Oct 30 23:45:02.040669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:02.040365    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:02.719569 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:02.719517    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg" event={"ID":"59eb5777-0d57-4a60-8e83-692d5b7a4b62","Type":"ContainerStarted","Data":"75a00e14d70e0e325e8dc4c6a938ef3b7d2e469a9d3e34b8f098bace15c90a36"}
Oct 30 23:45:02.728646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:02.728613    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f" event={"ID":"367f9225-5b26-41ee-9eeb-bcdd9b667439","Type":"ContainerStarted","Data":"604fa6d39b192d83fea766405854df9bfcc2458b88bd5b1d18ec97c073da88e8"}
Oct 30 23:45:02.728875 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:02.724422    4921 scope.go:122] "RemoveContainer" containerID="75a00e14d70e0e325e8dc4c6a938ef3b7d2e469a9d3e34b8f098bace15c90a36"
Oct 30 23:45:02.746060 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:02.746024    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2" event={"ID":"103409fa-7294-4741-8d40-786f667499b3","Type":"ContainerStarted","Data":"5b259ffdb04db2abf417bfe86e26596ecea3e6b46dddf42f63d535eb52d8ffda"}
Oct 30 23:45:02.788616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:02.788021    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:02.800986 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:02.800930    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f" podStartSLOduration=2.800909821 podStartE2EDuration="2.800909821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:02.795520762 +0000 UTC m=+1562.040376531" watchObservedRunningTime="2026-10-30 23:45:02.800909821 +0000 UTC m=+1562.045765589"
Oct 30 23:45:02.853532 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:02.849105    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2" podStartSLOduration=2.849085784 podStartE2EDuration="2.849085784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:02.841013654 +0000 UTC m=+1562.085869425" watchObservedRunningTime="2026-10-30 23:45:02.849085784 +0000 UTC m=+1562.093941555"
Oct 30 23:45:02.900951 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:02.900903    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="21ae1c1b-7826-48da-bb7a-21863aa658e6" path="/var/lib/kubelet/pods/21ae1c1b-7826-48da-bb7a-21863aa658e6/volumes"
Oct 30 23:45:02.976538 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:02.976453    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:03.107852 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:03.107719    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:03.324747 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:03.306615    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:03.969056 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:03.968812    4921 generic.go:356] "Generic (PLEG): container finished" podID="103409fa-7294-4741-8d40-786f667499b3" containerID="5b259ffdb04db2abf417bfe86e26596ecea3e6b46dddf42f63d535eb52d8ffda" exitCode=60
Oct 30 23:45:03.969172 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:03.969082    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2" event={"ID":"103409fa-7294-4741-8d40-786f667499b3","Type":"ContainerDied","Data":"5b259ffdb04db2abf417bfe86e26596ecea3e6b46dddf42f63d535eb52d8ffda"}
Oct 30 23:45:03.971906 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:03.970212    4921 scope.go:122] "RemoveContainer" containerID="5b259ffdb04db2abf417bfe86e26596ecea3e6b46dddf42f63d535eb52d8ffda"
Oct 30 23:45:04.033842 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:04.026331    4921 generic.go:356] "Generic (PLEG): container finished" podID="59eb5777-0d57-4a60-8e83-692d5b7a4b62" containerID="75a00e14d70e0e325e8dc4c6a938ef3b7d2e469a9d3e34b8f098bace15c90a36" exitCode=60
Oct 30 23:45:04.033842 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:04.026535    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg" event={"ID":"59eb5777-0d57-4a60-8e83-692d5b7a4b62","Type":"ContainerDied","Data":"75a00e14d70e0e325e8dc4c6a938ef3b7d2e469a9d3e34b8f098bace15c90a36"}
Oct 30 23:45:04.033842 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:04.026636    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg" event={"ID":"59eb5777-0d57-4a60-8e83-692d5b7a4b62","Type":"ContainerStarted","Data":"31640f9c3ffabc465644847be12e0de02e887c8381e4995ba810a18df6a27217"}
Oct 30 23:45:04.046090 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:04.044760    4921 generic.go:356] "Generic (PLEG): container finished" podID="367f9225-5b26-41ee-9eeb-bcdd9b667439" containerID="604fa6d39b192d83fea766405854df9bfcc2458b88bd5b1d18ec97c073da88e8" exitCode=60
Oct 30 23:45:04.046090 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:04.044842    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f" event={"ID":"367f9225-5b26-41ee-9eeb-bcdd9b667439","Type":"ContainerDied","Data":"604fa6d39b192d83fea766405854df9bfcc2458b88bd5b1d18ec97c073da88e8"}
Oct 30 23:45:04.046090 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:04.045228    4921 scope.go:122] "RemoveContainer" containerID="604fa6d39b192d83fea766405854df9bfcc2458b88bd5b1d18ec97c073da88e8"
Oct 30 23:45:04.049199 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:04.049160    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:04.071691 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:04.071634    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg" podStartSLOduration=4.071615262 podStartE2EDuration="4.071615262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:04.05620872 +0000 UTC m=+1563.301064489" watchObservedRunningTime="2026-10-30 23:45:04.071615262 +0000 UTC m=+1563.316471030"
Oct 30 23:45:04.577299 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:04.577202    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:04.728112 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:04.728068    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:05.254728 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:05.254676    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2" event={"ID":"103409fa-7294-4741-8d40-786f667499b3","Type":"ContainerStarted","Data":"38b65d4a43f27441b507fec1ff63a3106340477b6e56aaf2a4107755e049dea4"}
Oct 30 23:45:05.262345 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:05.262316    4921 generic.go:356] "Generic (PLEG): container finished" podID="59eb5777-0d57-4a60-8e83-692d5b7a4b62" containerID="31640f9c3ffabc465644847be12e0de02e887c8381e4995ba810a18df6a27217" exitCode=60
Oct 30 23:45:05.263411 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:05.263391    4921 scope.go:122] "RemoveContainer" containerID="31640f9c3ffabc465644847be12e0de02e887c8381e4995ba810a18df6a27217"
Oct 30 23:45:05.265849 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:05.263747    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg" event={"ID":"59eb5777-0d57-4a60-8e83-692d5b7a4b62","Type":"ContainerDied","Data":"31640f9c3ffabc465644847be12e0de02e887c8381e4995ba810a18df6a27217"}
Oct 30 23:45:05.266154 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:05.266135    4921 scope.go:122] "RemoveContainer" containerID="75a00e14d70e0e325e8dc4c6a938ef3b7d2e469a9d3e34b8f098bace15c90a36"
Oct 30 23:45:05.268923 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:45:05.265783    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg_odh-ai-gateway-infra(59eb5777-0d57-4a60-8e83-692d5b7a4b62)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg" podUID="59eb5777-0d57-4a60-8e83-692d5b7a4b62"
Oct 30 23:45:05.301303 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:05.301255    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f" event={"ID":"367f9225-5b26-41ee-9eeb-bcdd9b667439","Type":"ContainerStarted","Data":"4c012897bde6ec0691055731903e987ecd2382aabd28cc78b7ca60b28d5ade89"}
Oct 30 23:45:05.757931 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:05.757893    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:06.345618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:06.345470    4921 scope.go:122] "RemoveContainer" containerID="31640f9c3ffabc465644847be12e0de02e887c8381e4995ba810a18df6a27217"
Oct 30 23:45:06.345992 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:45:06.345960    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg_odh-ai-gateway-infra(59eb5777-0d57-4a60-8e83-692d5b7a4b62)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg" podUID="59eb5777-0d57-4a60-8e83-692d5b7a4b62"
Oct 30 23:45:06.347724 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:06.347695    4921 generic.go:356] "Generic (PLEG): container finished" podID="367f9225-5b26-41ee-9eeb-bcdd9b667439" containerID="4c012897bde6ec0691055731903e987ecd2382aabd28cc78b7ca60b28d5ade89" exitCode=60
Oct 30 23:45:06.347872 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:06.347858    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f" event={"ID":"367f9225-5b26-41ee-9eeb-bcdd9b667439","Type":"ContainerDied","Data":"4c012897bde6ec0691055731903e987ecd2382aabd28cc78b7ca60b28d5ade89"}
Oct 30 23:45:06.347947 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:06.347911    4921 scope.go:122] "RemoveContainer" containerID="604fa6d39b192d83fea766405854df9bfcc2458b88bd5b1d18ec97c073da88e8"
Oct 30 23:45:06.348117 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:06.348100    4921 scope.go:122] "RemoveContainer" containerID="4c012897bde6ec0691055731903e987ecd2382aabd28cc78b7ca60b28d5ade89"
Oct 30 23:45:06.348420 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:45:06.348402    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f_odh-ai-gateway-infra(367f9225-5b26-41ee-9eeb-bcdd9b667439)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f" podUID="367f9225-5b26-41ee-9eeb-bcdd9b667439"
Oct 30 23:45:06.350337 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:06.350310    4921 generic.go:356] "Generic (PLEG): container finished" podID="103409fa-7294-4741-8d40-786f667499b3" containerID="38b65d4a43f27441b507fec1ff63a3106340477b6e56aaf2a4107755e049dea4" exitCode=60
Oct 30 23:45:06.350447 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:06.350356    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2" event={"ID":"103409fa-7294-4741-8d40-786f667499b3","Type":"ContainerDied","Data":"38b65d4a43f27441b507fec1ff63a3106340477b6e56aaf2a4107755e049dea4"}
Oct 30 23:45:06.350725 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:06.350708    4921 scope.go:122] "RemoveContainer" containerID="38b65d4a43f27441b507fec1ff63a3106340477b6e56aaf2a4107755e049dea4"
Oct 30 23:45:06.351032 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:45:06.351015    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2_odh-ai-gateway-infra(103409fa-7294-4741-8d40-786f667499b3)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2" podUID="103409fa-7294-4741-8d40-786f667499b3"
Oct 30 23:45:06.363869 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:06.363849    4921 scope.go:122] "RemoveContainer" containerID="5b259ffdb04db2abf417bfe86e26596ecea3e6b46dddf42f63d535eb52d8ffda"
Oct 30 23:45:06.975661 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:06.975567    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:07.360892 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:07.360813    4921 scope.go:122] "RemoveContainer" containerID="4c012897bde6ec0691055731903e987ecd2382aabd28cc78b7ca60b28d5ade89"
Oct 30 23:45:07.361262 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:45:07.361231    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f_odh-ai-gateway-infra(367f9225-5b26-41ee-9eeb-bcdd9b667439)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f" podUID="367f9225-5b26-41ee-9eeb-bcdd9b667439"
Oct 30 23:45:07.362755 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:07.362729    4921 scope.go:122] "RemoveContainer" containerID="38b65d4a43f27441b507fec1ff63a3106340477b6e56aaf2a4107755e049dea4"
Oct 30 23:45:07.363244 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:45:07.363213    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2_odh-ai-gateway-infra(103409fa-7294-4741-8d40-786f667499b3)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2" podUID="103409fa-7294-4741-8d40-786f667499b3"
Oct 30 23:45:07.629490 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:07.629378    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:08.547136 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:08.547106    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:09.477215 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:09.477177    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:10.249559 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:10.249510    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:11.140947 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:11.140911    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:11.405919 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:45:11.405827    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:45:11.523646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:11.523517    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:11.662674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:11.662603    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:11.965992 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:11.965913    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:12.719318 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:12.719291    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:12.872319 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:12.872091    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:13.630267 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:13.630232    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:14.790045 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:14.789996    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:15.519950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:15.519919    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:16.229268 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:16.229221    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:16.876129 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:16.876103    4921 scope.go:122] "RemoveContainer" containerID="38b65d4a43f27441b507fec1ff63a3106340477b6e56aaf2a4107755e049dea4"
Oct 30 23:45:17.131668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:17.131153    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:17.638865 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:17.638828    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2" event={"ID":"103409fa-7294-4741-8d40-786f667499b3","Type":"ContainerStarted","Data":"67c5e0fe75e5285615318090f9c94d19d4ee666656f0abe9a164bce5b771119d"}
Oct 30 23:45:17.875888 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:17.875862    4921 scope.go:122] "RemoveContainer" containerID="31640f9c3ffabc465644847be12e0de02e887c8381e4995ba810a18df6a27217"
Oct 30 23:45:17.956193 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:17.953955    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:18.651311 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:18.651279    4921 generic.go:356] "Generic (PLEG): container finished" podID="103409fa-7294-4741-8d40-786f667499b3" containerID="67c5e0fe75e5285615318090f9c94d19d4ee666656f0abe9a164bce5b771119d" exitCode=60
Oct 30 23:45:18.651884 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:18.651495    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2" event={"ID":"103409fa-7294-4741-8d40-786f667499b3","Type":"ContainerDied","Data":"67c5e0fe75e5285615318090f9c94d19d4ee666656f0abe9a164bce5b771119d"}
Oct 30 23:45:18.651884 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:18.651566    4921 scope.go:122] "RemoveContainer" containerID="38b65d4a43f27441b507fec1ff63a3106340477b6e56aaf2a4107755e049dea4"
Oct 30 23:45:18.652108 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:18.652090    4921 scope.go:122] "RemoveContainer" containerID="67c5e0fe75e5285615318090f9c94d19d4ee666656f0abe9a164bce5b771119d"
Oct 30 23:45:18.652473 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:45:18.652449    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2_odh-ai-gateway-infra(103409fa-7294-4741-8d40-786f667499b3)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2" podUID="103409fa-7294-4741-8d40-786f667499b3"
Oct 30 23:45:18.656154 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:18.656125    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg" event={"ID":"59eb5777-0d57-4a60-8e83-692d5b7a4b62","Type":"ContainerStarted","Data":"3383688e3428350586279b077957c22da903d205b56c2787206f0ace7bcbfc42"}
Oct 30 23:45:18.683897 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:18.683864    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2"]
Oct 30 23:45:18.749843 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:18.749807    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:18.893668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:18.884891    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:19.669121 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:19.669090    4921 generic.go:356] "Generic (PLEG): container finished" podID="59eb5777-0d57-4a60-8e83-692d5b7a4b62" containerID="3383688e3428350586279b077957c22da903d205b56c2787206f0ace7bcbfc42" exitCode=60
Oct 30 23:45:19.669519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:19.669127    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg" event={"ID":"59eb5777-0d57-4a60-8e83-692d5b7a4b62","Type":"ContainerDied","Data":"3383688e3428350586279b077957c22da903d205b56c2787206f0ace7bcbfc42"}
Oct 30 23:45:19.669519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:19.669230    4921 scope.go:122] "RemoveContainer" containerID="31640f9c3ffabc465644847be12e0de02e887c8381e4995ba810a18df6a27217"
Oct 30 23:45:19.669807 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:19.669784    4921 scope.go:122] "RemoveContainer" containerID="3383688e3428350586279b077957c22da903d205b56c2787206f0ace7bcbfc42"
Oct 30 23:45:19.670331 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:45:19.670253    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg_odh-ai-gateway-infra(59eb5777-0d57-4a60-8e83-692d5b7a4b62)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg" podUID="59eb5777-0d57-4a60-8e83-692d5b7a4b62"
Oct 30 23:45:19.737110 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:19.737077    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg"]
Oct 30 23:45:19.871630 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:19.828496    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:19.888654 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:19.876021    4921 scope.go:122] "RemoveContainer" containerID="4c012897bde6ec0691055731903e987ecd2382aabd28cc78b7ca60b28d5ade89"
Oct 30 23:45:19.996819 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:19.996787    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2"
Oct 30 23:45:20.034987 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:20.034918    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/103409fa-7294-4741-8d40-786f667499b3-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/103409fa-7294-4741-8d40-786f667499b3-maas-api-service-ca\") pod \"103409fa-7294-4741-8d40-786f667499b3\" (UID: \"103409fa-7294-4741-8d40-786f667499b3\") "
Oct 30 23:45:20.035167 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:20.035069    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/103409fa-7294-4741-8d40-786f667499b3-kube-api-access-jlzmc\" (UniqueName: \"kubernetes.io/projected/103409fa-7294-4741-8d40-786f667499b3-kube-api-access-jlzmc\") pod \"103409fa-7294-4741-8d40-786f667499b3\" (UID: \"103409fa-7294-4741-8d40-786f667499b3\") "
Oct 30 23:45:20.036660 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:20.036628    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/103409fa-7294-4741-8d40-786f667499b3-maas-api-service-ca" pod "103409fa-7294-4741-8d40-786f667499b3" (UID: "103409fa-7294-4741-8d40-786f667499b3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:45:20.042039 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:20.042010    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/103409fa-7294-4741-8d40-786f667499b3-kube-api-access-jlzmc" pod "103409fa-7294-4741-8d40-786f667499b3" (UID: "103409fa-7294-4741-8d40-786f667499b3"). InnerVolumeSpecName "kube-api-access-jlzmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:45:20.137690 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:20.137657    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/103409fa-7294-4741-8d40-786f667499b3-maas-api-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:45:20.137690 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:20.137688    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlzmc\" (UniqueName: \"kubernetes.io/projected/103409fa-7294-4741-8d40-786f667499b3-kube-api-access-jlzmc\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:45:20.679571 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:20.679527    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f" event={"ID":"367f9225-5b26-41ee-9eeb-bcdd9b667439","Type":"ContainerStarted","Data":"4c435fe751c9b1ace48c73ebd8082a0ae674922e6ae51e9d8f7ab0b38eace673"}
Oct 30 23:45:20.681032 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:20.681008    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2"
Oct 30 23:45:20.681203 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:20.681045    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2" event={"ID":"103409fa-7294-4741-8d40-786f667499b3","Type":"ContainerDied","Data":"9794ab3939ff50d21bb82c261e5b0a6f2d890bcb912073c8024651a039a00685"}
Oct 30 23:45:20.681203 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:20.681097    4921 scope.go:122] "RemoveContainer" containerID="67c5e0fe75e5285615318090f9c94d19d4ee666656f0abe9a164bce5b771119d"
Oct 30 23:45:20.748363 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:20.740800    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2"]
Oct 30 23:45:20.748363 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:20.742322    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:20.945398 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:20.945367    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-e15304-29890065-v25c2"]
Oct 30 23:45:21.060598 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:21.060574    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg"
Oct 30 23:45:21.161215 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:21.161181    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59eb5777-0d57-4a60-8e83-692d5b7a4b62-kube-api-access-dc4sq\" (UniqueName: \"kubernetes.io/projected/59eb5777-0d57-4a60-8e83-692d5b7a4b62-kube-api-access-dc4sq\") pod \"59eb5777-0d57-4a60-8e83-692d5b7a4b62\" (UID: \"59eb5777-0d57-4a60-8e83-692d5b7a4b62\") "
Oct 30 23:45:21.161368 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:21.161347    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/59eb5777-0d57-4a60-8e83-692d5b7a4b62-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59eb5777-0d57-4a60-8e83-692d5b7a4b62-maas-api-service-ca\") pod \"59eb5777-0d57-4a60-8e83-692d5b7a4b62\" (UID: \"59eb5777-0d57-4a60-8e83-692d5b7a4b62\") "
Oct 30 23:45:21.161707 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:21.161683    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59eb5777-0d57-4a60-8e83-692d5b7a4b62-maas-api-service-ca" pod "59eb5777-0d57-4a60-8e83-692d5b7a4b62" (UID: "59eb5777-0d57-4a60-8e83-692d5b7a4b62"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:45:21.162093 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:21.162075    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59eb5777-0d57-4a60-8e83-692d5b7a4b62-maas-api-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:45:21.163643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:21.163616    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59eb5777-0d57-4a60-8e83-692d5b7a4b62-kube-api-access-dc4sq" pod "59eb5777-0d57-4a60-8e83-692d5b7a4b62" (UID: "59eb5777-0d57-4a60-8e83-692d5b7a4b62"). InnerVolumeSpecName "kube-api-access-dc4sq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:45:21.263321 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:21.263246    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc4sq\" (UniqueName: \"kubernetes.io/projected/59eb5777-0d57-4a60-8e83-692d5b7a4b62-kube-api-access-dc4sq\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:45:21.587675 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:21.587255    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:21.699536 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:21.699500    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg"
Oct 30 23:45:21.699536 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:21.699522    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg" event={"ID":"59eb5777-0d57-4a60-8e83-692d5b7a4b62","Type":"ContainerDied","Data":"b3b27d1b7b5a69de496f3b102212c4dd85bf8920085b093d97e02fbe1d24942f"}
Oct 30 23:45:21.700139 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:21.699643    4921 scope.go:122] "RemoveContainer" containerID="3383688e3428350586279b077957c22da903d205b56c2787206f0ace7bcbfc42"
Oct 30 23:45:21.702439 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:21.702414    4921 generic.go:356] "Generic (PLEG): container finished" podID="367f9225-5b26-41ee-9eeb-bcdd9b667439" containerID="4c435fe751c9b1ace48c73ebd8082a0ae674922e6ae51e9d8f7ab0b38eace673" exitCode=60
Oct 30 23:45:21.702564 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:21.702496    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f" event={"ID":"367f9225-5b26-41ee-9eeb-bcdd9b667439","Type":"ContainerDied","Data":"4c435fe751c9b1ace48c73ebd8082a0ae674922e6ae51e9d8f7ab0b38eace673"}
Oct 30 23:45:21.703069 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:21.703050    4921 scope.go:122] "RemoveContainer" containerID="4c435fe751c9b1ace48c73ebd8082a0ae674922e6ae51e9d8f7ab0b38eace673"
Oct 30 23:45:21.703570 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:45:21.703532    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f_odh-ai-gateway-infra(367f9225-5b26-41ee-9eeb-bcdd9b667439)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f" podUID="367f9225-5b26-41ee-9eeb-bcdd9b667439"
Oct 30 23:45:21.711762 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:21.711735    4921 scope.go:122] "RemoveContainer" containerID="4c012897bde6ec0691055731903e987ecd2382aabd28cc78b7ca60b28d5ade89"
Oct 30 23:45:21.712156 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:21.712126    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f"]
Oct 30 23:45:21.747554 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:21.747521    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg"]
Oct 30 23:45:21.755445 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:21.755420    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890065-7dxsg"]
Oct 30 23:45:22.354706 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:22.354608    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:22.880791 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:22.880766    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f"
Oct 30 23:45:22.885243 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:22.885214    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="103409fa-7294-4741-8d40-786f667499b3" path="/var/lib/kubelet/pods/103409fa-7294-4741-8d40-786f667499b3/volumes"
Oct 30 23:45:22.885799 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:22.885783    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="59eb5777-0d57-4a60-8e83-692d5b7a4b62" path="/var/lib/kubelet/pods/59eb5777-0d57-4a60-8e83-692d5b7a4b62/volumes"
Oct 30 23:45:23.003975 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:23.003890    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/367f9225-5b26-41ee-9eeb-bcdd9b667439-kube-api-access-qskf7\" (UniqueName: \"kubernetes.io/projected/367f9225-5b26-41ee-9eeb-bcdd9b667439-kube-api-access-qskf7\") pod \"367f9225-5b26-41ee-9eeb-bcdd9b667439\" (UID: \"367f9225-5b26-41ee-9eeb-bcdd9b667439\") "
Oct 30 23:45:23.004125 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:23.004107    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/367f9225-5b26-41ee-9eeb-bcdd9b667439-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/367f9225-5b26-41ee-9eeb-bcdd9b667439-maas-api-service-ca\") pod \"367f9225-5b26-41ee-9eeb-bcdd9b667439\" (UID: \"367f9225-5b26-41ee-9eeb-bcdd9b667439\") "
Oct 30 23:45:23.004510 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:23.004480    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/367f9225-5b26-41ee-9eeb-bcdd9b667439-maas-api-service-ca" pod "367f9225-5b26-41ee-9eeb-bcdd9b667439" (UID: "367f9225-5b26-41ee-9eeb-bcdd9b667439"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:45:23.004836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:23.004819    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/367f9225-5b26-41ee-9eeb-bcdd9b667439-maas-api-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:45:23.006386 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:23.006364    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/367f9225-5b26-41ee-9eeb-bcdd9b667439-kube-api-access-qskf7" pod "367f9225-5b26-41ee-9eeb-bcdd9b667439" (UID: "367f9225-5b26-41ee-9eeb-bcdd9b667439"). InnerVolumeSpecName "kube-api-access-qskf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:45:23.106187 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:23.106149    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qskf7\" (UniqueName: \"kubernetes.io/projected/367f9225-5b26-41ee-9eeb-bcdd9b667439-kube-api-access-qskf7\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:45:23.247614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:23.245099    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:23.726469 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:23.726441    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f"
Oct 30 23:45:23.726672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:23.726436    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f" event={"ID":"367f9225-5b26-41ee-9eeb-bcdd9b667439","Type":"ContainerDied","Data":"28f812a1a0cb7c6ac13eec950646e20143680da7a39d7a63c378fd9fd342a349"}
Oct 30 23:45:23.726672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:23.726662    4921 scope.go:122] "RemoveContainer" containerID="4c435fe751c9b1ace48c73ebd8082a0ae674922e6ae51e9d8f7ab0b38eace673"
Oct 30 23:45:23.756243 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:23.756215    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f"]
Oct 30 23:45:23.762723 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:23.762701    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e4285d4a-29890065-pwl6f"]
Oct 30 23:45:23.928961 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:23.928929    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:24.659347 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:24.659305    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:24.885522 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:24.885487    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="367f9225-5b26-41ee-9eeb-bcdd9b667439" path="/var/lib/kubelet/pods/367f9225-5b26-41ee-9eeb-bcdd9b667439/volumes"
Oct 30 23:45:25.463947 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:25.463915    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:26.353345 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:26.353305    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:27.146764 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:27.146733    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:28.224728 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:28.224689    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:29.084638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:29.084576    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:30.019912 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:30.019874    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:30.203658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:30.203624    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:30.375537 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:30.375450    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:31.197221 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:31.197189    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:31.727439 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:31.712912    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:31.989625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:31.989362    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:32.165340 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:32.165307    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:32.613818 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:32.613781    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:32.762621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:32.761644    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:32.947628 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:32.938037    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:33.986330 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:33.984417    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:34.775619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:34.775307    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:35.623922 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:35.623887    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:36.611736 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:36.611691    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:37.190583 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:37.190545    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:37.334431 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:37.334399    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:37.470462 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:37.470386    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:37.727939 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:37.727856    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:38.561161 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.561126    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:38.621878 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.621837    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7"]
Oct 30 23:45:38.622757 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.622733    4921 cpu_manager.go:414] "containerMap: removing container" podUID="367f9225-5b26-41ee-9eeb-bcdd9b667439" containerName="cleanup"
Oct 30 23:45:38.622757 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.622755    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="367f9225-5b26-41ee-9eeb-bcdd9b667439" containerName="cleanup"
Oct 30 23:45:38.622991 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.622773    4921 cpu_manager.go:414] "containerMap: removing container" podUID="59eb5777-0d57-4a60-8e83-692d5b7a4b62" containerName="cleanup"
Oct 30 23:45:38.622991 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.622780    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59eb5777-0d57-4a60-8e83-692d5b7a4b62" containerName="cleanup"
Oct 30 23:45:38.622991 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.622811    4921 cpu_manager.go:414] "containerMap: removing container" podUID="103409fa-7294-4741-8d40-786f667499b3" containerName="cleanup"
Oct 30 23:45:38.622991 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.622819    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="103409fa-7294-4741-8d40-786f667499b3" containerName="cleanup"
Oct 30 23:45:38.622991 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.622835    4921 cpu_manager.go:414] "containerMap: removing container" podUID="59eb5777-0d57-4a60-8e83-692d5b7a4b62" containerName="cleanup"
Oct 30 23:45:38.622991 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.622841    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59eb5777-0d57-4a60-8e83-692d5b7a4b62" containerName="cleanup"
Oct 30 23:45:38.622991 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.622861    4921 cpu_manager.go:414] "containerMap: removing container" podUID="103409fa-7294-4741-8d40-786f667499b3" containerName="cleanup"
Oct 30 23:45:38.622991 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.622869    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="103409fa-7294-4741-8d40-786f667499b3" containerName="cleanup"
Oct 30 23:45:38.622991 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.622880    4921 cpu_manager.go:414] "containerMap: removing container" podUID="59eb5777-0d57-4a60-8e83-692d5b7a4b62" containerName="cleanup"
Oct 30 23:45:38.622991 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.622886    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59eb5777-0d57-4a60-8e83-692d5b7a4b62" containerName="cleanup"
Oct 30 23:45:38.622991 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.622912    4921 cpu_manager.go:414] "containerMap: removing container" podUID="103409fa-7294-4741-8d40-786f667499b3" containerName="cleanup"
Oct 30 23:45:38.622991 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.622918    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="103409fa-7294-4741-8d40-786f667499b3" containerName="cleanup"
Oct 30 23:45:38.622991 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.622943    4921 cpu_manager.go:414] "containerMap: removing container" podUID="367f9225-5b26-41ee-9eeb-bcdd9b667439" containerName="cleanup"
Oct 30 23:45:38.622991 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.622950    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="367f9225-5b26-41ee-9eeb-bcdd9b667439" containerName="cleanup"
Oct 30 23:45:38.623713 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.623129    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="367f9225-5b26-41ee-9eeb-bcdd9b667439" containerName="cleanup"
Oct 30 23:45:38.623713 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.623145    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="367f9225-5b26-41ee-9eeb-bcdd9b667439" containerName="cleanup"
Oct 30 23:45:38.623713 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.623155    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="59eb5777-0d57-4a60-8e83-692d5b7a4b62" containerName="cleanup"
Oct 30 23:45:38.623713 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.623168    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="103409fa-7294-4741-8d40-786f667499b3" containerName="cleanup"
Oct 30 23:45:38.623713 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.623179    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="59eb5777-0d57-4a60-8e83-692d5b7a4b62" containerName="cleanup"
Oct 30 23:45:38.623713 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.623190    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="103409fa-7294-4741-8d40-786f667499b3" containerName="cleanup"
Oct 30 23:45:38.623713 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.623199    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="59eb5777-0d57-4a60-8e83-692d5b7a4b62" containerName="cleanup"
Oct 30 23:45:38.628710 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.628688    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7"
Oct 30 23:45:38.639038 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.639010    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7"]
Oct 30 23:45:38.730620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.691961    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-a3e876-dockercfg-2tm45\""
Oct 30 23:45:38.730912 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.701876    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-a3e876\""
Oct 30 23:45:38.766340 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.766193    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:38.861680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.792469    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ff8b90e-ea76-4c42-808a-a60e9b81d376-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7\" (UID: \"1ff8b90e-ea76-4c42-808a-a60e9b81d376\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7"
Oct 30 23:45:38.861680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:38.792843    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg89k\" (UniqueName: \"kubernetes.io/projected/1ff8b90e-ea76-4c42-808a-a60e9b81d376-kube-api-access-dg89k\") pod \"payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7\" (UID: \"1ff8b90e-ea76-4c42-808a-a60e9b81d376\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7"
Oct 30 23:45:39.061616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:39.052961    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ff8b90e-ea76-4c42-808a-a60e9b81d376-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7\" (UID: \"1ff8b90e-ea76-4c42-808a-a60e9b81d376\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7"
Oct 30 23:45:39.061616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:39.053353    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg89k\" (UniqueName: \"kubernetes.io/projected/1ff8b90e-ea76-4c42-808a-a60e9b81d376-kube-api-access-dg89k\") pod \"payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7\" (UID: \"1ff8b90e-ea76-4c42-808a-a60e9b81d376\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7"
Oct 30 23:45:39.061616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:39.055764    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ff8b90e-ea76-4c42-808a-a60e9b81d376-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7\" (UID: \"1ff8b90e-ea76-4c42-808a-a60e9b81d376\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7"
Oct 30 23:45:39.094633 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:39.094582    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg89k\" (UniqueName: \"kubernetes.io/projected/1ff8b90e-ea76-4c42-808a-a60e9b81d376-kube-api-access-dg89k\") pod \"payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7\" (UID: \"1ff8b90e-ea76-4c42-808a-a60e9b81d376\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7"
Oct 30 23:45:39.248931 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:39.248894    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:39.255898 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:39.255866    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7"
Oct 30 23:45:39.677683 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:39.677653    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7"]
Oct 30 23:45:39.678186 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:45:39.678161    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ff8b90e_ea76_4c42_808a_a60e9b81d376.slice/crio-494d371a4a01617a5d8f39016eedd6e4bd1cf12e22649731966b526e0c3b8fd7 WatchSource:0}: Error finding container 494d371a4a01617a5d8f39016eedd6e4bd1cf12e22649731966b526e0c3b8fd7: Status 404 returned error can't find the container with id 494d371a4a01617a5d8f39016eedd6e4bd1cf12e22649731966b526e0c3b8fd7
Oct 30 23:45:40.049338 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:40.049260    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:40.094702 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:40.094668    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7" event={"ID":"1ff8b90e-ea76-4c42-808a-a60e9b81d376","Type":"ContainerStarted","Data":"190b85c7c92d0efa82e4e002002ee847527423a609362f563ad1b961b2ba7b50"}
Oct 30 23:45:40.094872 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:40.094729    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7" event={"ID":"1ff8b90e-ea76-4c42-808a-a60e9b81d376","Type":"ContainerStarted","Data":"494d371a4a01617a5d8f39016eedd6e4bd1cf12e22649731966b526e0c3b8fd7"}
Oct 30 23:45:40.094872 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:40.094758    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7"
Oct 30 23:45:40.151387 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:40.151314    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7" podStartSLOduration=2.151290653 podStartE2EDuration="2.151290653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:40.114334404 +0000 UTC m=+1599.359190173" watchObservedRunningTime="2026-10-30 23:45:40.151290653 +0000 UTC m=+1599.396146422"
Oct 30 23:45:40.937571 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:40.937534    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:41.108625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:41.105899    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:41.414829 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:45:41.414793    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:45:41.460160 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:41.456146    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:41.613620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:41.605054    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:42.416035 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:42.415998    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:43.257620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:43.256887    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:43.870377 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:43.870341    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:44.771268 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:44.771167    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:45.362835 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:45.362801    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:45.497553 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:45.497521    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:45.796971 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:45.796934    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:46.574152 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:46.574118    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:46.605230 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:46.605200    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd"]
Oct 30 23:45:46.606000 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:46.605982    4921 cpu_manager.go:414] "containerMap: removing container" podUID="367f9225-5b26-41ee-9eeb-bcdd9b667439" containerName="cleanup"
Oct 30 23:45:46.606000 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:46.606001    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="367f9225-5b26-41ee-9eeb-bcdd9b667439" containerName="cleanup"
Oct 30 23:45:46.606142 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:46.606128    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="103409fa-7294-4741-8d40-786f667499b3" containerName="cleanup"
Oct 30 23:45:46.606174 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:46.606146    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="367f9225-5b26-41ee-9eeb-bcdd9b667439" containerName="cleanup"
Oct 30 23:45:46.614061 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:46.614042    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd"
Oct 30 23:45:46.627465 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:46.624241    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-6a162557-dockercfg-59xxl\""
Oct 30 23:45:46.627465 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:46.624360    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-6a162557\""
Oct 30 23:45:46.632352 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:46.632330    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd"]
Oct 30 23:45:46.707068 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:46.707035    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95h6g\" (UniqueName: \"kubernetes.io/projected/13a82994-2aea-4a29-9db6-10b92669f68c-kube-api-access-95h6g\") pod \"payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd\" (UID: \"13a82994-2aea-4a29-9db6-10b92669f68c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd"
Oct 30 23:45:46.707270 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:46.707177    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13a82994-2aea-4a29-9db6-10b92669f68c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd\" (UID: \"13a82994-2aea-4a29-9db6-10b92669f68c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd"
Oct 30 23:45:46.757685 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:46.752533    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:46.814621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:46.813347    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95h6g\" (UniqueName: \"kubernetes.io/projected/13a82994-2aea-4a29-9db6-10b92669f68c-kube-api-access-95h6g\") pod \"payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd\" (UID: \"13a82994-2aea-4a29-9db6-10b92669f68c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd"
Oct 30 23:45:46.814621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:46.813458    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13a82994-2aea-4a29-9db6-10b92669f68c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd\" (UID: \"13a82994-2aea-4a29-9db6-10b92669f68c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd"
Oct 30 23:45:46.814621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:46.814570    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13a82994-2aea-4a29-9db6-10b92669f68c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd\" (UID: \"13a82994-2aea-4a29-9db6-10b92669f68c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd"
Oct 30 23:45:46.915635 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:46.909011    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95h6g\" (UniqueName: \"kubernetes.io/projected/13a82994-2aea-4a29-9db6-10b92669f68c-kube-api-access-95h6g\") pod \"payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd\" (UID: \"13a82994-2aea-4a29-9db6-10b92669f68c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd"
Oct 30 23:45:46.915635 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:46.911725    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:46.953616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:46.946316    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd"
Oct 30 23:45:47.436425 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:45:47.436391    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a82994_2aea_4a29_9db6_10b92669f68c.slice/crio-e213382840138b29b551238e15bab4631038632cac0e8feebb1a6dc29b96793b WatchSource:0}: Error finding container e213382840138b29b551238e15bab4631038632cac0e8feebb1a6dc29b96793b: Status 404 returned error can't find the container with id e213382840138b29b551238e15bab4631038632cac0e8feebb1a6dc29b96793b
Oct 30 23:45:47.436941 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:47.436892    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd"]
Oct 30 23:45:47.941206 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:47.941167    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:48.196920 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:48.196838    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd" event={"ID":"13a82994-2aea-4a29-9db6-10b92669f68c","Type":"ContainerStarted","Data":"aef4e44142af5f05e6b8d428b1b9c98d970fa086c84fc2ef49fde7cb25909910"}
Oct 30 23:45:48.196920 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:48.196907    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd" event={"ID":"13a82994-2aea-4a29-9db6-10b92669f68c","Type":"ContainerStarted","Data":"e213382840138b29b551238e15bab4631038632cac0e8feebb1a6dc29b96793b"}
Oct 30 23:45:48.198646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:48.197287    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd"
Oct 30 23:45:48.220565 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:48.220518    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd" podStartSLOduration=2.220504883 podStartE2EDuration="2.220504883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:48.220074627 +0000 UTC m=+1607.464930397" watchObservedRunningTime="2026-10-30 23:45:48.220504883 +0000 UTC m=+1607.465360651"
Oct 30 23:45:48.845624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:48.845532    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:49.583093 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:49.583051    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:50.336156 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:50.336126    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:51.134270 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:51.130750    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7"
Oct 30 23:45:51.168692 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:51.167440    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:51.352421 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:51.352389    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs"]
Oct 30 23:45:51.465071 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:51.464987    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:51.593223 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:51.593187    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:52.232712 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:52.232675    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:52.638749 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:52.638716    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:53.120998 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:53.120906    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:53.852546 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:53.852501    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:54.444237 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:54.444202    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"]
Oct 30 23:45:54.454432 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:54.454373    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"
Oct 30 23:45:54.455584 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:54.455547    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"]
Oct 30 23:45:54.463189 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:54.463157    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-6a162557-serving-cert\""
Oct 30 23:45:54.527208 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:54.527179    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:54.535985 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:54.535959    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kptbb\" (UniqueName: \"kubernetes.io/projected/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-kube-api-access-kptbb\") pod \"maas-api-e2e-mt-6a162557-55c4486749-7mwts\" (UID: \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"
Oct 30 23:45:54.536166 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:54.536137    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-openshift-service-ca\") pod \"maas-api-e2e-mt-6a162557-55c4486749-7mwts\" (UID: \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"
Oct 30 23:45:54.536297 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:54.536186    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-maas-api-tls\") pod \"maas-api-e2e-mt-6a162557-55c4486749-7mwts\" (UID: \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"
Oct 30 23:45:54.536344 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:54.536327    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-metrics-certs\") pod \"maas-api-e2e-mt-6a162557-55c4486749-7mwts\" (UID: \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"
Oct 30 23:45:54.644619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:54.642032    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-openshift-service-ca\") pod \"maas-api-e2e-mt-6a162557-55c4486749-7mwts\" (UID: \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"
Oct 30 23:45:54.644619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:54.642107    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-maas-api-tls\") pod \"maas-api-e2e-mt-6a162557-55c4486749-7mwts\" (UID: \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"
Oct 30 23:45:54.644619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:54.642229    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-metrics-certs\") pod \"maas-api-e2e-mt-6a162557-55c4486749-7mwts\" (UID: \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"
Oct 30 23:45:54.644619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:54.642465    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kptbb\" (UniqueName: \"kubernetes.io/projected/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-kube-api-access-kptbb\") pod \"maas-api-e2e-mt-6a162557-55c4486749-7mwts\" (UID: \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"
Oct 30 23:45:54.644619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:54.643881    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-openshift-service-ca\") pod \"maas-api-e2e-mt-6a162557-55c4486749-7mwts\" (UID: \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"
Oct 30 23:45:54.673618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:54.673542    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:54.675693 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:54.675573    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-maas-api-tls\") pod \"maas-api-e2e-mt-6a162557-55c4486749-7mwts\" (UID: \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"
Oct 30 23:45:54.678336 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:54.678023    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kptbb\" (UniqueName: \"kubernetes.io/projected/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-kube-api-access-kptbb\") pod \"maas-api-e2e-mt-6a162557-55c4486749-7mwts\" (UID: \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"
Oct 30 23:45:54.679211 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:54.679169    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-metrics-certs\") pod \"maas-api-e2e-mt-6a162557-55c4486749-7mwts\" (UID: \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"
Oct 30 23:45:54.775667 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:54.773915    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"
Oct 30 23:45:55.199724 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:55.197016    4921 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 23:45:55.207868 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:55.207838    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"]
Oct 30 23:45:55.324747 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:55.324714    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts" event={"ID":"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317","Type":"ContainerStarted","Data":"7d0dfe69472a046220d7d7135704e6def8698a5f9e386012974358ace5aaa997"}
Oct 30 23:45:55.525038 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:55.524926    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:56.333777 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:56.333743    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts" event={"ID":"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317","Type":"ContainerStarted","Data":"c93a2e516a6fb64b88a06bc0683608e0340213c66c8e184ed9a1e5f8a6a66368"}
Oct 30 23:45:56.334167 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:56.333869    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"
Oct 30 23:45:56.343482 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:56.343446    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:56.377620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:56.360162    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts" podStartSLOduration=1.872315034 podStartE2EDuration="2.360140108s" totalImagesPullingTime="487.825074ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:56.359169203 +0000 UTC m=+1615.604024972" watchObservedRunningTime="2026-10-30 23:45:56.360140108 +0000 UTC m=+1615.604995878"
Oct 30 23:45:56.387615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:56.387433    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs" podUID="37369cd4-f379-4ed8-8826-b0828b5f4374" containerName="payload-processing" containerID="cri-o://74ca3d456f7060b1df5a8550e8b6bc67b8c9636329d7c530c5b6d4825f399b5a" gracePeriod=25
Oct 30 23:45:56.809472 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:56.809446    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs"
Oct 30 23:45:56.845422 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:56.845394    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/37369cd4-f379-4ed8-8826-b0828b5f4374-kube-api-access-gslhh\" (UniqueName: \"kubernetes.io/projected/37369cd4-f379-4ed8-8826-b0828b5f4374-kube-api-access-gslhh\") pod \"37369cd4-f379-4ed8-8826-b0828b5f4374\" (UID: \"37369cd4-f379-4ed8-8826-b0828b5f4374\") "
Oct 30 23:45:56.845746 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:56.845717    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/37369cd4-f379-4ed8-8826-b0828b5f4374-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37369cd4-f379-4ed8-8826-b0828b5f4374-plugins-config-volume\") pod \"37369cd4-f379-4ed8-8826-b0828b5f4374\" (UID: \"37369cd4-f379-4ed8-8826-b0828b5f4374\") "
Oct 30 23:45:56.846133 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:56.846101    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37369cd4-f379-4ed8-8826-b0828b5f4374-plugins-config-volume" pod "37369cd4-f379-4ed8-8826-b0828b5f4374" (UID: "37369cd4-f379-4ed8-8826-b0828b5f4374"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:45:56.846587 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:56.846563    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37369cd4-f379-4ed8-8826-b0828b5f4374-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:45:56.848271 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:56.848250    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37369cd4-f379-4ed8-8826-b0828b5f4374-kube-api-access-gslhh" pod "37369cd4-f379-4ed8-8826-b0828b5f4374" (UID: "37369cd4-f379-4ed8-8826-b0828b5f4374"). InnerVolumeSpecName "kube-api-access-gslhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:45:56.948718 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:56.948650    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gslhh\" (UniqueName: \"kubernetes.io/projected/37369cd4-f379-4ed8-8826-b0828b5f4374-kube-api-access-gslhh\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:45:57.134140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:57.134110    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:57.343793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:57.343710    4921 generic.go:356] "Generic (PLEG): container finished" podID="37369cd4-f379-4ed8-8826-b0828b5f4374" containerID="74ca3d456f7060b1df5a8550e8b6bc67b8c9636329d7c530c5b6d4825f399b5a" exitCode=0
Oct 30 23:45:57.343793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:57.343761    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs"
Oct 30 23:45:57.344347 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:57.343792    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs" event={"ID":"37369cd4-f379-4ed8-8826-b0828b5f4374","Type":"ContainerDied","Data":"74ca3d456f7060b1df5a8550e8b6bc67b8c9636329d7c530c5b6d4825f399b5a"}
Oct 30 23:45:57.344347 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:57.343843    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs" event={"ID":"37369cd4-f379-4ed8-8826-b0828b5f4374","Type":"ContainerDied","Data":"0f76bf4eec6e5374ec9eed9de0513431d0d57b45686be74c17a6124f8ed90483"}
Oct 30 23:45:57.344347 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:57.343866    4921 scope.go:122] "RemoveContainer" containerID="74ca3d456f7060b1df5a8550e8b6bc67b8c9636329d7c530c5b6d4825f399b5a"
Oct 30 23:45:57.355302 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:57.355286    4921 scope.go:122] "RemoveContainer" containerID="74ca3d456f7060b1df5a8550e8b6bc67b8c9636329d7c530c5b6d4825f399b5a"
Oct 30 23:45:57.355579 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:45:57.355553    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74ca3d456f7060b1df5a8550e8b6bc67b8c9636329d7c530c5b6d4825f399b5a\": container with ID starting with 74ca3d456f7060b1df5a8550e8b6bc67b8c9636329d7c530c5b6d4825f399b5a not found: ID does not exist" containerID="74ca3d456f7060b1df5a8550e8b6bc67b8c9636329d7c530c5b6d4825f399b5a"
Oct 30 23:45:57.355683 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:57.355587    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74ca3d456f7060b1df5a8550e8b6bc67b8c9636329d7c530c5b6d4825f399b5a"} err="failed to get container status \"74ca3d456f7060b1df5a8550e8b6bc67b8c9636329d7c530c5b6d4825f399b5a\": rpc error: code = NotFound desc = could not find container \"74ca3d456f7060b1df5a8550e8b6bc67b8c9636329d7c530c5b6d4825f399b5a\": container with ID starting with 74ca3d456f7060b1df5a8550e8b6bc67b8c9636329d7c530c5b6d4825f399b5a not found: ID does not exist"
Oct 30 23:45:57.364699 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:57.364551    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs"]
Oct 30 23:45:57.368737 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:57.368718    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e4285d4a-7d5c8d8849-9mgrs"]
Oct 30 23:45:58.131813 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:58.131744    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:58.885794 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:58.885759    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="37369cd4-f379-4ed8-8826-b0828b5f4374" path="/var/lib/kubelet/pods/37369cd4-f379-4ed8-8826-b0828b5f4374/volumes"
Oct 30 23:45:59.107533 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:59.107498    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:59.208678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:59.208542    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd"
Oct 30 23:45:59.590514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:59.579500    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:45:59.929237 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:45:59.929198    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:00.176906 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:00.176874    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:00.926651 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:00.921790    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:01.775615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:01.772129    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:02.350647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:02.350579    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"
Oct 30 23:46:02.550467 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:02.550428    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:02.757459 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:02.757423    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:03.578681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:03.578617    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:04.055003 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:04.054972    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:04.194512 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:04.194476    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:04.235254 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:04.235211    4921 scope.go:122] "RemoveContainer" containerID="d4e5d9ec728cbbccad4bd3a7d3fc8aae12548f64359f94f151e8eae817e9e277"
Oct 30 23:46:04.555035 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:04.554996    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:05.228134 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:05.228099    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:05.362969 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:05.362936    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:05.531771 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:05.531668    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:06.048857 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:06.048818    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:07.156411 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:07.156374    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:07.306354 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:07.306319    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:07.568654 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:07.568554    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"]
Oct 30 23:46:07.568827 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:07.568805    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9" podUID="186ab5a2-2953-437c-b1a2-b883c1a32dca" containerName="istio-proxy" containerID="cri-o://8eddc99eb967172fe760eff7c191adce43c25b399c7b406b688ff7604253a091" gracePeriod=30
Oct 30 23:46:07.640602 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:07.640568    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:08.048479 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:08.048444    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:08.193918 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:08.193878    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:08.348618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:08.348526    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:08.490780 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:08.490718    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:09.176398 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:09.176360    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:09.937845 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:09.937810    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:10.624048 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:10.624009    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:10.765561 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:10.765519    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:11.347933 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:11.347900    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:11.538309 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:46:11.538140    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:46:12.155540 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.155497    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:12.865132 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.865105    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:46:12.930701 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.930649    4921 generic.go:356] "Generic (PLEG): container finished" podID="186ab5a2-2953-437c-b1a2-b883c1a32dca" containerID="8eddc99eb967172fe760eff7c191adce43c25b399c7b406b688ff7604253a091" exitCode=0
Oct 30 23:46:12.930897 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.930804    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9" event={"ID":"186ab5a2-2953-437c-b1a2-b883c1a32dca","Type":"ContainerDied","Data":"8eddc99eb967172fe760eff7c191adce43c25b399c7b406b688ff7604253a091"}
Oct 30 23:46:12.930897 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.930855    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9" event={"ID":"186ab5a2-2953-437c-b1a2-b883c1a32dca","Type":"ContainerDied","Data":"bd922e2df42d6e23d5c4ab238e0477d2c3e10452819785484bda9c942bff4761"}
Oct 30 23:46:12.930897 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.930884    4921 scope.go:122] "RemoveContainer" containerID="8eddc99eb967172fe760eff7c191adce43c25b399c7b406b688ff7604253a091"
Oct 30 23:46:12.931049 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.931034    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"
Oct 30 23:46:12.933530 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.933498    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-podinfo\") pod \"186ab5a2-2953-437c-b1a2-b883c1a32dca\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") "
Oct 30 23:46:12.933687 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.933666    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-credential-socket\") pod \"186ab5a2-2953-437c-b1a2-b883c1a32dca\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") "
Oct 30 23:46:12.933761 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.933721    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/186ab5a2-2953-437c-b1a2-b883c1a32dca-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/186ab5a2-2953-437c-b1a2-b883c1a32dca-istiod-ca-cert\") pod \"186ab5a2-2953-437c-b1a2-b883c1a32dca\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") "
Oct 30 23:46:12.933879 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.933861    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-envoy\") pod \"186ab5a2-2953-437c-b1a2-b883c1a32dca\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") "
Oct 30 23:46:12.933940 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.933899    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-token\" (UniqueName: \"kubernetes.io/projected/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-token\") pod \"186ab5a2-2953-437c-b1a2-b883c1a32dca\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") "
Oct 30 23:46:12.933940 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.933927    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-workload-socket\") pod \"186ab5a2-2953-437c-b1a2-b883c1a32dca\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") "
Oct 30 23:46:12.934056 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.933978    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-workload-certs\") pod \"186ab5a2-2953-437c-b1a2-b883c1a32dca\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") "
Oct 30 23:46:12.934114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.934090    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-data\") pod \"186ab5a2-2953-437c-b1a2-b883c1a32dca\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") "
Oct 30 23:46:12.934228 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.934176    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/186ab5a2-2953-437c-b1a2-b883c1a32dca-kube-api-access-8bml5\" (UniqueName: \"kubernetes.io/projected/186ab5a2-2953-437c-b1a2-b883c1a32dca-kube-api-access-8bml5\") pod \"186ab5a2-2953-437c-b1a2-b883c1a32dca\" (UID: \"186ab5a2-2953-437c-b1a2-b883c1a32dca\") "
Oct 30 23:46:12.936528 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.936487    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-workload-socket" pod "186ab5a2-2953-437c-b1a2-b883c1a32dca" (UID: "186ab5a2-2953-437c-b1a2-b883c1a32dca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:12.937012 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.936989    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-workload-certs" pod "186ab5a2-2953-437c-b1a2-b883c1a32dca" (UID: "186ab5a2-2953-437c-b1a2-b883c1a32dca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:12.937196 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.937174    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-data" pod "186ab5a2-2953-437c-b1a2-b883c1a32dca" (UID: "186ab5a2-2953-437c-b1a2-b883c1a32dca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:12.937950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.937917    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-credential-socket" pod "186ab5a2-2953-437c-b1a2-b883c1a32dca" (UID: "186ab5a2-2953-437c-b1a2-b883c1a32dca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:12.938039 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.937963    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/186ab5a2-2953-437c-b1a2-b883c1a32dca-istiod-ca-cert" pod "186ab5a2-2953-437c-b1a2-b883c1a32dca" (UID: "186ab5a2-2953-437c-b1a2-b883c1a32dca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:46:12.938900 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.938874    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/186ab5a2-2953-437c-b1a2-b883c1a32dca-kube-api-access-8bml5" pod "186ab5a2-2953-437c-b1a2-b883c1a32dca" (UID: "186ab5a2-2953-437c-b1a2-b883c1a32dca"). InnerVolumeSpecName "kube-api-access-8bml5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:46:12.939005 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.938994    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-token" pod "186ab5a2-2953-437c-b1a2-b883c1a32dca" (UID: "186ab5a2-2953-437c-b1a2-b883c1a32dca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:46:12.945959 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.940766    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-podinfo" pod "186ab5a2-2953-437c-b1a2-b883c1a32dca" (UID: "186ab5a2-2953-437c-b1a2-b883c1a32dca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:46:12.945959 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.941023    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-envoy" pod "186ab5a2-2953-437c-b1a2-b883c1a32dca" (UID: "186ab5a2-2953-437c-b1a2-b883c1a32dca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:46:12.947685 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.947664    4921 scope.go:122] "RemoveContainer" containerID="1dbc3746cd5d761b6a241c6cabfce113f33d7da3a3333499c5b76099e6f4065d"
Oct 30 23:46:12.991288 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.991261    4921 scope.go:122] "RemoveContainer" containerID="8eddc99eb967172fe760eff7c191adce43c25b399c7b406b688ff7604253a091"
Oct 30 23:46:12.991695 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:46:12.991674    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eddc99eb967172fe760eff7c191adce43c25b399c7b406b688ff7604253a091\": container with ID starting with 8eddc99eb967172fe760eff7c191adce43c25b399c7b406b688ff7604253a091 not found: ID does not exist" containerID="8eddc99eb967172fe760eff7c191adce43c25b399c7b406b688ff7604253a091"
Oct 30 23:46:12.991765 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.991706    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eddc99eb967172fe760eff7c191adce43c25b399c7b406b688ff7604253a091"} err="failed to get container status \"8eddc99eb967172fe760eff7c191adce43c25b399c7b406b688ff7604253a091\": rpc error: code = NotFound desc = could not find container \"8eddc99eb967172fe760eff7c191adce43c25b399c7b406b688ff7604253a091\": container with ID starting with 8eddc99eb967172fe760eff7c191adce43c25b399c7b406b688ff7604253a091 not found: ID does not exist"
Oct 30 23:46:12.991765 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.991726    4921 scope.go:122] "RemoveContainer" containerID="1dbc3746cd5d761b6a241c6cabfce113f33d7da3a3333499c5b76099e6f4065d"
Oct 30 23:46:12.992012 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:46:12.991997    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dbc3746cd5d761b6a241c6cabfce113f33d7da3a3333499c5b76099e6f4065d\": container with ID starting with 1dbc3746cd5d761b6a241c6cabfce113f33d7da3a3333499c5b76099e6f4065d not found: ID does not exist" containerID="1dbc3746cd5d761b6a241c6cabfce113f33d7da3a3333499c5b76099e6f4065d"
Oct 30 23:46:12.992052 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:12.992031    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dbc3746cd5d761b6a241c6cabfce113f33d7da3a3333499c5b76099e6f4065d"} err="failed to get container status \"1dbc3746cd5d761b6a241c6cabfce113f33d7da3a3333499c5b76099e6f4065d\": rpc error: code = NotFound desc = could not find container \"1dbc3746cd5d761b6a241c6cabfce113f33d7da3a3333499c5b76099e6f4065d\": container with ID starting with 1dbc3746cd5d761b6a241c6cabfce113f33d7da3a3333499c5b76099e6f4065d not found: ID does not exist"
Oct 30 23:46:13.029868 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:13.029834    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:13.036764 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:13.036739    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:46:13.036764 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:13.036765    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bml5\" (UniqueName: \"kubernetes.io/projected/186ab5a2-2953-437c-b1a2-b883c1a32dca-kube-api-access-8bml5\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:46:13.036916 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:13.036776    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:46:13.036916 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:13.036785    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:46:13.036916 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:13.036793    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/186ab5a2-2953-437c-b1a2-b883c1a32dca-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:46:13.036916 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:13.036802    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:46:13.036916 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:13.036811    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/186ab5a2-2953-437c-b1a2-b883c1a32dca-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:46:13.036916 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:13.036819    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:46:13.036916 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:13.036827    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/186ab5a2-2953-437c-b1a2-b883c1a32dca-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:46:13.218418 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:13.218377    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:13.362719 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:13.362687    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"]
Oct 30 23:46:13.378618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:13.376910    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e4285d4a-openshift-default-8d9b959f7-bcdz9"]
Oct 30 23:46:13.968106 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:13.968069    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:14.885888 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:14.885860    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="186ab5a2-2953-437c-b1a2-b883c1a32dca" path="/var/lib/kubelet/pods/186ab5a2-2953-437c-b1a2-b883c1a32dca/volumes"
Oct 30 23:46:14.948121 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:14.948090    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:15.319285 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:15.319194    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:15.458583 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:15.458552    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:15.767003 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:15.766973    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:15.940755 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:15.937259    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:16.389620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:16.382550    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:17.062343 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:17.062211    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:17.217459 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:17.217409    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:17.420047 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:17.420012    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:17.947960 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:17.947869    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:18.306588 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:18.306511    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:18.670038 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:18.670001    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:19.723491 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:19.723441    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:20.431385 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:20.431349    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:20.571248 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:20.571195    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:20.903702 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:20.903667    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:21.667846 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.667810    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:21.732965 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.732932    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb"]
Oct 30 23:46:21.733797 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.733768    4921 cpu_manager.go:414] "containerMap: removing container" podUID="186ab5a2-2953-437c-b1a2-b883c1a32dca" containerName="istio-proxy"
Oct 30 23:46:21.733797 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.733793    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="186ab5a2-2953-437c-b1a2-b883c1a32dca" containerName="istio-proxy"
Oct 30 23:46:21.734004 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.733838    4921 cpu_manager.go:414] "containerMap: removing container" podUID="37369cd4-f379-4ed8-8826-b0828b5f4374" containerName="payload-processing"
Oct 30 23:46:21.734004 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.733843    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="37369cd4-f379-4ed8-8826-b0828b5f4374" containerName="payload-processing"
Oct 30 23:46:21.734004 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.733973    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="186ab5a2-2953-437c-b1a2-b883c1a32dca" containerName="istio-proxy"
Oct 30 23:46:21.734004 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.733986    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="37369cd4-f379-4ed8-8826-b0828b5f4374" containerName="payload-processing"
Oct 30 23:46:21.737643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.737618    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb"
Oct 30 23:46:21.744490 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.744462    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-bb25e9-dockercfg-5mkh7\""
Oct 30 23:46:21.754217 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.754177    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-bb25e9\""
Oct 30 23:46:21.761199 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.761175    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb"]
Oct 30 23:46:21.775871 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.775849    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv"]
Oct 30 23:46:21.776686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.776667    4921 cpu_manager.go:414] "containerMap: removing container" podUID="186ab5a2-2953-437c-b1a2-b883c1a32dca" containerName="istio-proxy"
Oct 30 23:46:21.776686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.776686    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="186ab5a2-2953-437c-b1a2-b883c1a32dca" containerName="istio-proxy"
Oct 30 23:46:21.776942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.776927    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="186ab5a2-2953-437c-b1a2-b883c1a32dca" containerName="istio-proxy"
Oct 30 23:46:21.780437 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.780414    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7kgw\" (UniqueName: \"kubernetes.io/projected/e41a2495-1fb4-41b2-b0df-3afea685991f-kube-api-access-l7kgw\") pod \"payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb\" (UID: \"e41a2495-1fb4-41b2-b0df-3afea685991f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb"
Oct 30 23:46:21.780773 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.780753    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e41a2495-1fb4-41b2-b0df-3afea685991f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb\" (UID: \"e41a2495-1fb4-41b2-b0df-3afea685991f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb"
Oct 30 23:46:21.781865 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.781846    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv"
Oct 30 23:46:21.786644 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.786624    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv"]
Oct 30 23:46:21.842614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:21.814903    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:22.176628 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:22.172528    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7kgw\" (UniqueName: \"kubernetes.io/projected/e41a2495-1fb4-41b2-b0df-3afea685991f-kube-api-access-l7kgw\") pod \"payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb\" (UID: \"e41a2495-1fb4-41b2-b0df-3afea685991f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb"
Oct 30 23:46:22.176628 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:22.175740    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqcdg\" (UniqueName: \"kubernetes.io/projected/4b4e1366-1342-4366-bf20-68279d532e96-kube-api-access-mqcdg\") pod \"payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv\" (UID: \"4b4e1366-1342-4366-bf20-68279d532e96\") " pod="openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv"
Oct 30 23:46:22.176628 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:22.175892    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e41a2495-1fb4-41b2-b0df-3afea685991f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb\" (UID: \"e41a2495-1fb4-41b2-b0df-3afea685991f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb"
Oct 30 23:46:22.176628 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:22.176126    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b4e1366-1342-4366-bf20-68279d532e96-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv\" (UID: \"4b4e1366-1342-4366-bf20-68279d532e96\") " pod="openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv"
Oct 30 23:46:22.194259 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:22.178552    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e41a2495-1fb4-41b2-b0df-3afea685991f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb\" (UID: \"e41a2495-1fb4-41b2-b0df-3afea685991f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb"
Oct 30 23:46:22.228615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:22.227986    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7kgw\" (UniqueName: \"kubernetes.io/projected/e41a2495-1fb4-41b2-b0df-3afea685991f-kube-api-access-l7kgw\") pod \"payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb\" (UID: \"e41a2495-1fb4-41b2-b0df-3afea685991f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb"
Oct 30 23:46:22.280226 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:22.280195    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqcdg\" (UniqueName: \"kubernetes.io/projected/4b4e1366-1342-4366-bf20-68279d532e96-kube-api-access-mqcdg\") pod \"payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv\" (UID: \"4b4e1366-1342-4366-bf20-68279d532e96\") " pod="openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv"
Oct 30 23:46:22.280386 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:22.280362    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b4e1366-1342-4366-bf20-68279d532e96-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv\" (UID: \"4b4e1366-1342-4366-bf20-68279d532e96\") " pod="openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv"
Oct 30 23:46:22.281204 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:22.281180    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b4e1366-1342-4366-bf20-68279d532e96-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv\" (UID: \"4b4e1366-1342-4366-bf20-68279d532e96\") " pod="openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv"
Oct 30 23:46:22.292975 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:22.292948    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqcdg\" (UniqueName: \"kubernetes.io/projected/4b4e1366-1342-4366-bf20-68279d532e96-kube-api-access-mqcdg\") pod \"payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv\" (UID: \"4b4e1366-1342-4366-bf20-68279d532e96\") " pod="openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv"
Oct 30 23:46:22.352692 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:22.352661    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb"
Oct 30 23:46:22.415291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:22.415257    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv"
Oct 30 23:46:22.652343 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:22.652311    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb"]
Oct 30 23:46:22.652782 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:46:22.652758    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode41a2495_1fb4_41b2_b0df_3afea685991f.slice/crio-3906b83dc03e79e934fd2dc8c8b126bd611ccf518018e118eab41ab221e52e22 WatchSource:0}: Error finding container 3906b83dc03e79e934fd2dc8c8b126bd611ccf518018e118eab41ab221e52e22: Status 404 returned error can't find the container with id 3906b83dc03e79e934fd2dc8c8b126bd611ccf518018e118eab41ab221e52e22
Oct 30 23:46:22.732641 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:22.732614    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv"]
Oct 30 23:46:22.737147 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:46:22.737120    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b4e1366_1342_4366_bf20_68279d532e96.slice/crio-0cb43d3c6e45b035e2dceb52957a8089ec2ace0996339119ddf4b7457d7e5528 WatchSource:0}: Error finding container 0cb43d3c6e45b035e2dceb52957a8089ec2ace0996339119ddf4b7457d7e5528: Status 404 returned error can't find the container with id 0cb43d3c6e45b035e2dceb52957a8089ec2ace0996339119ddf4b7457d7e5528
Oct 30 23:46:22.830712 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:22.830685    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:23.005670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:23.005564    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:23.239614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:23.233562    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb" event={"ID":"e41a2495-1fb4-41b2-b0df-3afea685991f","Type":"ContainerStarted","Data":"d1cc7e1a024e192e1b2bb692845d3ef6dbd4ed493d852740d0b6b06eebe7b078"}
Oct 30 23:46:23.239614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:23.233650    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb" event={"ID":"e41a2495-1fb4-41b2-b0df-3afea685991f","Type":"ContainerStarted","Data":"3906b83dc03e79e934fd2dc8c8b126bd611ccf518018e118eab41ab221e52e22"}
Oct 30 23:46:23.239614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:23.235073    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb"
Oct 30 23:46:23.239614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:23.237722    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv" event={"ID":"4b4e1366-1342-4366-bf20-68279d532e96","Type":"ContainerStarted","Data":"9ac9923fd5df5e48746c7309f992567f8fff898e2e1ecf9f56d16ac7aafc802d"}
Oct 30 23:46:23.239614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:23.237786    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv" event={"ID":"4b4e1366-1342-4366-bf20-68279d532e96","Type":"ContainerStarted","Data":"0cb43d3c6e45b035e2dceb52957a8089ec2ace0996339119ddf4b7457d7e5528"}
Oct 30 23:46:23.239614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:23.238735    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv"
Oct 30 23:46:23.279165 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:23.278801    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb" podStartSLOduration=2.278782109 podStartE2EDuration="2.278782109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:46:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:46:23.271904577 +0000 UTC m=+1642.516760349" watchObservedRunningTime="2026-10-30 23:46:23.278782109 +0000 UTC m=+1642.523637880"
Oct 30 23:46:23.298324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:23.298271    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv" podStartSLOduration=2.298253313 podStartE2EDuration="2.298253313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:46:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:46:23.295377975 +0000 UTC m=+1642.540233755" watchObservedRunningTime="2026-10-30 23:46:23.298253313 +0000 UTC m=+1642.543109081"
Oct 30 23:46:23.811985 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:23.811950    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:24.811814 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:24.811783    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:24.992172 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:24.992137    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:25.735559 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:25.735514    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:25.890054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:25.889788    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:26.540671 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:26.540641    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:27.246333 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:27.246299    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:27.981949 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:27.981913    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:28.734141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:28.734105    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:29.209115 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.202998    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:29.385823 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.385787    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:29.649344 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.649308    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"]
Oct 30 23:46:29.655978 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.655955    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"
Oct 30 23:46:29.667725 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.667695    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-bb25e9-serving-cert\""
Oct 30 23:46:29.674927 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.674897    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"]
Oct 30 23:46:29.732777 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.732741    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:29.748687 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.748655    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsqlf\" (UniqueName: \"kubernetes.io/projected/ea3018d7-a489-45af-856b-5ec6740e8d76-kube-api-access-jsqlf\") pod \"maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l\" (UID: \"ea3018d7-a489-45af-856b-5ec6740e8d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"
Oct 30 23:46:29.749144 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.748836    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3018d7-a489-45af-856b-5ec6740e8d76-openshift-service-ca\") pod \"maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l\" (UID: \"ea3018d7-a489-45af-856b-5ec6740e8d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"
Oct 30 23:46:29.749144 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.748904    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea3018d7-a489-45af-856b-5ec6740e8d76-metrics-certs\") pod \"maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l\" (UID: \"ea3018d7-a489-45af-856b-5ec6740e8d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"
Oct 30 23:46:29.749144 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.748945    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea3018d7-a489-45af-856b-5ec6740e8d76-maas-api-tls\") pod \"maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l\" (UID: \"ea3018d7-a489-45af-856b-5ec6740e8d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"
Oct 30 23:46:29.859615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.852878    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3018d7-a489-45af-856b-5ec6740e8d76-openshift-service-ca\") pod \"maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l\" (UID: \"ea3018d7-a489-45af-856b-5ec6740e8d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"
Oct 30 23:46:29.859615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.852967    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea3018d7-a489-45af-856b-5ec6740e8d76-metrics-certs\") pod \"maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l\" (UID: \"ea3018d7-a489-45af-856b-5ec6740e8d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"
Oct 30 23:46:29.859615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.853010    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea3018d7-a489-45af-856b-5ec6740e8d76-maas-api-tls\") pod \"maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l\" (UID: \"ea3018d7-a489-45af-856b-5ec6740e8d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"
Oct 30 23:46:29.859615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.853339    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsqlf\" (UniqueName: \"kubernetes.io/projected/ea3018d7-a489-45af-856b-5ec6740e8d76-kube-api-access-jsqlf\") pod \"maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l\" (UID: \"ea3018d7-a489-45af-856b-5ec6740e8d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"
Oct 30 23:46:29.859615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.854802    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3018d7-a489-45af-856b-5ec6740e8d76-openshift-service-ca\") pod \"maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l\" (UID: \"ea3018d7-a489-45af-856b-5ec6740e8d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"
Oct 30 23:46:29.868444 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.868410    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea3018d7-a489-45af-856b-5ec6740e8d76-metrics-certs\") pod \"maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l\" (UID: \"ea3018d7-a489-45af-856b-5ec6740e8d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"
Oct 30 23:46:29.873834 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.873804    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:29.877617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.876345    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsqlf\" (UniqueName: \"kubernetes.io/projected/ea3018d7-a489-45af-856b-5ec6740e8d76-kube-api-access-jsqlf\") pod \"maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l\" (UID: \"ea3018d7-a489-45af-856b-5ec6740e8d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"
Oct 30 23:46:29.877617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.877087    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea3018d7-a489-45af-856b-5ec6740e8d76-maas-api-tls\") pod \"maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l\" (UID: \"ea3018d7-a489-45af-856b-5ec6740e8d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"
Oct 30 23:46:29.982262 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:29.982176    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"
Oct 30 23:46:30.003574 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:30.003530    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:30.464629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:30.451938    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"]
Oct 30 23:46:31.248035 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:31.247892    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:31.423187 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:31.423146    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l" event={"ID":"ea3018d7-a489-45af-856b-5ec6740e8d76","Type":"ContainerStarted","Data":"6641a7baf5cfc2bf6dd6b8c8a128bf26e371adf93a1a3eaab697ff004d092cb1"}
Oct 30 23:46:31.423490 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:31.423464    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l" event={"ID":"ea3018d7-a489-45af-856b-5ec6740e8d76","Type":"ContainerStarted","Data":"4f075d0cbc6270f98bce97a6e0bd73d4abe8e44e6fbc92dc969dffadd6fba6f4"}
Oct 30 23:46:31.423740 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:31.423723    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"
Oct 30 23:46:32.396239 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:32.396204    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:33.380653 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:33.379881    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:34.569508 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:34.569471    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:35.256279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:35.256252    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv"
Oct 30 23:46:35.256483 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:35.256399    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb"
Oct 30 23:46:35.275062 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:35.275006    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l" podStartSLOduration=5.724936641 podStartE2EDuration="6.274993185s" totalImagesPullingTime="550.056544ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:46:31.448575789 +0000 UTC m=+1650.693431557" watchObservedRunningTime="2026-10-30 23:46:35.274993185 +0000 UTC m=+1654.519848953"
Oct 30 23:46:35.336305 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:35.336270    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:36.191939 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:36.191909    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:36.369895 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:36.369863    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:37.096954 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:37.096913    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:37.452701 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:37.452663    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"
Oct 30 23:46:37.858030 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:37.857930    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:38.730696 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:38.730654    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:39.436393 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:39.436361    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:40.133186 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:40.133063    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:40.854451 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:40.854395    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:41.408254 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:46:41.408212    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:46:41.731722 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:41.728024    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:42.726621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:42.721832    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:43.552404 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:43.552371    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:44.328242 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:44.328207    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:45.033251 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:45.033220    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:45.766328 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:45.766292    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:45.911627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:45.910068    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:46.403346 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:46.403309    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:46.537146 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:46.537053    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:46.846584 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:46.846475    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:47.436625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:47.428284    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:47.588234 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:47.588200    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:48.278578 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:48.278544    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:49.036059 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:49.036021    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:49.918014 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:49.917976    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:50.658906 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:50.658867    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:50.871255 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:50.871219    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:52.148434 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:52.148397    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:52.255250 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:52.255215    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7"]
Oct 30 23:46:52.260267 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:52.260242    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7"
Oct 30 23:46:52.275112 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:52.275072    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-b6cb71\""
Oct 30 23:46:52.278083 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:52.278060    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-b6cb71-dockercfg-qjdvh\""
Oct 30 23:46:52.297780 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:52.297739    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7"]
Oct 30 23:46:52.308307 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:52.308275    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:52.434716 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:52.411017    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e-plugins-config-volume\") pod \"payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7\" (UID: \"1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e\") " pod="openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7"
Oct 30 23:46:52.434716 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:52.411103    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf5rz\" (UniqueName: \"kubernetes.io/projected/1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e-kube-api-access-mf5rz\") pod \"payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7\" (UID: \"1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e\") " pod="openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7"
Oct 30 23:46:52.532371 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:52.532322    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e-plugins-config-volume\") pod \"payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7\" (UID: \"1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e\") " pod="openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7"
Oct 30 23:46:52.532777 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:52.532754    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf5rz\" (UniqueName: \"kubernetes.io/projected/1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e-kube-api-access-mf5rz\") pod \"payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7\" (UID: \"1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e\") " pod="openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7"
Oct 30 23:46:52.537042 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:52.537016    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e-plugins-config-volume\") pod \"payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7\" (UID: \"1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e\") " pod="openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7"
Oct 30 23:46:52.577314 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:52.577281    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf5rz\" (UniqueName: \"kubernetes.io/projected/1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e-kube-api-access-mf5rz\") pod \"payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7\" (UID: \"1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e\") " pod="openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7"
Oct 30 23:46:52.615405 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:52.614890    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7"
Oct 30 23:46:52.753156 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:52.753054    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:53.008423 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:53.008393    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7"]
Oct 30 23:46:53.008728 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:46:53.008706    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c17a3db_6f6c_4b91_ada5_c1c7e40ad28e.slice/crio-f95ea933dd47449d0ab8a16a3f8ed7dcfa9c6127888e4b55926b1dcaac719710 WatchSource:0}: Error finding container f95ea933dd47449d0ab8a16a3f8ed7dcfa9c6127888e4b55926b1dcaac719710: Status 404 returned error can't find the container with id f95ea933dd47449d0ab8a16a3f8ed7dcfa9c6127888e4b55926b1dcaac719710
Oct 30 23:46:53.044291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:53.044257    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:53.783123 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:53.783086    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7" event={"ID":"1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e","Type":"ContainerStarted","Data":"6b060dd5015b6cdae1b7d6753f45fd4698e4f8a5e24ed255116a19dc76c86365"}
Oct 30 23:46:53.783683 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:53.783157    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7"
Oct 30 23:46:53.783683 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:53.783179    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7" event={"ID":"1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e","Type":"ContainerStarted","Data":"f95ea933dd47449d0ab8a16a3f8ed7dcfa9c6127888e4b55926b1dcaac719710"}
Oct 30 23:46:53.809611 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:53.809550    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7" podStartSLOduration=1.809535172 podStartE2EDuration="1.809535172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:46:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:46:53.804216002 +0000 UTC m=+1673.049071769" watchObservedRunningTime="2026-10-30 23:46:53.809535172 +0000 UTC m=+1673.054390939"
Oct 30 23:46:53.846791 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:53.846763    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:54.649368 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:54.649328    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:55.375556 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:55.375515    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:56.014829 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:56.014798    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:56.718676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:56.718646    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:57.433042 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:57.433006    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:58.141306 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:58.141232    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:58.845780 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:58.845749    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:59.540464 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:59.540429    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:59.674726 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:59.674666    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:46:59.830888 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:46:59.830807    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:00.440796 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:00.440760    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:01.121684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:01.121646    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:02.029488 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:02.029456    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:02.874621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:02.871701    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:03.993382 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:03.993342    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:04.855950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:04.855917    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7"
Oct 30 23:47:05.170070 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:05.170038    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:06.036219 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:06.036182    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:07.027451 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:07.027414    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:08.101074 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:08.101021    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:08.831235 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:08.831198    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:09.743206 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:09.743172    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:10.726868 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:10.726839    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:11.406427 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:47:11.406387    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:47:11.722105 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:11.721967    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:12.690817 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:12.690784    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:13.418092 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:13.418060    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:14.135234 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:14.135204    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:14.902773 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:14.902729    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:15.575003 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:15.574967    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:15.906896 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:15.906848    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:16.326325 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:16.326237    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:17.144217 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:17.144155    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:17.922588 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:17.922554    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:18.719845 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:18.719782    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:19.460469 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:19.460434    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:20.463622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:20.460174    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:21.258976 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:21.258937    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:21.921302 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:21.921265    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:22.687779 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:22.687744    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:23.352656 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:23.352587    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:24.049786 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:24.049749    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:24.724177 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:24.724143    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:25.430123 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:25.430080    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:26.156899 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:26.156870    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:26.830820 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:26.830787    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:27.520048 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:27.520012    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:28.232035 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:28.232003    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:28.930143 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:28.930109    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:29.802624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:29.792100    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:30.043727 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:30.043674    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv"]
Oct 30 23:47:30.062434 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:30.062346    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb"]
Oct 30 23:47:30.145933 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:30.145902    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:30.272967 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:30.272936    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:30.915277 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:30.915239    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:31.611512 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:31.611461    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:32.468058 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:32.463821    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:33.230305 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:33.230278    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:34.076617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:34.072551    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:34.719374 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:34.719346    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:35.044484 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.044356    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv" podUID="4b4e1366-1342-4366-bf20-68279d532e96" containerName="payload-processing" containerID="cri-o://9ac9923fd5df5e48746c7309f992567f8fff898e2e1ecf9f56d16ac7aafc802d" gracePeriod=25
Oct 30 23:47:35.063156 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.063101    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb" podUID="e41a2495-1fb4-41b2-b0df-3afea685991f" containerName="payload-pre-processing" containerID="cri-o://d1cc7e1a024e192e1b2bb692845d3ef6dbd4ed493d852740d0b6b06eebe7b078" gracePeriod=25
Oct 30 23:47:35.258736 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:47:35.255717    4921 logging.go:55] [core] [Channel #1539 SubChannel #1542]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.119:50052", ServerName: "10.132.0.119:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.119:50052: connect: connection refused"
Oct 30 23:47:35.378666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.378587    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv"
Oct 30 23:47:35.420081 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.420047    4921 generic.go:356] "Generic (PLEG): container finished" podID="e41a2495-1fb4-41b2-b0df-3afea685991f" containerID="d1cc7e1a024e192e1b2bb692845d3ef6dbd4ed493d852740d0b6b06eebe7b078" exitCode=0
Oct 30 23:47:35.420550 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.420493    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb" event={"ID":"e41a2495-1fb4-41b2-b0df-3afea685991f","Type":"ContainerDied","Data":"d1cc7e1a024e192e1b2bb692845d3ef6dbd4ed493d852740d0b6b06eebe7b078"}
Oct 30 23:47:35.420738 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.420581    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb" event={"ID":"e41a2495-1fb4-41b2-b0df-3afea685991f","Type":"ContainerDied","Data":"3906b83dc03e79e934fd2dc8c8b126bd611ccf518018e118eab41ab221e52e22"}
Oct 30 23:47:35.420738 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.420674    4921 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3906b83dc03e79e934fd2dc8c8b126bd611ccf518018e118eab41ab221e52e22"
Oct 30 23:47:35.425611 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.422478    4921 generic.go:356] "Generic (PLEG): container finished" podID="4b4e1366-1342-4366-bf20-68279d532e96" containerID="9ac9923fd5df5e48746c7309f992567f8fff898e2e1ecf9f56d16ac7aafc802d" exitCode=0
Oct 30 23:47:35.425611 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.422507    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv" event={"ID":"4b4e1366-1342-4366-bf20-68279d532e96","Type":"ContainerDied","Data":"9ac9923fd5df5e48746c7309f992567f8fff898e2e1ecf9f56d16ac7aafc802d"}
Oct 30 23:47:35.425611 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.422574    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv" event={"ID":"4b4e1366-1342-4366-bf20-68279d532e96","Type":"ContainerDied","Data":"0cb43d3c6e45b035e2dceb52957a8089ec2ace0996339119ddf4b7457d7e5528"}
Oct 30 23:47:35.425611 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.422633    4921 scope.go:122] "RemoveContainer" containerID="9ac9923fd5df5e48746c7309f992567f8fff898e2e1ecf9f56d16ac7aafc802d"
Oct 30 23:47:35.425611 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.422974    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv"
Oct 30 23:47:35.432619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.431712    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4b4e1366-1342-4366-bf20-68279d532e96-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b4e1366-1342-4366-bf20-68279d532e96-plugins-config-volume\") pod \"4b4e1366-1342-4366-bf20-68279d532e96\" (UID: \"4b4e1366-1342-4366-bf20-68279d532e96\") "
Oct 30 23:47:35.432619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.431988    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4b4e1366-1342-4366-bf20-68279d532e96-kube-api-access-mqcdg\" (UniqueName: \"kubernetes.io/projected/4b4e1366-1342-4366-bf20-68279d532e96-kube-api-access-mqcdg\") pod \"4b4e1366-1342-4366-bf20-68279d532e96\" (UID: \"4b4e1366-1342-4366-bf20-68279d532e96\") "
Oct 30 23:47:35.432619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.432209    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b4e1366-1342-4366-bf20-68279d532e96-plugins-config-volume" pod "4b4e1366-1342-4366-bf20-68279d532e96" (UID: "4b4e1366-1342-4366-bf20-68279d532e96"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:47:35.435853 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.432948    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b4e1366-1342-4366-bf20-68279d532e96-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:47:35.435853 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.435019    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b4e1366-1342-4366-bf20-68279d532e96-kube-api-access-mqcdg" pod "4b4e1366-1342-4366-bf20-68279d532e96" (UID: "4b4e1366-1342-4366-bf20-68279d532e96"). InnerVolumeSpecName "kube-api-access-mqcdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:47:35.437314 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.437292    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb"
Oct 30 23:47:35.446902 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.446881    4921 scope.go:122] "RemoveContainer" containerID="9ac9923fd5df5e48746c7309f992567f8fff898e2e1ecf9f56d16ac7aafc802d"
Oct 30 23:47:35.447231 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:47:35.447211    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ac9923fd5df5e48746c7309f992567f8fff898e2e1ecf9f56d16ac7aafc802d\": container with ID starting with 9ac9923fd5df5e48746c7309f992567f8fff898e2e1ecf9f56d16ac7aafc802d not found: ID does not exist" containerID="9ac9923fd5df5e48746c7309f992567f8fff898e2e1ecf9f56d16ac7aafc802d"
Oct 30 23:47:35.447298 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.447238    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ac9923fd5df5e48746c7309f992567f8fff898e2e1ecf9f56d16ac7aafc802d"} err="failed to get container status \"9ac9923fd5df5e48746c7309f992567f8fff898e2e1ecf9f56d16ac7aafc802d\": rpc error: code = NotFound desc = could not find container \"9ac9923fd5df5e48746c7309f992567f8fff898e2e1ecf9f56d16ac7aafc802d\": container with ID starting with 9ac9923fd5df5e48746c7309f992567f8fff898e2e1ecf9f56d16ac7aafc802d not found: ID does not exist"
Oct 30 23:47:35.533670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.533639    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e41a2495-1fb4-41b2-b0df-3afea685991f-kube-api-access-l7kgw\" (UniqueName: \"kubernetes.io/projected/e41a2495-1fb4-41b2-b0df-3afea685991f-kube-api-access-l7kgw\") pod \"e41a2495-1fb4-41b2-b0df-3afea685991f\" (UID: \"e41a2495-1fb4-41b2-b0df-3afea685991f\") "
Oct 30 23:47:35.533861 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.533731    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e41a2495-1fb4-41b2-b0df-3afea685991f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e41a2495-1fb4-41b2-b0df-3afea685991f-plugins-config-volume\") pod \"e41a2495-1fb4-41b2-b0df-3afea685991f\" (UID: \"e41a2495-1fb4-41b2-b0df-3afea685991f\") "
Oct 30 23:47:35.534129 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.534103    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e41a2495-1fb4-41b2-b0df-3afea685991f-plugins-config-volume" pod "e41a2495-1fb4-41b2-b0df-3afea685991f" (UID: "e41a2495-1fb4-41b2-b0df-3afea685991f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:47:35.534410 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.534391    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqcdg\" (UniqueName: \"kubernetes.io/projected/4b4e1366-1342-4366-bf20-68279d532e96-kube-api-access-mqcdg\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:47:35.534452 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.534414    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e41a2495-1fb4-41b2-b0df-3afea685991f-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:47:35.536045 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.536028    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e41a2495-1fb4-41b2-b0df-3afea685991f-kube-api-access-l7kgw" pod "e41a2495-1fb4-41b2-b0df-3afea685991f" (UID: "e41a2495-1fb4-41b2-b0df-3afea685991f"). InnerVolumeSpecName "kube-api-access-l7kgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:47:35.548909 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.548881    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:35.644823 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.643871    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7kgw\" (UniqueName: \"kubernetes.io/projected/e41a2495-1fb4-41b2-b0df-3afea685991f-kube-api-access-l7kgw\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:47:35.750762 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.750734    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv"]
Oct 30 23:47:35.754763 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:35.754736    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv"]
Oct 30 23:47:36.242188 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:36.242152    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:36.262708 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:36.255150    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-api-a-bb25e9-59fd677889-wltkv" podUID="4b4e1366-1342-4366-bf20-68279d532e96" containerName="payload-processing" probeResult="failure" output="timeout: failed to connect service \"10.132.0.120:50052\" within 1s: context deadline exceeded"
Oct 30 23:47:36.262708 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:47:36.255612    4921 logging.go:55] [core] [Channel #1540 SubChannel #1541]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.120:50052", ServerName: "10.132.0.120:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.120:50052: operation was canceled"
Oct 30 23:47:36.262708 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:36.256075    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb" podUID="e41a2495-1fb4-41b2-b0df-3afea685991f" containerName="payload-pre-processing" probeResult="failure" output="timeout: failed to connect service \"10.132.0.119:50052\" within 1s: context deadline exceeded"
Oct 30 23:47:36.262708 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:47:36.256205    4921 logging.go:55] [core] [Channel #1539 SubChannel #1542]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.119:50052", ServerName: "10.132.0.119:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.119:50052: operation was canceled"
Oct 30 23:47:36.431472 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:36.431447    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb"
Oct 30 23:47:36.468969 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:36.468941    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb"]
Oct 30 23:47:36.472921 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:36.472899    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bb25e9-5b79759595-rp5sb"]
Oct 30 23:47:36.885120 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:36.885093    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4b4e1366-1342-4366-bf20-68279d532e96" path="/var/lib/kubelet/pods/4b4e1366-1342-4366-bf20-68279d532e96/volumes"
Oct 30 23:47:36.885546 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:36.885531    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e41a2495-1fb4-41b2-b0df-3afea685991f" path="/var/lib/kubelet/pods/e41a2495-1fb4-41b2-b0df-3afea685991f/volumes"
Oct 30 23:47:37.015580 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:37.015544    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:37.825718 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:37.825686    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:38.553789 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:38.553750    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:39.237644 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:39.237571    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:39.916292 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:39.916261    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:40.652623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:40.649541    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:41.408720 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:47:41.408682    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:47:41.494499 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:41.494464    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:42.339098 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:42.339047    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:43.113714 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:43.113676    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:43.793514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:43.793465    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:44.456994 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:44.456953    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:45.143171 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:45.143130    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:45.834382 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:45.834339    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:46.531750 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:46.531709    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:47.304087 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:47.304053    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"]
Oct 30 23:47:47.304643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:47.304244    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l" podUID="ea3018d7-a489-45af-856b-5ec6740e8d76" containerName="maas-api" containerID="cri-o://6641a7baf5cfc2bf6dd6b8c8a128bf26e371adf93a1a3eaab697ff004d092cb1" gracePeriod=30
Oct 30 23:47:47.338317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:47.338195    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:47.447312 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:47.447262    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l" podUID="ea3018d7-a489-45af-856b-5ec6740e8d76" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.121:8443/health\": dial tcp 10.132.0.121:8443: connect: connection refused"
Oct 30 23:47:47.786030 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:47.785949    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:47.925457 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:47.925420    4921 generic.go:356] "Generic (PLEG): container finished" podID="ea3018d7-a489-45af-856b-5ec6740e8d76" containerID="6641a7baf5cfc2bf6dd6b8c8a128bf26e371adf93a1a3eaab697ff004d092cb1" exitCode=0
Oct 30 23:47:47.925969 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:47.925943    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l" event={"ID":"ea3018d7-a489-45af-856b-5ec6740e8d76","Type":"ContainerDied","Data":"6641a7baf5cfc2bf6dd6b8c8a128bf26e371adf93a1a3eaab697ff004d092cb1"}
Oct 30 23:47:47.931264 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:47.931234    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:48.043702 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.043635    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"
Oct 30 23:47:48.088624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.087009    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:48.089561 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.089529    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea3018d7-a489-45af-856b-5ec6740e8d76-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea3018d7-a489-45af-856b-5ec6740e8d76-metrics-certs\") pod \"ea3018d7-a489-45af-856b-5ec6740e8d76\" (UID: \"ea3018d7-a489-45af-856b-5ec6740e8d76\") "
Oct 30 23:47:48.122616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.113443    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea3018d7-a489-45af-856b-5ec6740e8d76-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea3018d7-a489-45af-856b-5ec6740e8d76-maas-api-tls\") pod \"ea3018d7-a489-45af-856b-5ec6740e8d76\" (UID: \"ea3018d7-a489-45af-856b-5ec6740e8d76\") "
Oct 30 23:47:48.122616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.113763    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea3018d7-a489-45af-856b-5ec6740e8d76-metrics-certs" pod "ea3018d7-a489-45af-856b-5ec6740e8d76" (UID: "ea3018d7-a489-45af-856b-5ec6740e8d76"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:47:48.122616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.114275    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ea3018d7-a489-45af-856b-5ec6740e8d76-kube-api-access-jsqlf\" (UniqueName: \"kubernetes.io/projected/ea3018d7-a489-45af-856b-5ec6740e8d76-kube-api-access-jsqlf\") pod \"ea3018d7-a489-45af-856b-5ec6740e8d76\" (UID: \"ea3018d7-a489-45af-856b-5ec6740e8d76\") "
Oct 30 23:47:48.122616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.114437    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ea3018d7-a489-45af-856b-5ec6740e8d76-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3018d7-a489-45af-856b-5ec6740e8d76-openshift-service-ca\") pod \"ea3018d7-a489-45af-856b-5ec6740e8d76\" (UID: \"ea3018d7-a489-45af-856b-5ec6740e8d76\") "
Oct 30 23:47:48.122616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.117233    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea3018d7-a489-45af-856b-5ec6740e8d76-openshift-service-ca" pod "ea3018d7-a489-45af-856b-5ec6740e8d76" (UID: "ea3018d7-a489-45af-856b-5ec6740e8d76"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:47:48.122616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.117538    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea3018d7-a489-45af-856b-5ec6740e8d76-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:47:48.122616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.120063    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea3018d7-a489-45af-856b-5ec6740e8d76-kube-api-access-jsqlf" pod "ea3018d7-a489-45af-856b-5ec6740e8d76" (UID: "ea3018d7-a489-45af-856b-5ec6740e8d76"). InnerVolumeSpecName "kube-api-access-jsqlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:47:48.147096 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.123893    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea3018d7-a489-45af-856b-5ec6740e8d76-maas-api-tls" pod "ea3018d7-a489-45af-856b-5ec6740e8d76" (UID: "ea3018d7-a489-45af-856b-5ec6740e8d76"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:47:48.236370 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.236336    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea3018d7-a489-45af-856b-5ec6740e8d76-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:47:48.236370 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.236371    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsqlf\" (UniqueName: \"kubernetes.io/projected/ea3018d7-a489-45af-856b-5ec6740e8d76-kube-api-access-jsqlf\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:47:48.236578 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.236386    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3018d7-a489-45af-856b-5ec6740e8d76-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:47:48.496800 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.496767    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:48.631506 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.631465    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:48.769961 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.769876    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:48.935037 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.935006    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l" event={"ID":"ea3018d7-a489-45af-856b-5ec6740e8d76","Type":"ContainerDied","Data":"4f075d0cbc6270f98bce97a6e0bd73d4abe8e44e6fbc92dc969dffadd6fba6f4"}
Oct 30 23:47:48.935208 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.935043    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"
Oct 30 23:47:48.935208 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.935069    4921 scope.go:122] "RemoveContainer" containerID="6641a7baf5cfc2bf6dd6b8c8a128bf26e371adf93a1a3eaab697ff004d092cb1"
Oct 30 23:47:48.955683 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.955658    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"]
Oct 30 23:47:48.959789 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:48.959765    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bb25e9-54b684bb86-mmp5l"]
Oct 30 23:47:49.064007 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:49.063938    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:49.372046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:49.371949    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:49.848784 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:49.848754    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:50.548053 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:50.548015    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:50.885469 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:50.885441    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ea3018d7-a489-45af-856b-5ec6740e8d76" path="/var/lib/kubelet/pods/ea3018d7-a489-45af-856b-5ec6740e8d76/volumes"
Oct 30 23:47:51.239976 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:51.239897    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:51.916161 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:51.916131    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:52.664311 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:52.660967    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:52.922676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:52.922156    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:53.416378 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.416340    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:53.559822 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.559779    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:53.895893 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.895856    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"]
Oct 30 23:47:53.897502 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.897442    4921 cpu_manager.go:414] "containerMap: removing container" podUID="e41a2495-1fb4-41b2-b0df-3afea685991f" containerName="payload-pre-processing"
Oct 30 23:47:53.897502 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.897498    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e41a2495-1fb4-41b2-b0df-3afea685991f" containerName="payload-pre-processing"
Oct 30 23:47:53.897783 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.897660    4921 cpu_manager.go:414] "containerMap: removing container" podUID="ea3018d7-a489-45af-856b-5ec6740e8d76" containerName="maas-api"
Oct 30 23:47:53.897783 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.897668    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ea3018d7-a489-45af-856b-5ec6740e8d76" containerName="maas-api"
Oct 30 23:47:53.897783 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.897683    4921 cpu_manager.go:414] "containerMap: removing container" podUID="4b4e1366-1342-4366-bf20-68279d532e96" containerName="payload-processing"
Oct 30 23:47:53.897783 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.897687    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4b4e1366-1342-4366-bf20-68279d532e96" containerName="payload-processing"
Oct 30 23:47:53.898010 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.897841    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="ea3018d7-a489-45af-856b-5ec6740e8d76" containerName="maas-api"
Oct 30 23:47:53.898010 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.897852    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="4b4e1366-1342-4366-bf20-68279d532e96" containerName="payload-processing"
Oct 30 23:47:53.898010 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.897860    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="e41a2495-1fb4-41b2-b0df-3afea685991f" containerName="payload-pre-processing"
Oct 30 23:47:53.901798 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.901777    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:53.908122 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.908096    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-200408-openshift-default-dockercfg-rzm4l\""
Oct 30 23:47:53.912859 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.912836    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"]
Oct 30 23:47:53.977738 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.977192    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:54.004617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.993799    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2srr7\" (UniqueName: \"kubernetes.io/projected/4f146534-bcab-407d-ad28-d9528ca641c3-kube-api-access-2srr7\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.004617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.993867    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f146534-bcab-407d-ad28-d9528ca641c3-istio-podinfo\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.004617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.993990    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-workload-certs\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.004617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.994050    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f146534-bcab-407d-ad28-d9528ca641c3-istio-token\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.004617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.994112    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-credential-socket\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.004617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.994136    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-istio-envoy\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.004617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.994261    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-workload-socket\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.004617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.994288    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f146534-bcab-407d-ad28-d9528ca641c3-istiod-ca-cert\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.004617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:53.994418    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-istio-data\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.110038 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.105315    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-workload-certs\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.110038 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.105396    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f146534-bcab-407d-ad28-d9528ca641c3-istio-token\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.110038 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.105461    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-credential-socket\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.110038 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.105482    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-istio-envoy\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.110038 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.105619    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-workload-socket\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.110038 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.105645    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f146534-bcab-407d-ad28-d9528ca641c3-istiod-ca-cert\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.110038 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.105771    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-istio-data\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.110038 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.105865    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2srr7\" (UniqueName: \"kubernetes.io/projected/4f146534-bcab-407d-ad28-d9528ca641c3-kube-api-access-2srr7\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.110038 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.105900    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f146534-bcab-407d-ad28-d9528ca641c3-istio-podinfo\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.121730 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.112633    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-workload-certs\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.121730 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.112899    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-credential-socket\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.121730 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.113624    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f146534-bcab-407d-ad28-d9528ca641c3-istiod-ca-cert\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.121730 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.113890    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-workload-socket\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.121730 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.114208    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-istio-data\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.172705 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.154877    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-istio-envoy\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.199386 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.199350    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f146534-bcab-407d-ad28-d9528ca641c3-istio-podinfo\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.229530 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.229459    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2srr7\" (UniqueName: \"kubernetes.io/projected/4f146534-bcab-407d-ad28-d9528ca641c3-kube-api-access-2srr7\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.269621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.268745    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f146534-bcab-407d-ad28-d9528ca641c3-istio-token\") pod \"e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") " pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.519728 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.515492    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:54.520709 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.520683    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:54.834857 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.834774    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:54.961311 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.961275    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:47:54.961625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.961578    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:47:54.961814 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.961793    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:47:54.967753 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:54.967731    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"]
Oct 30 23:47:55.199562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:55.199533    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv" event={"ID":"4f146534-bcab-407d-ad28-d9528ca641c3","Type":"ContainerStarted","Data":"8e79abb0b84797a86b7b15786064306fe8b99fae712da6e1f57102470c34b679"}
Oct 30 23:47:55.200042 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:55.199586    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv" event={"ID":"4f146534-bcab-407d-ad28-d9528ca641c3","Type":"ContainerStarted","Data":"ddbf6ae8ff833a696dbd7a3e95c495487336e9e0660dbf7c84e023c450bcc5ed"}
Oct 30 23:47:55.226298 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:55.226245    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv" podStartSLOduration=2.22623015 podStartE2EDuration="2.22623015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:47:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:47:55.222858784 +0000 UTC m=+1734.467714554" watchObservedRunningTime="2026-10-30 23:47:55.22623015 +0000 UTC m=+1734.471085918"
Oct 30 23:47:55.531781 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:55.526415    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:55.938070 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:55.936012    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:56.527298 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:56.527262    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:56.790848 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:56.790757    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:56.939211 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:56.939166    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:57.083940 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.083865    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:57.169165 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.169129    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"]
Oct 30 23:47:57.183918 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.183867    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.191303 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.191278    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w0-4e6c3b-openshift-default-dockercfg-dsqsn\""
Oct 30 23:47:57.193542 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.193468    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"]
Oct 30 23:47:57.215409 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.215388    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:57.218655 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.218634    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:47:57.225725 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.225699    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-data\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.225856 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.225729    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-podinfo\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.225923 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.225889    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4993a595-ab1b-49b4-bb75-3efa3f127527-istiod-ca-cert\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.225982 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.225954    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-envoy\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.226039 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.226029    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-workload-socket\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.226093 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.226053    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-credential-socket\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.226161 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.226141    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fw7g\" (UniqueName: \"kubernetes.io/projected/4993a595-ab1b-49b4-bb75-3efa3f127527-kube-api-access-9fw7g\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.226254 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.226238    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-workload-certs\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.226320 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.226305    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-token\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.272641 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.272456    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:57.351695 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.350983    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-workload-socket\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.351695 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.351030    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-credential-socket\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.351695 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.351132    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fw7g\" (UniqueName: \"kubernetes.io/projected/4993a595-ab1b-49b4-bb75-3efa3f127527-kube-api-access-9fw7g\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.351695 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.351228    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-workload-certs\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.351695 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.351687    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-workload-certs\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.352098 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.352002    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-credential-socket\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.352212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.352188    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-token\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.352279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.352261    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-workload-socket\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.352633 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.352564    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-data\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.352633 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.352621    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-podinfo\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.352793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.352760    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4993a595-ab1b-49b4-bb75-3efa3f127527-istiod-ca-cert\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.352861 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.352846    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-envoy\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.355632 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.355570    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-data\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.356282 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.356254    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4993a595-ab1b-49b4-bb75-3efa3f127527-istiod-ca-cert\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.366122 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.366091    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-token\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.395465 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.395398    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-envoy\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.396183 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.396156    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-podinfo\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.397520 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.397496    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fw7g\" (UniqueName: \"kubernetes.io/projected/4993a595-ab1b-49b4-bb75-3efa3f127527-kube-api-access-9fw7g\") pod \"e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") " pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.475623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.451338    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:57.522622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.519400    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:57.708623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:57.708053    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:58.173451 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:47:58.173423    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4993a595_ab1b_49b4_bb75_3efa3f127527.slice/crio-c59bc5c0f2e205bf6d01b88f2a329ab0e68c70c63c8b16cd8ababd150e0b1a45 WatchSource:0}: Error finding container c59bc5c0f2e205bf6d01b88f2a329ab0e68c70c63c8b16cd8ababd150e0b1a45: Status 404 returned error can't find the container with id c59bc5c0f2e205bf6d01b88f2a329ab0e68c70c63c8b16cd8ababd150e0b1a45
Oct 30 23:47:58.173553 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:58.173454    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"]
Oct 30 23:47:58.176434 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:58.176401    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:47:58.176861 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:58.176467    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:47:58.176861 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:58.176499    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:47:58.226030 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:58.226002    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t" event={"ID":"4993a595-ab1b-49b4-bb75-3efa3f127527","Type":"ContainerStarted","Data":"c59bc5c0f2e205bf6d01b88f2a329ab0e68c70c63c8b16cd8ababd150e0b1a45"}
Oct 30 23:47:58.459685 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:58.452697    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:58.612520 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:58.612480    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:58.848774 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:58.848693    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:58.893902 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:58.893871    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr"]
Oct 30 23:47:58.898657 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:58.898636    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr"
Oct 30 23:47:58.905501 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:58.904390    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-200408\""
Oct 30 23:47:58.905501 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:58.904703    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-200408-dockercfg-zpwrj\""
Oct 30 23:47:58.908662 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:58.908644    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr"]
Oct 30 23:47:58.919280 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:58.919227    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4wfl\" (UniqueName: \"kubernetes.io/projected/167cafe8-5356-4cec-9841-87d4abdd6e4f-kube-api-access-j4wfl\") pod \"payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr\" (UID: \"167cafe8-5356-4cec-9841-87d4abdd6e4f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr"
Oct 30 23:47:58.919440 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:58.919385    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/167cafe8-5356-4cec-9841-87d4abdd6e4f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr\" (UID: \"167cafe8-5356-4cec-9841-87d4abdd6e4f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr"
Oct 30 23:47:58.989557 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:58.989518    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:59.050619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:59.049488    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4wfl\" (UniqueName: \"kubernetes.io/projected/167cafe8-5356-4cec-9841-87d4abdd6e4f-kube-api-access-j4wfl\") pod \"payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr\" (UID: \"167cafe8-5356-4cec-9841-87d4abdd6e4f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr"
Oct 30 23:47:59.063622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:59.061095    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/167cafe8-5356-4cec-9841-87d4abdd6e4f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr\" (UID: \"167cafe8-5356-4cec-9841-87d4abdd6e4f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr"
Oct 30 23:47:59.063622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:59.062228    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/167cafe8-5356-4cec-9841-87d4abdd6e4f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr\" (UID: \"167cafe8-5356-4cec-9841-87d4abdd6e4f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr"
Oct 30 23:47:59.164624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:59.148356    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4wfl\" (UniqueName: \"kubernetes.io/projected/167cafe8-5356-4cec-9841-87d4abdd6e4f-kube-api-access-j4wfl\") pod \"payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr\" (UID: \"167cafe8-5356-4cec-9841-87d4abdd6e4f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr"
Oct 30 23:47:59.433190 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:59.432609    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr"
Oct 30 23:47:59.474800 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:59.471067    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t" event={"ID":"4993a595-ab1b-49b4-bb75-3efa3f127527","Type":"ContainerStarted","Data":"f1802b43c1ae5d798d2066d9b5191bd5c35fe5f9bd6d6c2744f48323b009c445"}
Oct 30 23:47:59.508420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:59.508373    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t" podStartSLOduration=2.508358269 podStartE2EDuration="2.508358269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:47:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:47:59.503546628 +0000 UTC m=+1738.748402396" watchObservedRunningTime="2026-10-30 23:47:59.508358269 +0000 UTC m=+1738.753214091"
Oct 30 23:47:59.525968 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:59.525942    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:59.535341 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:59.535184    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:47:59.778872 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:59.778793    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:47:59.801569 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:59.800644    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr"]
Oct 30 23:47:59.845658 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:47:59.844222    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod167cafe8_5356_4cec_9841_87d4abdd6e4f.slice/crio-f0b15a9a58b34043dd93a64cfdad0454ce6005f0ec3916c26294297d5cb1ddda WatchSource:0}: Error finding container f0b15a9a58b34043dd93a64cfdad0454ce6005f0ec3916c26294297d5cb1ddda: Status 404 returned error can't find the container with id f0b15a9a58b34043dd93a64cfdad0454ce6005f0ec3916c26294297d5cb1ddda
Oct 30 23:47:59.962379 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:47:59.962345    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:00.331332 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.331298    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"]
Oct 30 23:48:00.336654 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.336629    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.341007 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.340984    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-2ccd42-openshift-default-dockercfg-qcc6m\""
Oct 30 23:48:00.356567 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.356541    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"]
Oct 30 23:48:00.440283 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.439873    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:00.647756 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.643741    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:00.787646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.754178    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-workload-socket\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.787646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.754479    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-envoy\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.787646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.754719    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-workload-certs\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.787646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.754832    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj4ms\" (UniqueName: \"kubernetes.io/projected/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-kube-api-access-cj4ms\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.787646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.754930    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istiod-ca-cert\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.787646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.755000    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-credential-socket\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.787646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.755123    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-podinfo\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.787646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.755198    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-data\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.787646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.755241    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-token\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.903754 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.903572    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-workload-socket\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.903946 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.903756    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-envoy\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.905346 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.904023    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-workload-certs\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.905346 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.904126    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj4ms\" (UniqueName: \"kubernetes.io/projected/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-kube-api-access-cj4ms\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.905346 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.904193    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istiod-ca-cert\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.905346 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.904248    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-credential-socket\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.905346 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.904348    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-podinfo\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.905346 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.904413    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-data\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.905346 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.904541    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-token\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.908317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.908293    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-workload-socket\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.932300 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.931945    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-data\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.962937 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.936087    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-workload-certs\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.962937 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.937394    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istiod-ca-cert\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:00.962937 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:00.937691    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-credential-socket\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:01.025584 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:01.025552    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-envoy\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:01.040715 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:01.040682    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-podinfo\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:01.041351 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:01.041328    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-token\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:01.042826 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:01.042788    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj4ms\" (UniqueName: \"kubernetes.io/projected/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-kube-api-access-cj4ms\") pod \"e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") " pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:01.069619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:01.069135    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr" event={"ID":"167cafe8-5356-4cec-9841-87d4abdd6e4f","Type":"ContainerStarted","Data":"8bbabd566c41a8713ac0f90b1c9739f867d4f08c2a09544095b90062c937dbb2"}
Oct 30 23:48:01.069619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:01.069206    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr" event={"ID":"167cafe8-5356-4cec-9841-87d4abdd6e4f","Type":"ContainerStarted","Data":"f0b15a9a58b34043dd93a64cfdad0454ce6005f0ec3916c26294297d5cb1ddda"}
Oct 30 23:48:01.069619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:01.069229    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:48:01.069619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:01.069247    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr"
Oct 30 23:48:01.069619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:01.069286    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:48:01.084308 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:01.084252    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr" podStartSLOduration=3.084235043 podStartE2EDuration="3.084235043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:47:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:01.078672005 +0000 UTC m=+1740.323527777" watchObservedRunningTime="2026-10-30 23:48:01.084235043 +0000 UTC m=+1740.329090813"
Oct 30 23:48:01.250154 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:01.250067    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:01.265028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:01.264978    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-2ccd42-openshift-default-dockercfg-qcc6m\""
Oct 30 23:48:01.276406 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:01.276112    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:01.735218 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:01.735189    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"]
Oct 30 23:48:01.735708 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:48:01.735680    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76cc079f_13e3_4159_b6f5_ca36d2b3a56a.slice/crio-0f48afe610f6da2f514febc25727ea3d2f55287dc4ba67b72727ca529f6f34d6 WatchSource:0}: Error finding container 0f48afe610f6da2f514febc25727ea3d2f55287dc4ba67b72727ca529f6f34d6: Status 404 returned error can't find the container with id 0f48afe610f6da2f514febc25727ea3d2f55287dc4ba67b72727ca529f6f34d6
Oct 30 23:48:01.738872 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:01.738834    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:48:01.738956 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:01.738911    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:48:01.738956 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:01.738942    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:48:01.880165 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:01.880123    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:02.019495 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:02.019450    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:02.049855 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:02.049761    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977" event={"ID":"76cc079f-13e3-4159-b6f5-ca36d2b3a56a","Type":"ContainerStarted","Data":"2cb64be2c9e0c6f67320cd0a71347c103a1b6c66acfe3ffc415d1a3be0fbab5f"}
Oct 30 23:48:02.049855 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:02.049835    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977" event={"ID":"76cc079f-13e3-4159-b6f5-ca36d2b3a56a","Type":"ContainerStarted","Data":"0f48afe610f6da2f514febc25727ea3d2f55287dc4ba67b72727ca529f6f34d6"}
Oct 30 23:48:02.084933 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:02.084874    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977" podStartSLOduration=2.084853276 podStartE2EDuration="2.084853276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:02.079323432 +0000 UTC m=+1741.324179201" watchObservedRunningTime="2026-10-30 23:48:02.084853276 +0000 UTC m=+1741.329709044"
Oct 30 23:48:02.283619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:02.282327    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:02.283619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:02.282658    4921 patch_prober.go:29] interesting pod/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 23:48:02.283619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:02.282879    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977" podUID="76cc079f-13e3-4159-b6f5-ca36d2b3a56a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 23:48:02.408390 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:02.408347    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:03.178821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:03.178785    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:03.285067 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:03.285029    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:03.327944 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:03.327907    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:03.976457 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:03.976426    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:04.118345 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:04.114873    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:04.118829 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:04.118803    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:48:05.003514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:05.003481    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:05.184442 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:05.184400    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:06.361369 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:06.361336    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:06.530982 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:06.530941    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:06.720224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:06.720184    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:06.867619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:06.853152    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:07.485616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:07.479295    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:08.034977 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:08.034941    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7"]
Oct 30 23:48:08.168693 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:08.168581    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:08.459619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:08.459067    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:09.127274 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:09.127242    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:09.989618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:09.987329    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:10.748363 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:10.748327    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:10.904614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:10.898475    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:11.652339 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:48:11.652012    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:48:11.863292 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:11.863256    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:12.053326 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:12.053251    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr"
Oct 30 23:48:12.117422 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:12.117385    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"]
Oct 30 23:48:12.118110 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:12.117696    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd" podUID="f91240cc-16c4-406a-9db3-4f40de05e354" containerName="istio-proxy" containerID="cri-o://2da398b05d2e817f96d3d076abd29e78054787cabf09d10664a8e6ba11723e46" gracePeriod=30
Oct 30 23:48:12.124262 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:12.124239    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"]
Oct 30 23:48:12.124434 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:12.124411    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9" podUID="59a6ba32-e3e0-479f-8e87-5ee77a926503" containerName="istio-proxy" containerID="cri-o://f11abe114195eeffa8f96f1a5edfc97fda4205dec526c07d1abe5220ed7fafa6" gracePeriod=30
Oct 30 23:48:12.128918 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:12.128890    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"]
Oct 30 23:48:12.129132 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:12.129108    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy" containerID="cri-o://43f8a81d78c6283c5ae2fd4748b6da54bb144ae32ef1272fdaca92176bf5eec0" gracePeriod=30
Oct 30 23:48:12.441428 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:12.441394    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:48:12.441655 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:12.441452    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:48:12.828683 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:12.814914    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:13.035536 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:13.035482    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7" podUID="1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e" containerName="payload-processing" containerID="cri-o://6b060dd5015b6cdae1b7d6753f45fd4698e4f8a5e24ed255116a19dc76c86365" gracePeriod=25
Oct 30 23:48:13.296380 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:13.296349    4921 generic.go:356] "Generic (PLEG): container finished" podID="1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e" containerID="6b060dd5015b6cdae1b7d6753f45fd4698e4f8a5e24ed255116a19dc76c86365" exitCode=0
Oct 30 23:48:13.296674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:13.296653    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7" event={"ID":"1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e","Type":"ContainerDied","Data":"6b060dd5015b6cdae1b7d6753f45fd4698e4f8a5e24ed255116a19dc76c86365"}
Oct 30 23:48:13.468696 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:13.468669    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7"
Oct 30 23:48:13.502288 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:13.502256    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e-plugins-config-volume\") pod \"1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e\" (UID: \"1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e\") "
Oct 30 23:48:13.502659 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:13.502607    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e-kube-api-access-mf5rz\" (UniqueName: \"kubernetes.io/projected/1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e-kube-api-access-mf5rz\") pod \"1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e\" (UID: \"1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e\") "
Oct 30 23:48:13.502750 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:13.502660    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e-plugins-config-volume" pod "1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e" (UID: "1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:48:13.503428 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:13.503409    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:13.505530 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:13.505505    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e-kube-api-access-mf5rz" pod "1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e" (UID: "1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e"). InnerVolumeSpecName "kube-api-access-mf5rz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:13.605314 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:13.605273    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mf5rz\" (UniqueName: \"kubernetes.io/projected/1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e-kube-api-access-mf5rz\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:13.885708 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:13.872194    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:14.080334 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:14.080301    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd"]
Oct 30 23:48:14.175129 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:14.175025    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:14.297807 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:14.297760    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:14.305472 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:14.305438    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7" event={"ID":"1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e","Type":"ContainerDied","Data":"f95ea933dd47449d0ab8a16a3f8ed7dcfa9c6127888e4b55926b1dcaac719710"}
Oct 30 23:48:14.305640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:14.305497    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7"
Oct 30 23:48:14.305640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:14.305499    4921 scope.go:122] "RemoveContainer" containerID="6b060dd5015b6cdae1b7d6753f45fd4698e4f8a5e24ed255116a19dc76c86365"
Oct 30 23:48:14.331915 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:14.331890    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7"]
Oct 30 23:48:14.339995 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:14.339962    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b6cb71-6bf88d6f79-78kz7"]
Oct 30 23:48:14.885437 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:14.885405    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e" path="/var/lib/kubelet/pods/1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e/volumes"
Oct 30 23:48:14.918552 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:14.918511    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"]
Oct 30 23:48:14.919701 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:14.919675    4921 cpu_manager.go:414] "containerMap: removing container" podUID="1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e" containerName="payload-processing"
Oct 30 23:48:14.919701 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:14.919698    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e" containerName="payload-processing"
Oct 30 23:48:14.919990 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:14.919976    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="1c17a3db-6f6c-4b91-ada5-c1c7e40ad28e" containerName="payload-processing"
Oct 30 23:48:14.926137 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:14.926111    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"
Oct 30 23:48:14.947234 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:14.947201    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w0-4e6c3b-serving-cert\""
Oct 30 23:48:14.954445 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:14.954417    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"]
Oct 30 23:48:15.026578 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:15.026548    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:15.048424 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:15.048392    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efb5db91-83e2-4884-bd0d-6a7d10787929-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj\" (UID: \"efb5db91-83e2-4884-bd0d-6a7d10787929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"
Oct 30 23:48:15.048641 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:15.048619    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm7gn\" (UniqueName: \"kubernetes.io/projected/efb5db91-83e2-4884-bd0d-6a7d10787929-kube-api-access-hm7gn\") pod \"maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj\" (UID: \"efb5db91-83e2-4884-bd0d-6a7d10787929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"
Oct 30 23:48:15.048753 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:15.048672    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efb5db91-83e2-4884-bd0d-6a7d10787929-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj\" (UID: \"efb5db91-83e2-4884-bd0d-6a7d10787929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"
Oct 30 23:48:15.048822 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:15.048783    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efb5db91-83e2-4884-bd0d-6a7d10787929-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj\" (UID: \"efb5db91-83e2-4884-bd0d-6a7d10787929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"
Oct 30 23:48:15.150670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:15.150237    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efb5db91-83e2-4884-bd0d-6a7d10787929-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj\" (UID: \"efb5db91-83e2-4884-bd0d-6a7d10787929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"
Oct 30 23:48:15.150670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:15.150482    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm7gn\" (UniqueName: \"kubernetes.io/projected/efb5db91-83e2-4884-bd0d-6a7d10787929-kube-api-access-hm7gn\") pod \"maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj\" (UID: \"efb5db91-83e2-4884-bd0d-6a7d10787929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"
Oct 30 23:48:15.150670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:15.150550    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efb5db91-83e2-4884-bd0d-6a7d10787929-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj\" (UID: \"efb5db91-83e2-4884-bd0d-6a7d10787929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"
Oct 30 23:48:15.181039 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:15.163526    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efb5db91-83e2-4884-bd0d-6a7d10787929-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj\" (UID: \"efb5db91-83e2-4884-bd0d-6a7d10787929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"
Oct 30 23:48:15.181039 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:15.164647    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efb5db91-83e2-4884-bd0d-6a7d10787929-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj\" (UID: \"efb5db91-83e2-4884-bd0d-6a7d10787929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"
Oct 30 23:48:15.211619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:15.202483    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efb5db91-83e2-4884-bd0d-6a7d10787929-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj\" (UID: \"efb5db91-83e2-4884-bd0d-6a7d10787929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"
Oct 30 23:48:15.213648 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:15.213581    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:15.214045 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:15.213685    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm7gn\" (UniqueName: \"kubernetes.io/projected/efb5db91-83e2-4884-bd0d-6a7d10787929-kube-api-access-hm7gn\") pod \"maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj\" (UID: \"efb5db91-83e2-4884-bd0d-6a7d10787929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"
Oct 30 23:48:15.237853 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:15.234992    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efb5db91-83e2-4884-bd0d-6a7d10787929-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj\" (UID: \"efb5db91-83e2-4884-bd0d-6a7d10787929\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"
Oct 30 23:48:15.260743 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:15.260207    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"
Oct 30 23:48:15.639614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:15.637708    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:15.679726 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:15.678025    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"]
Oct 30 23:48:15.832616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:15.827160    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:48:15.832616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:15.827215    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd" podUID="f91240cc-16c4-406a-9db3-4f40de05e354" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:48:16.191619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:16.171115    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:16.335084 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:16.335052    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj" event={"ID":"efb5db91-83e2-4884-bd0d-6a7d10787929","Type":"ContainerStarted","Data":"ea6a08b73efd4c0d13e6613ffa27cd10c9ed0fc8106c256dc7c6e29dc5143993"}
Oct 30 23:48:16.830077 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:16.830040    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:17.354295 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.354009    4921 generic.go:356] "Generic (PLEG): container finished" podID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerID="43f8a81d78c6283c5ae2fd4748b6da54bb144ae32ef1272fdaca92176bf5eec0" exitCode=0
Oct 30 23:48:17.354295 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.354217    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" event={"ID":"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec","Type":"ContainerDied","Data":"43f8a81d78c6283c5ae2fd4748b6da54bb144ae32ef1272fdaca92176bf5eec0"}
Oct 30 23:48:17.360939 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.360906    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj" event={"ID":"efb5db91-83e2-4884-bd0d-6a7d10787929","Type":"ContainerStarted","Data":"303f9103f3936d61693f15527dccb8ecb9eb65146eb9b6aebec3556302dbf4a8"}
Oct 30 23:48:17.361937 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.361379    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"
Oct 30 23:48:17.367003 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.366978    4921 generic.go:356] "Generic (PLEG): container finished" podID="59a6ba32-e3e0-479f-8e87-5ee77a926503" containerID="f11abe114195eeffa8f96f1a5edfc97fda4205dec526c07d1abe5220ed7fafa6" exitCode=0
Oct 30 23:48:17.367096 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.367073    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9" event={"ID":"59a6ba32-e3e0-479f-8e87-5ee77a926503","Type":"ContainerDied","Data":"f11abe114195eeffa8f96f1a5edfc97fda4205dec526c07d1abe5220ed7fafa6"}
Oct 30 23:48:17.397003 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.396905    4921 generic.go:356] "Generic (PLEG): container finished" podID="f91240cc-16c4-406a-9db3-4f40de05e354" containerID="2da398b05d2e817f96d3d076abd29e78054787cabf09d10664a8e6ba11723e46" exitCode=0
Oct 30 23:48:17.397149 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.397000    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd" event={"ID":"f91240cc-16c4-406a-9db3-4f40de05e354","Type":"ContainerDied","Data":"2da398b05d2e817f96d3d076abd29e78054787cabf09d10664a8e6ba11723e46"}
Oct 30 23:48:17.423302 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.423248    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj" podStartSLOduration=2.748151005 podStartE2EDuration="3.423233975s" totalImagesPullingTime="675.08297ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:17.412993843 +0000 UTC m=+1756.657849616" watchObservedRunningTime="2026-10-30 23:48:17.423233975 +0000 UTC m=+1756.668089743"
Oct 30 23:48:17.498643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.493433    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:48:17.498643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.496703    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:48:17.716836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.696285    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:17.716836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.714133    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"]
Oct 30 23:48:17.716836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.714892    4921 cpu_manager.go:414] "containerMap: removing container" podUID="f91240cc-16c4-406a-9db3-4f40de05e354" containerName="istio-proxy"
Oct 30 23:48:17.716836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.714908    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f91240cc-16c4-406a-9db3-4f40de05e354" containerName="istio-proxy"
Oct 30 23:48:17.716836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.714923    4921 cpu_manager.go:414] "containerMap: removing container" podUID="59a6ba32-e3e0-479f-8e87-5ee77a926503" containerName="istio-proxy"
Oct 30 23:48:17.716836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.714928    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59a6ba32-e3e0-479f-8e87-5ee77a926503" containerName="istio-proxy"
Oct 30 23:48:17.716836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.715058    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="f91240cc-16c4-406a-9db3-4f40de05e354" containerName="istio-proxy"
Oct 30 23:48:17.716836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.715066    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="59a6ba32-e3e0-479f-8e87-5ee77a926503" containerName="istio-proxy"
Oct 30 23:48:17.721825 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.720769    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"
Oct 30 23:48:17.726976 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.726477    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-2ccd42-serving-cert\""
Oct 30 23:48:17.726976 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.726900    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"]
Oct 30 23:48:17.765461 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.765107    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.775708    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f91240cc-16c4-406a-9db3-4f40de05e354-kube-api-access-z9jjk\" (UniqueName: \"kubernetes.io/projected/f91240cc-16c4-406a-9db3-4f40de05e354-kube-api-access-z9jjk\") pod \"f91240cc-16c4-406a-9db3-4f40de05e354\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") "
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.775791    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f91240cc-16c4-406a-9db3-4f40de05e354-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f91240cc-16c4-406a-9db3-4f40de05e354-istio-podinfo\") pod \"f91240cc-16c4-406a-9db3-4f40de05e354\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") "
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.775844    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59a6ba32-e3e0-479f-8e87-5ee77a926503-kube-api-access-q2nqc\" (UniqueName: \"kubernetes.io/projected/59a6ba32-e3e0-479f-8e87-5ee77a926503-kube-api-access-q2nqc\") pod \"59a6ba32-e3e0-479f-8e87-5ee77a926503\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") "
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.775894    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-istio-data\") pod \"f91240cc-16c4-406a-9db3-4f40de05e354\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") "
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.775930    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-istio-envoy\") pod \"f91240cc-16c4-406a-9db3-4f40de05e354\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") "
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.775990    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-envoy\") pod \"59a6ba32-e3e0-479f-8e87-5ee77a926503\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") "
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.776021    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/59a6ba32-e3e0-479f-8e87-5ee77a926503-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59a6ba32-e3e0-479f-8e87-5ee77a926503-istiod-ca-cert\") pod \"59a6ba32-e3e0-479f-8e87-5ee77a926503\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") "
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.776083    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f91240cc-16c4-406a-9db3-4f40de05e354-istio-token\" (UniqueName: \"kubernetes.io/projected/f91240cc-16c4-406a-9db3-4f40de05e354-istio-token\") pod \"f91240cc-16c4-406a-9db3-4f40de05e354\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") "
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.776217    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-workload-socket\") pod \"f91240cc-16c4-406a-9db3-4f40de05e354\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") "
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.776275    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-token\" (UniqueName: \"kubernetes.io/projected/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-token\") pod \"59a6ba32-e3e0-479f-8e87-5ee77a926503\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") "
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.776316    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f91240cc-16c4-406a-9db3-4f40de05e354-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f91240cc-16c4-406a-9db3-4f40de05e354-istiod-ca-cert\") pod \"f91240cc-16c4-406a-9db3-4f40de05e354\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") "
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.776349    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-podinfo\") pod \"59a6ba32-e3e0-479f-8e87-5ee77a926503\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") "
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.776395    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-data\") pod \"59a6ba32-e3e0-479f-8e87-5ee77a926503\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") "
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.776487    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-workload-certs\") pod \"f91240cc-16c4-406a-9db3-4f40de05e354\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") "
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.776547    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-credential-socket\") pod \"59a6ba32-e3e0-479f-8e87-5ee77a926503\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") "
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.776631    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-credential-socket\") pod \"f91240cc-16c4-406a-9db3-4f40de05e354\" (UID: \"f91240cc-16c4-406a-9db3-4f40de05e354\") "
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.776675    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-workload-socket\") pod \"59a6ba32-e3e0-479f-8e87-5ee77a926503\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") "
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.776735    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-workload-certs\") pod \"59a6ba32-e3e0-479f-8e87-5ee77a926503\" (UID: \"59a6ba32-e3e0-479f-8e87-5ee77a926503\") "
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.777447    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5rqq\" (UniqueName: \"kubernetes.io/projected/6bc80c1d-4e70-4ece-a26c-42c76131a6af-kube-api-access-c5rqq\") pod \"maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb\" (UID: \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.777612    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bc80c1d-4e70-4ece-a26c-42c76131a6af-maas-api-tls\") pod \"maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb\" (UID: \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.777894    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bc80c1d-4e70-4ece-a26c-42c76131a6af-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb\" (UID: \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.777924    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bc80c1d-4e70-4ece-a26c-42c76131a6af-metrics-certs\") pod \"maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb\" (UID: \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.781202    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f91240cc-16c4-406a-9db3-4f40de05e354-istiod-ca-cert" pod "f91240cc-16c4-406a-9db3-4f40de05e354" (UID: "f91240cc-16c4-406a-9db3-4f40de05e354"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:48:17.782666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.781781    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-credential-socket" pod "f91240cc-16c4-406a-9db3-4f40de05e354" (UID: "f91240cc-16c4-406a-9db3-4f40de05e354"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:17.790845 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.789143    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-workload-certs" pod "59a6ba32-e3e0-479f-8e87-5ee77a926503" (UID: "59a6ba32-e3e0-479f-8e87-5ee77a926503"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:17.790845 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.789365    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-workload-socket" pod "59a6ba32-e3e0-479f-8e87-5ee77a926503" (UID: "59a6ba32-e3e0-479f-8e87-5ee77a926503"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:17.790845 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.789541    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-data" pod "59a6ba32-e3e0-479f-8e87-5ee77a926503" (UID: "59a6ba32-e3e0-479f-8e87-5ee77a926503"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:17.790845 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.789843    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-credential-socket" pod "59a6ba32-e3e0-479f-8e87-5ee77a926503" (UID: "59a6ba32-e3e0-479f-8e87-5ee77a926503"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:17.790845 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.790125    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-workload-certs" pod "f91240cc-16c4-406a-9db3-4f40de05e354" (UID: "f91240cc-16c4-406a-9db3-4f40de05e354"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:17.790845 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.790357    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-workload-socket" pod "f91240cc-16c4-406a-9db3-4f40de05e354" (UID: "f91240cc-16c4-406a-9db3-4f40de05e354"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:17.808627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.803076    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59a6ba32-e3e0-479f-8e87-5ee77a926503-istiod-ca-cert" pod "59a6ba32-e3e0-479f-8e87-5ee77a926503" (UID: "59a6ba32-e3e0-479f-8e87-5ee77a926503"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:48:17.815091 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.814695    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-istio-data" pod "f91240cc-16c4-406a-9db3-4f40de05e354" (UID: "f91240cc-16c4-406a-9db3-4f40de05e354"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:17.847349 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.846969    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:17.884324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.882859    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-podinfo\") pod \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") "
Oct 30 23:48:17.884324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.882968    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-kube-api-access-5lzdg\" (UniqueName: \"kubernetes.io/projected/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-kube-api-access-5lzdg\") pod \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") "
Oct 30 23:48:17.884324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.883015    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istiod-ca-cert\") pod \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") "
Oct 30 23:48:17.884324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.883099    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-token\" (UniqueName: \"kubernetes.io/projected/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-token\") pod \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") "
Oct 30 23:48:17.884324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.883197    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-data\") pod \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") "
Oct 30 23:48:17.884324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.883263    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-envoy\") pod \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") "
Oct 30 23:48:17.884324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.883468    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-workload-certs\") pod \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") "
Oct 30 23:48:17.884324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.883655    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-workload-socket\") pod \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") "
Oct 30 23:48:17.884324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.883779    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-credential-socket\") pod \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\" (UID: \"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec\") "
Oct 30 23:48:17.884324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.884266    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5rqq\" (UniqueName: \"kubernetes.io/projected/6bc80c1d-4e70-4ece-a26c-42c76131a6af-kube-api-access-c5rqq\") pod \"maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb\" (UID: \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"
Oct 30 23:48:17.886445 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.885255    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bc80c1d-4e70-4ece-a26c-42c76131a6af-maas-api-tls\") pod \"maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb\" (UID: \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"
Oct 30 23:48:17.886445 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.885543    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bc80c1d-4e70-4ece-a26c-42c76131a6af-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb\" (UID: \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"
Oct 30 23:48:17.886445 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.885578    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bc80c1d-4e70-4ece-a26c-42c76131a6af-metrics-certs\") pod \"maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb\" (UID: \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"
Oct 30 23:48:17.886445 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.885726    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59a6ba32-e3e0-479f-8e87-5ee77a926503-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:17.886445 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.885745    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:17.886445 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.885759    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f91240cc-16c4-406a-9db3-4f40de05e354-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:17.886445 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.885772    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:17.886445 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.885785    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:17.886445 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.885797    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:17.886445 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.885810    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:17.886445 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.885822    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:17.886445 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.885835    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:17.886445 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.885849    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:17.886445 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.886120    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-data" pod "254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" (UID: "254e6e3d-3f3a-447b-ac66-b93b79c4f8ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:17.891055 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.890931    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-podinfo" pod "59a6ba32-e3e0-479f-8e87-5ee77a926503" (UID: "59a6ba32-e3e0-479f-8e87-5ee77a926503"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:48:17.895065 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.891335    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59a6ba32-e3e0-479f-8e87-5ee77a926503-kube-api-access-q2nqc" pod "59a6ba32-e3e0-479f-8e87-5ee77a926503" (UID: "59a6ba32-e3e0-479f-8e87-5ee77a926503"). InnerVolumeSpecName "kube-api-access-q2nqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:17.895065 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.891032    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f91240cc-16c4-406a-9db3-4f40de05e354-istio-podinfo" pod "f91240cc-16c4-406a-9db3-4f40de05e354" (UID: "f91240cc-16c4-406a-9db3-4f40de05e354"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:48:17.895065 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.892624    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istiod-ca-cert" pod "254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" (UID: "254e6e3d-3f3a-447b-ac66-b93b79c4f8ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:48:17.895065 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.894521    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-credential-socket" pod "254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" (UID: "254e6e3d-3f3a-447b-ac66-b93b79c4f8ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:17.895926 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.895569    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-workload-socket" pod "254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" (UID: "254e6e3d-3f3a-447b-ac66-b93b79c4f8ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:17.906211 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.897112    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-workload-certs" pod "254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" (UID: "254e6e3d-3f3a-447b-ac66-b93b79c4f8ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:17.906211 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.897887    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bc80c1d-4e70-4ece-a26c-42c76131a6af-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb\" (UID: \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"
Oct 30 23:48:17.906211 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.900707    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-istio-envoy" pod "f91240cc-16c4-406a-9db3-4f40de05e354" (UID: "f91240cc-16c4-406a-9db3-4f40de05e354"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:17.941563 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.941461    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f91240cc-16c4-406a-9db3-4f40de05e354-kube-api-access-z9jjk" pod "f91240cc-16c4-406a-9db3-4f40de05e354" (UID: "f91240cc-16c4-406a-9db3-4f40de05e354"). InnerVolumeSpecName "kube-api-access-z9jjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:17.945686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.945021    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bc80c1d-4e70-4ece-a26c-42c76131a6af-maas-api-tls\") pod \"maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb\" (UID: \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"
Oct 30 23:48:17.945686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.945562    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5rqq\" (UniqueName: \"kubernetes.io/projected/6bc80c1d-4e70-4ece-a26c-42c76131a6af-kube-api-access-c5rqq\") pod \"maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb\" (UID: \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"
Oct 30 23:48:17.947836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.946171    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-envoy" pod "254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" (UID: "254e6e3d-3f3a-447b-ac66-b93b79c4f8ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:17.947836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.946280    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-token" pod "254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" (UID: "254e6e3d-3f3a-447b-ac66-b93b79c4f8ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:17.947836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.946340    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-podinfo" pod "254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" (UID: "254e6e3d-3f3a-447b-ac66-b93b79c4f8ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:48:17.947836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.946910    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bc80c1d-4e70-4ece-a26c-42c76131a6af-metrics-certs\") pod \"maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb\" (UID: \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"
Oct 30 23:48:17.948896 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.948876    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f91240cc-16c4-406a-9db3-4f40de05e354-istio-token" pod "f91240cc-16c4-406a-9db3-4f40de05e354" (UID: "f91240cc-16c4-406a-9db3-4f40de05e354"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:17.949116 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.949101    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-kube-api-access-5lzdg" pod "254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" (UID: "254e6e3d-3f3a-447b-ac66-b93b79c4f8ec"). InnerVolumeSpecName "kube-api-access-5lzdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:17.949295 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.949266    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-token" pod "59a6ba32-e3e0-479f-8e87-5ee77a926503" (UID: "59a6ba32-e3e0-479f-8e87-5ee77a926503"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:17.949435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:17.949422    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-envoy" pod "59a6ba32-e3e0-479f-8e87-5ee77a926503" (UID: "59a6ba32-e3e0-479f-8e87-5ee77a926503"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:18.015235 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.015149    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:18.084643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.057470    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lzdg\" (UniqueName: \"kubernetes.io/projected/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-kube-api-access-5lzdg\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:18.084643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.057507    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:18.084643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.057523    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:18.084643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.057537    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:18.084643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.057553    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:18.084643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.057567    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:18.084643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.057580    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:18.084643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.057613    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9jjk\" (UniqueName: \"kubernetes.io/projected/f91240cc-16c4-406a-9db3-4f40de05e354-kube-api-access-z9jjk\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:18.084643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.057627    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:18.084643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.057640    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f91240cc-16c4-406a-9db3-4f40de05e354-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:18.084643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.057654    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2nqc\" (UniqueName: \"kubernetes.io/projected/59a6ba32-e3e0-479f-8e87-5ee77a926503-kube-api-access-q2nqc\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:18.084643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.057669    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f91240cc-16c4-406a-9db3-4f40de05e354-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:18.084643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.057682    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:18.084643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.057695    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59a6ba32-e3e0-479f-8e87-5ee77a926503-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:18.084643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.057707    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f91240cc-16c4-406a-9db3-4f40de05e354-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:18.084643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.057723    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:18.084643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.057736    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:18.101469 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.101003    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"
Oct 30 23:48:18.451194 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.451082    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9" event={"ID":"59a6ba32-e3e0-479f-8e87-5ee77a926503","Type":"ContainerDied","Data":"d2a8dfb9895fc42f95ec437170f061b6e1d9e46d876d8692b68993c322508c2e"}
Oct 30 23:48:18.451946 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.451924    4921 scope.go:122] "RemoveContainer" containerID="f11abe114195eeffa8f96f1a5edfc97fda4205dec526c07d1abe5220ed7fafa6"
Oct 30 23:48:18.452315 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.452290    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"
Oct 30 23:48:18.479244 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.479208    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd" event={"ID":"f91240cc-16c4-406a-9db3-4f40de05e354","Type":"ContainerDied","Data":"a2ca8f8842f11267f9db7aed6379a4e058ee1979313d8668f3cae9b0da43aa1b"}
Oct 30 23:48:18.479830 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.479808    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"
Oct 30 23:48:18.492626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.490303    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"
Oct 30 23:48:18.498437 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.498353    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784" event={"ID":"254e6e3d-3f3a-447b-ac66-b93b79c4f8ec","Type":"ContainerDied","Data":"2c0759ba47d4af0990dea814562aef31befb5b719e51e32951cd37bfe23f04f4"}
Oct 30 23:48:18.560999 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.560975    4921 scope.go:122] "RemoveContainer" containerID="2da398b05d2e817f96d3d076abd29e78054787cabf09d10664a8e6ba11723e46"
Oct 30 23:48:18.582693 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.582669    4921 scope.go:122] "RemoveContainer" containerID="43f8a81d78c6283c5ae2fd4748b6da54bb144ae32ef1272fdaca92176bf5eec0"
Oct 30 23:48:18.584425 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.584410    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"]
Oct 30 23:48:18.611618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.593190    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-nd784"]
Oct 30 23:48:18.611618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.600521    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"]
Oct 30 23:48:18.611618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.605305    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-bbtj9"]
Oct 30 23:48:18.621832 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.621773    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"]
Oct 30 23:48:18.628024 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.627987    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-xpftd"]
Oct 30 23:48:18.963226 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.963185    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" path="/var/lib/kubelet/pods/254e6e3d-3f3a-447b-ac66-b93b79c4f8ec/volumes"
Oct 30 23:48:18.965392 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.965367    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="59a6ba32-e3e0-479f-8e87-5ee77a926503" path="/var/lib/kubelet/pods/59a6ba32-e3e0-479f-8e87-5ee77a926503/volumes"
Oct 30 23:48:18.989892 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:18.989856    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f91240cc-16c4-406a-9db3-4f40de05e354" path="/var/lib/kubelet/pods/f91240cc-16c4-406a-9db3-4f40de05e354/volumes"
Oct 30 23:48:19.082477 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:19.082435    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd" podUID="13a82994-2aea-4a29-9db6-10b92669f68c" containerName="payload-pre-processing" containerID="cri-o://aef4e44142af5f05e6b8d428b1b9c98d970fa086c84fc2ef49fde7cb25909910" gracePeriod=25
Oct 30 23:48:19.209308 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:19.209254    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd" podUID="13a82994-2aea-4a29-9db6-10b92669f68c" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 23:48:19.314421 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:19.314368    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"]
Oct 30 23:48:19.317422 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:48:19.317382    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bc80c1d_4e70_4ece_a26c_42c76131a6af.slice/crio-47f4e02f927e213ad7b6ca4125c5d7c2a06bba9acad1fb6d4beb69e3a2d533c7 WatchSource:0}: Error finding container 47f4e02f927e213ad7b6ca4125c5d7c2a06bba9acad1fb6d4beb69e3a2d533c7: Status 404 returned error can't find the container with id 47f4e02f927e213ad7b6ca4125c5d7c2a06bba9acad1fb6d4beb69e3a2d533c7
Oct 30 23:48:19.457675 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:19.457370    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:19.574503 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:19.574465    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb" event={"ID":"6bc80c1d-4e70-4ece-a26c-42c76131a6af","Type":"ContainerStarted","Data":"47f4e02f927e213ad7b6ca4125c5d7c2a06bba9acad1fb6d4beb69e3a2d533c7"}
Oct 30 23:48:20.433493 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:20.433446    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:20.603419 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:20.603378    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb" event={"ID":"6bc80c1d-4e70-4ece-a26c-42c76131a6af","Type":"ContainerStarted","Data":"95191e897ba831396876037f59ea068c3d0c021735bb982157e0356ebd8a3e74"}
Oct 30 23:48:20.605738 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:20.605714    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"
Oct 30 23:48:20.649051 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:20.648989    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb" podStartSLOduration=3.115708756 podStartE2EDuration="3.648968976s" totalImagesPullingTime="533.26022ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:20.624977517 +0000 UTC m=+1759.869833285" watchObservedRunningTime="2026-10-30 23:48:20.648968976 +0000 UTC m=+1759.893824745"
Oct 30 23:48:20.654071 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:20.654033    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:21.436425 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:21.436388    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:22.072156 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:22.072122    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:22.219630 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:22.208407    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:22.911204 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:22.911175    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:23.535399 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:23.535369    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"
Oct 30 23:48:23.630543 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:23.630506    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:24.327081 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:24.327048    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:25.374446 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:25.374409    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:26.163415 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.163375    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:26.624670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.622458    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"]
Oct 30 23:48:26.624670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.623674    4921 cpu_manager.go:414] "containerMap: removing container" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy"
Oct 30 23:48:26.624670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.623697    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy"
Oct 30 23:48:26.624670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.623860    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="254e6e3d-3f3a-447b-ac66-b93b79c4f8ec" containerName="istio-proxy"
Oct 30 23:48:26.629616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.629420    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.640339 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.640311    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6a162557-openshift-default-dockercfg-w6bzl\""
Oct 30 23:48:26.645713 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.645691    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"]
Oct 30 23:48:26.801191 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.801163    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-istio-data\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.801370 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.801223    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxmbw\" (UniqueName: \"kubernetes.io/projected/061058ad-359f-44ac-a47b-ee6587a9a906-kube-api-access-gxmbw\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.801370 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.801294    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/061058ad-359f-44ac-a47b-ee6587a9a906-istiod-ca-cert\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.801370 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.801319    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-istio-envoy\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.801370 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.801341    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-credential-socket\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.801510 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.801410    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-workload-socket\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.801510 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.801437    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/061058ad-359f-44ac-a47b-ee6587a9a906-istio-podinfo\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.801577 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.801546    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-workload-certs\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.801743 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.801725    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/061058ad-359f-44ac-a47b-ee6587a9a906-istio-token\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.903888 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.903847    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/061058ad-359f-44ac-a47b-ee6587a9a906-istio-token\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.904083 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.904005    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-istio-data\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.904083 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.904064    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxmbw\" (UniqueName: \"kubernetes.io/projected/061058ad-359f-44ac-a47b-ee6587a9a906-kube-api-access-gxmbw\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.904222 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.904101    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/061058ad-359f-44ac-a47b-ee6587a9a906-istiod-ca-cert\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.904222 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.904138    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-istio-envoy\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.904222 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.904167    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-credential-socket\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.904222 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.904215    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-workload-socket\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.904426 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.904265    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/061058ad-359f-44ac-a47b-ee6587a9a906-istio-podinfo\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.904426 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.904342    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-workload-certs\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.904633 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.904605    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-credential-socket\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.904780 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.904754    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-workload-socket\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.904915 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.904890    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/061058ad-359f-44ac-a47b-ee6587a9a906-istiod-ca-cert\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.905043 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.904887    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-workload-certs\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.905171 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.905143    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-istio-data\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.907272 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.907228    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-istio-envoy\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.907514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.907493    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/061058ad-359f-44ac-a47b-ee6587a9a906-istio-podinfo\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.916529 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.916502    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxmbw\" (UniqueName: \"kubernetes.io/projected/061058ad-359f-44ac-a47b-ee6587a9a906-kube-api-access-gxmbw\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.916954 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.916933    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/061058ad-359f-44ac-a47b-ee6587a9a906-istio-token\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-l7b64\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:26.955660 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:26.955618    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:27.106617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:27.106079    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:27.252175 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:27.252149    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"]
Oct 30 23:48:27.253958 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:48:27.253927    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061058ad_359f_44ac_a47b_ee6587a9a906.slice/crio-9a1ec47d6493b8b97cf2ffe747283d4c8e27633d415ace64d50483e105dc64b4 WatchSource:0}: Error finding container 9a1ec47d6493b8b97cf2ffe747283d4c8e27633d415ace64d50483e105dc64b4: Status 404 returned error can't find the container with id 9a1ec47d6493b8b97cf2ffe747283d4c8e27633d415ace64d50483e105dc64b4
Oct 30 23:48:27.256663 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:27.256626    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:48:27.256761 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:27.256698    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:48:27.256761 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:27.256748    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:48:27.719252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:27.712538    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"
Oct 30 23:48:27.849839 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:27.840804    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64" event={"ID":"061058ad-359f-44ac-a47b-ee6587a9a906","Type":"ContainerStarted","Data":"3c9537420621e3d97582f034cf09dabb1dc6977568329d5907ae2b1eb73b3097"}
Oct 30 23:48:27.849839 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:27.840873    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64" event={"ID":"061058ad-359f-44ac-a47b-ee6587a9a906","Type":"ContainerStarted","Data":"9a1ec47d6493b8b97cf2ffe747283d4c8e27633d415ace64d50483e105dc64b4"}
Oct 30 23:48:27.989719 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:27.988292    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:28.042616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:28.036006    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:28.042616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:28.040630    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64" podStartSLOduration=2.040611027 podStartE2EDuration="2.040611027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:28.012122437 +0000 UTC m=+1767.256978204" watchObservedRunningTime="2026-10-30 23:48:28.040611027 +0000 UTC m=+1767.285466796"
Oct 30 23:48:28.352565 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:28.352480    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:28.521349 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:28.521314    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:28.919638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:28.919568    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"]
Oct 30 23:48:28.927165 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:28.927130    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:28.930285 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:28.930260    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"]
Oct 30 23:48:28.936725 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:28.936697    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-86d846-openshift-default-dockercfg-dnvpd\""
Oct 30 23:48:28.957561 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:28.957531    4921 patch_prober.go:29] interesting pod/e2e-mt-6a162557-openshift-default-8677879c89-l7b64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 23:48:28.957780 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:28.957580    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64" podUID="061058ad-359f-44ac-a47b-ee6587a9a906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 23:48:28.965775 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:28.965745    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-podinfo\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:28.966031 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:28.965816    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-data\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:28.966031 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:28.965918    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm5lj\" (UniqueName: \"kubernetes.io/projected/441b53d1-a1f2-493b-a111-afff2d1aac61-kube-api-access-dm5lj\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:28.966031 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:28.966018    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-token\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:28.966182 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:28.966052    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-envoy\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:28.966182 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:28.966169    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/441b53d1-a1f2-493b-a111-afff2d1aac61-istiod-ca-cert\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:28.966252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:28.966244    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-workload-socket\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:28.966392 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:28.966379    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-workload-certs\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:28.966448 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:28.966437    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-credential-socket\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.013620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.008945    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:29.088833 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.088791    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-workload-socket\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.089316 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.089282    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-workload-certs\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.089533 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.089516    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-credential-socket\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.089784 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.089763    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-podinfo\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.089960 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.089943    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-data\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.115753 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.090107    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm5lj\" (UniqueName: \"kubernetes.io/projected/441b53d1-a1f2-493b-a111-afff2d1aac61-kube-api-access-dm5lj\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.116376 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.116300    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-token\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.116615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.116533    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-envoy\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.116899 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.116795    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/441b53d1-a1f2-493b-a111-afff2d1aac61-istiod-ca-cert\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.117182 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.109510    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-podinfo\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.117378 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.109832    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-data\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.117378 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.091065    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-credential-socket\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.118048 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.091299    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-workload-socket\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.119088 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.091522    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-workload-certs\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.120189 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.120168    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/441b53d1-a1f2-493b-a111-afff2d1aac61-istiod-ca-cert\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.146701 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.146202    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-envoy\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.163676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.163643    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:29.170670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.166409    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm5lj\" (UniqueName: \"kubernetes.io/projected/441b53d1-a1f2-493b-a111-afff2d1aac61-kube-api-access-dm5lj\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.189369 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.189333    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-token\") pod \"e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") " pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.238619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.229739    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd" podUID="13a82994-2aea-4a29-9db6-10b92669f68c" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 23:48:29.250138 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.248940    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:29.915929 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:48:29.915898    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod441b53d1_a1f2_493b_a111_afff2d1aac61.slice/crio-6648a33bc8de5534486b04c0a1f1602afe985d87ee20b7033fc00b2e74393f1b WatchSource:0}: Error finding container 6648a33bc8de5534486b04c0a1f1602afe985d87ee20b7033fc00b2e74393f1b: Status 404 returned error can't find the container with id 6648a33bc8de5534486b04c0a1f1602afe985d87ee20b7033fc00b2e74393f1b
Oct 30 23:48:29.916975 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.916950    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"]
Oct 30 23:48:29.918803 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.918770    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:48:29.918863 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.918839    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:48:29.918900 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.918870    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:48:29.959345 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.959311    4921 patch_prober.go:29] interesting pod/e2e-mt-6a162557-openshift-default-8677879c89-l7b64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 23:48:29.959952 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:29.959912    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64" podUID="061058ad-359f-44ac-a47b-ee6587a9a906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 23:48:30.041683 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:30.041545    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:30.826536 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:30.826501    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:31.021729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:31.020789    4921 patch_prober.go:29] interesting pod/e2e-mt-6a162557-openshift-default-8677879c89-l7b64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 23:48:31.021729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:31.020852    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64" podUID="061058ad-359f-44ac-a47b-ee6587a9a906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 23:48:31.031678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:31.031641    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b" event={"ID":"441b53d1-a1f2-493b-a111-afff2d1aac61","Type":"ContainerStarted","Data":"cc40c0d08cd7e3d0cffdd160711c9f85f313ce8e064a750b110193a8f9836219"}
Oct 30 23:48:31.031900 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:31.031883    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b" event={"ID":"441b53d1-a1f2-493b-a111-afff2d1aac61","Type":"ContainerStarted","Data":"6648a33bc8de5534486b04c0a1f1602afe985d87ee20b7033fc00b2e74393f1b"}
Oct 30 23:48:31.043559 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:31.043511    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b" podStartSLOduration=3.043497332 podStartE2EDuration="3.043497332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:31.037428524 +0000 UTC m=+1770.282284293" watchObservedRunningTime="2026-10-30 23:48:31.043497332 +0000 UTC m=+1770.288353100"
Oct 30 23:48:31.291618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:31.273681    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:31.291618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:31.291466    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:31.940645 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:31.940613    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:31.942148 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:31.942129    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:48:31.959722 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:31.959692    4921 patch_prober.go:29] interesting pod/e2e-mt-6a162557-openshift-default-8677879c89-l7b64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 23:48:31.960195 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:31.960165    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64" podUID="061058ad-359f-44ac-a47b-ee6587a9a906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 23:48:32.050773 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:32.050718    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:32.323850 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:32.323741    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:32.793681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:32.781886    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:32.956464 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:32.956433    4921 patch_prober.go:29] interesting pod/e2e-mt-6a162557-openshift-default-8677879c89-l7b64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 23:48:32.956627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:32.956504    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64" podUID="061058ad-359f-44ac-a47b-ee6587a9a906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 23:48:33.303883 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:33.303831    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:33.460389 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:33.460348    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:33.598664 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:33.596342    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:33.964617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:33.957011    4921 patch_prober.go:29] interesting pod/e2e-mt-6a162557-openshift-default-8677879c89-l7b64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 23:48:33.981651 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:33.979105    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64" podUID="061058ad-359f-44ac-a47b-ee6587a9a906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 23:48:34.764500 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:34.764460    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:34.832499 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:34.832464    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g"]
Oct 30 23:48:34.838307 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:34.838287    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g"
Oct 30 23:48:34.852717 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:34.852065    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g"]
Oct 30 23:48:34.852717 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:34.852336    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-86d846\""
Oct 30 23:48:34.914621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:34.914568    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:34.956614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:34.956572    4921 patch_prober.go:29] interesting pod/e2e-mt-6a162557-openshift-default-8677879c89-l7b64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 23:48:34.956785 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:34.956666    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64" podUID="061058ad-359f-44ac-a47b-ee6587a9a906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 23:48:35.013619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:35.011985    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xn7n\" (UniqueName: \"kubernetes.io/projected/7dc2062f-cb3b-4b8b-b38d-635eea0f547a-kube-api-access-9xn7n\") pod \"payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g\" (UID: \"7dc2062f-cb3b-4b8b-b38d-635eea0f547a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g"
Oct 30 23:48:35.013619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:35.012037    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dc2062f-cb3b-4b8b-b38d-635eea0f547a-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g\" (UID: \"7dc2062f-cb3b-4b8b-b38d-635eea0f547a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g"
Oct 30 23:48:35.108227 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:35.108133    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:35.118462 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:35.118427    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xn7n\" (UniqueName: \"kubernetes.io/projected/7dc2062f-cb3b-4b8b-b38d-635eea0f547a-kube-api-access-9xn7n\") pod \"payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g\" (UID: \"7dc2062f-cb3b-4b8b-b38d-635eea0f547a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g"
Oct 30 23:48:35.118769 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:35.118744    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dc2062f-cb3b-4b8b-b38d-635eea0f547a-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g\" (UID: \"7dc2062f-cb3b-4b8b-b38d-635eea0f547a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g"
Oct 30 23:48:35.139615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:35.119956    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dc2062f-cb3b-4b8b-b38d-635eea0f547a-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g\" (UID: \"7dc2062f-cb3b-4b8b-b38d-635eea0f547a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g"
Oct 30 23:48:35.215465 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:35.215427    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xn7n\" (UniqueName: \"kubernetes.io/projected/7dc2062f-cb3b-4b8b-b38d-635eea0f547a-kube-api-access-9xn7n\") pod \"payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g\" (UID: \"7dc2062f-cb3b-4b8b-b38d-635eea0f547a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g"
Oct 30 23:48:35.483520 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:35.483407    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:35.495279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:35.495253    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g"
Oct 30 23:48:35.852508 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:35.852471    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g"]
Oct 30 23:48:35.855741 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:48:35.855713    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dc2062f_cb3b_4b8b_b38d_635eea0f547a.slice/crio-d1cf071395eae00aae0cd82488e0b177f7f8f3b1c08c11dbdfb59b4ce6da8044 WatchSource:0}: Error finding container d1cf071395eae00aae0cd82488e0b177f7f8f3b1c08c11dbdfb59b4ce6da8044: Status 404 returned error can't find the container with id d1cf071395eae00aae0cd82488e0b177f7f8f3b1c08c11dbdfb59b4ce6da8044
Oct 30 23:48:35.906844 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:35.906802    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:35.961845 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:35.961820    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:35.962319 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:35.962296    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:35.962988 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:35.962969    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:48:36.069477 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:36.069403    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:36.094241 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:36.094203    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g" event={"ID":"7dc2062f-cb3b-4b8b-b38d-635eea0f547a","Type":"ContainerStarted","Data":"a5e5718133467ae7486695bd16aba049e1f06abdf27d8d1e35de4696bd47f949"}
Oct 30 23:48:36.094440 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:36.094269    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g" event={"ID":"7dc2062f-cb3b-4b8b-b38d-635eea0f547a","Type":"ContainerStarted","Data":"d1cf071395eae00aae0cd82488e0b177f7f8f3b1c08c11dbdfb59b4ce6da8044"}
Oct 30 23:48:36.094440 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:36.094318    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g"
Oct 30 23:48:36.122893 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:36.122798    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g" podStartSLOduration=2.12278401 podStartE2EDuration="2.12278401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:36.121133193 +0000 UTC m=+1775.365988972" watchObservedRunningTime="2026-10-30 23:48:36.12278401 +0000 UTC m=+1775.367639778"
Oct 30 23:48:36.291618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:36.289215    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:37.342133 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:37.342098    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:37.526396 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:37.526359    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:38.562486 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:38.562448    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv"]
Oct 30 23:48:38.567891 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:38.567863    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv"
Oct 30 23:48:38.576524 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:38.576492    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:38.578231 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:38.578203    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w0-885999\""
Oct 30 23:48:38.596278 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:38.596245    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv"]
Oct 30 23:48:38.746620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:38.691053    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e977815f-d174-41e5-9485-2281325ca37c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv\" (UID: \"e977815f-d174-41e5-9485-2281325ca37c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv"
Oct 30 23:48:38.808620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:38.808257    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24q66\" (UniqueName: \"kubernetes.io/projected/e977815f-d174-41e5-9485-2281325ca37c-kube-api-access-24q66\") pod \"payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv\" (UID: \"e977815f-d174-41e5-9485-2281325ca37c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv"
Oct 30 23:48:38.808822 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:38.752873    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:38.979621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:38.973060    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e977815f-d174-41e5-9485-2281325ca37c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv\" (UID: \"e977815f-d174-41e5-9485-2281325ca37c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv"
Oct 30 23:48:38.979621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:38.973133    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24q66\" (UniqueName: \"kubernetes.io/projected/e977815f-d174-41e5-9485-2281325ca37c-kube-api-access-24q66\") pod \"payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv\" (UID: \"e977815f-d174-41e5-9485-2281325ca37c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv"
Oct 30 23:48:39.005951 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:38.994204    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e977815f-d174-41e5-9485-2281325ca37c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv\" (UID: \"e977815f-d174-41e5-9485-2281325ca37c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv"
Oct 30 23:48:39.037616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:39.037142    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24q66\" (UniqueName: \"kubernetes.io/projected/e977815f-d174-41e5-9485-2281325ca37c-kube-api-access-24q66\") pod \"payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv\" (UID: \"e977815f-d174-41e5-9485-2281325ca37c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv"
Oct 30 23:48:39.152123 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:39.128130    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:39.204981 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:39.204939    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv"
Oct 30 23:48:39.205813 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:48:39.205791    4921 logging.go:55] [core] [Channel #1735 SubChannel #1736]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.117:50052", ServerName: "10.132.0.117:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.117:50052: connect: connection refused"
Oct 30 23:48:39.522571 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:39.522540    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd"
Oct 30 23:48:39.616786 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:39.616753    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/13a82994-2aea-4a29-9db6-10b92669f68c-kube-api-access-95h6g\" (UniqueName: \"kubernetes.io/projected/13a82994-2aea-4a29-9db6-10b92669f68c-kube-api-access-95h6g\") pod \"13a82994-2aea-4a29-9db6-10b92669f68c\" (UID: \"13a82994-2aea-4a29-9db6-10b92669f68c\") "
Oct 30 23:48:39.617269 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:39.616965    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/13a82994-2aea-4a29-9db6-10b92669f68c-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13a82994-2aea-4a29-9db6-10b92669f68c-plugins-config-volume\") pod \"13a82994-2aea-4a29-9db6-10b92669f68c\" (UID: \"13a82994-2aea-4a29-9db6-10b92669f68c\") "
Oct 30 23:48:39.617332 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:39.617315    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13a82994-2aea-4a29-9db6-10b92669f68c-plugins-config-volume" pod "13a82994-2aea-4a29-9db6-10b92669f68c" (UID: "13a82994-2aea-4a29-9db6-10b92669f68c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:48:39.617922 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:39.617893    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13a82994-2aea-4a29-9db6-10b92669f68c-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:39.619181 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:39.619159    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13a82994-2aea-4a29-9db6-10b92669f68c-kube-api-access-95h6g" pod "13a82994-2aea-4a29-9db6-10b92669f68c" (UID: "13a82994-2aea-4a29-9db6-10b92669f68c"). InnerVolumeSpecName "kube-api-access-95h6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:39.645735 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:39.645710    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv"]
Oct 30 23:48:39.646792 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:48:39.646767    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode977815f_d174_41e5_9485_2281325ca37c.slice/crio-79f2b2997f0f6361d073e314c4aa756898575d569c6757bb50523f3941bed260 WatchSource:0}: Error finding container 79f2b2997f0f6361d073e314c4aa756898575d569c6757bb50523f3941bed260: Status 404 returned error can't find the container with id 79f2b2997f0f6361d073e314c4aa756898575d569c6757bb50523f3941bed260
Oct 30 23:48:39.720004 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:39.719979    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95h6g\" (UniqueName: \"kubernetes.io/projected/13a82994-2aea-4a29-9db6-10b92669f68c-kube-api-access-95h6g\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:40.136090 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.136053    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:40.155391 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.155358    4921 generic.go:356] "Generic (PLEG): container finished" podID="13a82994-2aea-4a29-9db6-10b92669f68c" containerID="aef4e44142af5f05e6b8d428b1b9c98d970fa086c84fc2ef49fde7cb25909910" exitCode=0
Oct 30 23:48:40.155565 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.155519    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd"
Oct 30 23:48:40.155860 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.155828    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd" event={"ID":"13a82994-2aea-4a29-9db6-10b92669f68c","Type":"ContainerDied","Data":"aef4e44142af5f05e6b8d428b1b9c98d970fa086c84fc2ef49fde7cb25909910"}
Oct 30 23:48:40.155945 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.155881    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd" event={"ID":"13a82994-2aea-4a29-9db6-10b92669f68c","Type":"ContainerDied","Data":"e213382840138b29b551238e15bab4631038632cac0e8feebb1a6dc29b96793b"}
Oct 30 23:48:40.155945 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.155910    4921 scope.go:122] "RemoveContainer" containerID="aef4e44142af5f05e6b8d428b1b9c98d970fa086c84fc2ef49fde7cb25909910"
Oct 30 23:48:40.160609 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.160465    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv" event={"ID":"e977815f-d174-41e5-9485-2281325ca37c","Type":"ContainerStarted","Data":"c05cace4bf4b88689f3511fcb2ea680a307b863dc45501bdf5db5a42c2a53631"}
Oct 30 23:48:40.160609 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.160561    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv" event={"ID":"e977815f-d174-41e5-9485-2281325ca37c","Type":"ContainerStarted","Data":"79f2b2997f0f6361d073e314c4aa756898575d569c6757bb50523f3941bed260"}
Oct 30 23:48:40.160998 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.160795    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv"
Oct 30 23:48:40.171166 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.171149    4921 scope.go:122] "RemoveContainer" containerID="aef4e44142af5f05e6b8d428b1b9c98d970fa086c84fc2ef49fde7cb25909910"
Oct 30 23:48:40.171460 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:48:40.171442    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aef4e44142af5f05e6b8d428b1b9c98d970fa086c84fc2ef49fde7cb25909910\": container with ID starting with aef4e44142af5f05e6b8d428b1b9c98d970fa086c84fc2ef49fde7cb25909910 not found: ID does not exist" containerID="aef4e44142af5f05e6b8d428b1b9c98d970fa086c84fc2ef49fde7cb25909910"
Oct 30 23:48:40.171525 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.171467    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aef4e44142af5f05e6b8d428b1b9c98d970fa086c84fc2ef49fde7cb25909910"} err="failed to get container status \"aef4e44142af5f05e6b8d428b1b9c98d970fa086c84fc2ef49fde7cb25909910\": rpc error: code = NotFound desc = could not find container \"aef4e44142af5f05e6b8d428b1b9c98d970fa086c84fc2ef49fde7cb25909910\": container with ID starting with aef4e44142af5f05e6b8d428b1b9c98d970fa086c84fc2ef49fde7cb25909910 not found: ID does not exist"
Oct 30 23:48:40.198502 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.198452    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv" podStartSLOduration=2.198437764 podStartE2EDuration="2.198437764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:40.197798724 +0000 UTC m=+1779.442654493" watchObservedRunningTime="2026-10-30 23:48:40.198437764 +0000 UTC m=+1779.443293560"
Oct 30 23:48:40.204865 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.204837    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd" podUID="13a82994-2aea-4a29-9db6-10b92669f68c" containerName="payload-pre-processing" probeResult="failure" output="timeout: failed to connect service \"10.132.0.117:50052\" within 1s: context deadline exceeded"
Oct 30 23:48:40.204986 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.204924    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd"
Oct 30 23:48:40.232566 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.232535    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd"]
Oct 30 23:48:40.239102 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.239077    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-4wpfd"]
Oct 30 23:48:40.308257 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.308177    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:40.619674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.616313    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:40.793538 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.793505    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:40.886108 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.886081    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="13a82994-2aea-4a29-9db6-10b92669f68c" path="/var/lib/kubelet/pods/13a82994-2aea-4a29-9db6-10b92669f68c/volumes"
Oct 30 23:48:40.981499 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:40.981464    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:41.151553 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:41.151474    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:41.395857 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:41.395819    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:41.411071 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:48:41.410990    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:48:41.532174 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:41.532139    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:41.610141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:41.610112    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn"]
Oct 30 23:48:41.611101 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:41.611082    4921 cpu_manager.go:414] "containerMap: removing container" podUID="13a82994-2aea-4a29-9db6-10b92669f68c" containerName="payload-pre-processing"
Oct 30 23:48:41.611163 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:41.611104    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="13a82994-2aea-4a29-9db6-10b92669f68c" containerName="payload-pre-processing"
Oct 30 23:48:41.611226 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:41.611216    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="13a82994-2aea-4a29-9db6-10b92669f68c" containerName="payload-pre-processing"
Oct 30 23:48:41.616948 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:41.616930    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn"
Oct 30 23:48:41.627716 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:41.627690    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn"]
Oct 30 23:48:41.786678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:41.681014    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-1bc837-dockercfg-r9rjj\""
Oct 30 23:48:41.786678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:41.692376    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-1bc837\""
Oct 30 23:48:41.786678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:41.719858    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9k5b\" (UniqueName: \"kubernetes.io/projected/5975b24e-2fa3-4875-92f9-b4316177ddca-kube-api-access-t9k5b\") pod \"payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn\" (UID: \"5975b24e-2fa3-4875-92f9-b4316177ddca\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn"
Oct 30 23:48:41.786678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:41.719993    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5975b24e-2fa3-4875-92f9-b4316177ddca-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn\" (UID: \"5975b24e-2fa3-4875-92f9-b4316177ddca\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn"
Oct 30 23:48:41.786678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:41.736498    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:42.163376 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:42.162751    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9k5b\" (UniqueName: \"kubernetes.io/projected/5975b24e-2fa3-4875-92f9-b4316177ddca-kube-api-access-t9k5b\") pod \"payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn\" (UID: \"5975b24e-2fa3-4875-92f9-b4316177ddca\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn"
Oct 30 23:48:42.163376 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:42.162965    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5975b24e-2fa3-4875-92f9-b4316177ddca-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn\" (UID: \"5975b24e-2fa3-4875-92f9-b4316177ddca\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn"
Oct 30 23:48:42.191623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:42.180993    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5975b24e-2fa3-4875-92f9-b4316177ddca-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn\" (UID: \"5975b24e-2fa3-4875-92f9-b4316177ddca\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn"
Oct 30 23:48:42.245645 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:42.228161    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"]
Oct 30 23:48:42.245645 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:42.228511    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6" podUID="fdf6241b-c315-455e-961d-76564291e53f" containerName="istio-proxy" containerID="cri-o://47da05efa7190f4498c7343bc3852a09fb76ee6ee9818d718e054c8285690106" gracePeriod=30
Oct 30 23:48:42.263375 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:42.263332    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"]
Oct 30 23:48:42.270492 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:42.265058    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l" podUID="a1c33c43-ad1c-409a-91d0-51a15a29304b" containerName="istio-proxy" containerID="cri-o://fc9bbda83eb3c334bd56791392c5ebaa4492ce008f0d24efb14c1b3983d9b7cc" gracePeriod=30
Oct 30 23:48:42.271963 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:42.271942    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9k5b\" (UniqueName: \"kubernetes.io/projected/5975b24e-2fa3-4875-92f9-b4316177ddca-kube-api-access-t9k5b\") pod \"payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn\" (UID: \"5975b24e-2fa3-4875-92f9-b4316177ddca\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn"
Oct 30 23:48:42.276030 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:42.275524    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"]
Oct 30 23:48:42.276457 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:42.276365    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc" podUID="1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" containerName="istio-proxy" containerID="cri-o://d3bfea8ba74449b574a6be42f3d305f29b945cead11937d65d514e131eb6d37b" gracePeriod=30
Oct 30 23:48:42.293656 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:42.287271    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"]
Oct 30 23:48:42.293656 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:42.287495    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp" podUID="66eff4e5-734b-4b15-82db-5cccb5521c00" containerName="istio-proxy" containerID="cri-o://185d1d0ec04093dfbfe509df88d008d906d4e51754bee71592522684ad2b5b3e" gracePeriod=30
Oct 30 23:48:42.299706 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:42.299674    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"]
Oct 30 23:48:42.299934 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:42.299907    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz" podUID="5db30e90-72c0-41bd-bc2d-101e8ece1f35" containerName="istio-proxy" containerID="cri-o://b2206ffad8a33d22224d9364026301fee166c734f82addc735545ae34a787813" gracePeriod=30
Oct 30 23:48:42.305078 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:42.305053    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"]
Oct 30 23:48:42.305276 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:42.305256    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g" podUID="3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" containerName="istio-proxy" containerID="cri-o://119c25b0c8823af3b3bf92dd7e05955cba562a3d597f071d5472aefc0766e8e5" gracePeriod=30
Oct 30 23:48:42.529545 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:42.522163    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:42.538754 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:42.538331    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn"
Oct 30 23:48:42.916807 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:42.916779    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn"]
Oct 30 23:48:42.917428 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:48:42.917405    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5975b24e_2fa3_4875_92f9_b4316177ddca.slice/crio-2ba7730b9dc1de08501d6be8d806609dfc9330758c99dbd757d37634ca8ab17f WatchSource:0}: Error finding container 2ba7730b9dc1de08501d6be8d806609dfc9330758c99dbd757d37634ca8ab17f: Status 404 returned error can't find the container with id 2ba7730b9dc1de08501d6be8d806609dfc9330758c99dbd757d37634ca8ab17f
Oct 30 23:48:43.234463 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:43.234371    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:43.263624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:43.243687    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn" event={"ID":"5975b24e-2fa3-4875-92f9-b4316177ddca","Type":"ContainerStarted","Data":"02a25a3997a55df776ca9f170a4d52c80856b96cd503a0d0a9fcf880ba389d78"}
Oct 30 23:48:43.263624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:43.243753    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn" event={"ID":"5975b24e-2fa3-4875-92f9-b4316177ddca","Type":"ContainerStarted","Data":"2ba7730b9dc1de08501d6be8d806609dfc9330758c99dbd757d37634ca8ab17f"}
Oct 30 23:48:43.263624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:43.245957    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn"
Oct 30 23:48:43.317654 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:43.314861    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn" podStartSLOduration=2.314841569 podStartE2EDuration="2.314841569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:43.309446572 +0000 UTC m=+1782.554302341" watchObservedRunningTime="2026-10-30 23:48:43.314841569 +0000 UTC m=+1782.559697338"
Oct 30 23:48:43.798045 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:43.798011    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"]
Oct 30 23:48:43.798239 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:43.798213    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts" podUID="b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317" containerName="maas-api" containerID="cri-o://c93a2e516a6fb64b88a06bc0683608e0340213c66c8e184ed9a1e5f8a6a66368" gracePeriod=30
Oct 30 23:48:43.864697 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:43.864669    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:44.109042 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:44.107262    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:44.298664 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:44.292990    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:44.554368 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:44.554282    4921 generic.go:356] "Generic (PLEG): container finished" podID="b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317" containerID="c93a2e516a6fb64b88a06bc0683608e0340213c66c8e184ed9a1e5f8a6a66368" exitCode=0
Oct 30 23:48:44.555726 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:44.555666    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts" event={"ID":"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317","Type":"ContainerDied","Data":"c93a2e516a6fb64b88a06bc0683608e0340213c66c8e184ed9a1e5f8a6a66368"}
Oct 30 23:48:44.557666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:44.557614    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:44.672623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:44.667070    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"
Oct 30 23:48:44.747110 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:44.747082    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-kube-api-access-kptbb\" (UniqueName: \"kubernetes.io/projected/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-kube-api-access-kptbb\") pod \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\" (UID: \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\") "
Oct 30 23:48:44.747303 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:44.747123    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-metrics-certs\") pod \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\" (UID: \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\") "
Oct 30 23:48:44.747457 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:44.747435    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-maas-api-tls\") pod \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\" (UID: \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\") "
Oct 30 23:48:44.747538 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:44.747477    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-openshift-service-ca\") pod \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\" (UID: \"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317\") "
Oct 30 23:48:44.748235 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:44.748188    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-openshift-service-ca" pod "b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317" (UID: "b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:48:44.748855 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:44.748816    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:44.749738 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:44.749713    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-kube-api-access-kptbb" pod "b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317" (UID: "b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317"). InnerVolumeSpecName "kube-api-access-kptbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:44.749864 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:44.749833    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-metrics-certs" pod "b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317" (UID: "b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:48:44.750490 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:44.750457    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-maas-api-tls" pod "b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317" (UID: "b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:48:44.851498 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:44.851406    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:44.851498 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:44.851450    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kptbb\" (UniqueName: \"kubernetes.io/projected/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-kube-api-access-kptbb\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:44.851498 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:44.851466    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:45.563928 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:45.563895    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"
Oct 30 23:48:45.564390 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:45.563917    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts" event={"ID":"b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317","Type":"ContainerDied","Data":"7d0dfe69472a046220d7d7135704e6def8698a5f9e386012974358ace5aaa997"}
Oct 30 23:48:45.564390 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:45.564015    4921 scope.go:122] "RemoveContainer" containerID="c93a2e516a6fb64b88a06bc0683608e0340213c66c8e184ed9a1e5f8a6a66368"
Oct 30 23:48:45.589728 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:45.589698    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"]
Oct 30 23:48:45.593896 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:45.593874    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6a162557-55c4486749-7mwts"]
Oct 30 23:48:45.602350 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:45.602316    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:46.415828 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:46.415800    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:46.885175 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:46.885146    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317" path="/var/lib/kubelet/pods/b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317/volumes"
Oct 30 23:48:47.107473 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.107441    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g"
Oct 30 23:48:47.175114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.175009    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:47.625230 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.624998    4921 generic.go:356] "Generic (PLEG): container finished" podID="66eff4e5-734b-4b15-82db-5cccb5521c00" containerID="185d1d0ec04093dfbfe509df88d008d906d4e51754bee71592522684ad2b5b3e" exitCode=0
Oct 30 23:48:47.625230 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.625105    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp" event={"ID":"66eff4e5-734b-4b15-82db-5cccb5521c00","Type":"ContainerDied","Data":"185d1d0ec04093dfbfe509df88d008d906d4e51754bee71592522684ad2b5b3e"}
Oct 30 23:48:47.627316 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.627283    4921 generic.go:356] "Generic (PLEG): container finished" podID="1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" containerID="d3bfea8ba74449b574a6be42f3d305f29b945cead11937d65d514e131eb6d37b" exitCode=0
Oct 30 23:48:47.627443 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.627418    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc" event={"ID":"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3","Type":"ContainerDied","Data":"d3bfea8ba74449b574a6be42f3d305f29b945cead11937d65d514e131eb6d37b"}
Oct 30 23:48:47.629222 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.629100    4921 generic.go:356] "Generic (PLEG): container finished" podID="fdf6241b-c315-455e-961d-76564291e53f" containerID="47da05efa7190f4498c7343bc3852a09fb76ee6ee9818d718e054c8285690106" exitCode=0
Oct 30 23:48:47.629322 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.629235    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6" event={"ID":"fdf6241b-c315-455e-961d-76564291e53f","Type":"ContainerDied","Data":"47da05efa7190f4498c7343bc3852a09fb76ee6ee9818d718e054c8285690106"}
Oct 30 23:48:47.630848 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.630826    4921 generic.go:356] "Generic (PLEG): container finished" podID="3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" containerID="119c25b0c8823af3b3bf92dd7e05955cba562a3d597f071d5472aefc0766e8e5" exitCode=0
Oct 30 23:48:47.630939 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.630903    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g" event={"ID":"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9","Type":"ContainerDied","Data":"119c25b0c8823af3b3bf92dd7e05955cba562a3d597f071d5472aefc0766e8e5"}
Oct 30 23:48:47.632723 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.632703    4921 generic.go:356] "Generic (PLEG): container finished" podID="a1c33c43-ad1c-409a-91d0-51a15a29304b" containerID="fc9bbda83eb3c334bd56791392c5ebaa4492ce008f0d24efb14c1b3983d9b7cc" exitCode=0
Oct 30 23:48:47.632846 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.632827    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l" event={"ID":"a1c33c43-ad1c-409a-91d0-51a15a29304b","Type":"ContainerDied","Data":"fc9bbda83eb3c334bd56791392c5ebaa4492ce008f0d24efb14c1b3983d9b7cc"}
Oct 30 23:48:47.634730 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.634617    4921 generic.go:356] "Generic (PLEG): container finished" podID="5db30e90-72c0-41bd-bc2d-101e8ece1f35" containerID="b2206ffad8a33d22224d9364026301fee166c734f82addc735545ae34a787813" exitCode=0
Oct 30 23:48:47.634730 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.634656    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz" event={"ID":"5db30e90-72c0-41bd-bc2d-101e8ece1f35","Type":"ContainerDied","Data":"b2206ffad8a33d22224d9364026301fee166c734f82addc735545ae34a787813"}
Oct 30 23:48:47.816621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.812059    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:48:47.872131 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.872106    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:48:47.874162 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.874136    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:48:47.891302 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.891268    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:48:47.913990 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.913271    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:48:47.918652 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.918281    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957198    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a1c33c43-ad1c-409a-91d0-51a15a29304b-kube-api-access-9hm2f\" (UniqueName: \"kubernetes.io/projected/a1c33c43-ad1c-409a-91d0-51a15a29304b-kube-api-access-9hm2f\") pod \"a1c33c43-ad1c-409a-91d0-51a15a29304b\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957261    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fdf6241b-c315-455e-961d-76564291e53f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdf6241b-c315-455e-961d-76564291e53f-istio-podinfo\") pod \"fdf6241b-c315-455e-961d-76564291e53f\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957284    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-istio-envoy\") pod \"fdf6241b-c315-455e-961d-76564291e53f\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957338    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-envoy\") pod \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957388    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-token\" (UniqueName: \"kubernetes.io/projected/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-token\") pod \"a1c33c43-ad1c-409a-91d0-51a15a29304b\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957422    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-envoy\") pod \"66eff4e5-734b-4b15-82db-5cccb5521c00\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957462    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-workload-certs\") pod \"66eff4e5-734b-4b15-82db-5cccb5521c00\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957484    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fdf6241b-c315-455e-961d-76564291e53f-kube-api-access-zxd5q\" (UniqueName: \"kubernetes.io/projected/fdf6241b-c315-455e-961d-76564291e53f-kube-api-access-zxd5q\") pod \"fdf6241b-c315-455e-961d-76564291e53f\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957508    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-workload-socket\") pod \"66eff4e5-734b-4b15-82db-5cccb5521c00\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957527    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-podinfo\") pod \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957551    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-credential-socket\") pod \"a1c33c43-ad1c-409a-91d0-51a15a29304b\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957568    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66eff4e5-734b-4b15-82db-5cccb5521c00-kube-api-access-sb87h\" (UniqueName: \"kubernetes.io/projected/66eff4e5-734b-4b15-82db-5cccb5521c00-kube-api-access-sb87h\") pod \"66eff4e5-734b-4b15-82db-5cccb5521c00\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957634    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-data\") pod \"66eff4e5-734b-4b15-82db-5cccb5521c00\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957677    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a1c33c43-ad1c-409a-91d0-51a15a29304b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1c33c43-ad1c-409a-91d0-51a15a29304b-istiod-ca-cert\") pod \"a1c33c43-ad1c-409a-91d0-51a15a29304b\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957707    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fdf6241b-c315-455e-961d-76564291e53f-istio-token\" (UniqueName: \"kubernetes.io/projected/fdf6241b-c315-455e-961d-76564291e53f-istio-token\") pod \"fdf6241b-c315-455e-961d-76564291e53f\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957733    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-workload-certs\") pod \"fdf6241b-c315-455e-961d-76564291e53f\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957761    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-credential-socket\") pod \"fdf6241b-c315-455e-961d-76564291e53f\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957838    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-credential-socket\") pod \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957919    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-workload-socket" pod "66eff4e5-734b-4b15-82db-5cccb5521c00" (UID: "66eff4e5-734b-4b15-82db-5cccb5521c00"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.957947    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-podinfo\") pod \"a1c33c43-ad1c-409a-91d0-51a15a29304b\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.958002    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-data\") pod \"a1c33c43-ad1c-409a-91d0-51a15a29304b\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.958043    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-credential-socket\") pod \"66eff4e5-734b-4b15-82db-5cccb5521c00\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.958080    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-istio-data\") pod \"fdf6241b-c315-455e-961d-76564291e53f\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.958129    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-data\") pod \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.958196    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-workload-socket\") pod \"a1c33c43-ad1c-409a-91d0-51a15a29304b\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.958228    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-workload-socket\") pod \"fdf6241b-c315-455e-961d-76564291e53f\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.958270    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5db30e90-72c0-41bd-bc2d-101e8ece1f35-kube-api-access-nczs7\" (UniqueName: \"kubernetes.io/projected/5db30e90-72c0-41bd-bc2d-101e8ece1f35-kube-api-access-nczs7\") pod \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.958330    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/66eff4e5-734b-4b15-82db-5cccb5521c00-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66eff4e5-734b-4b15-82db-5cccb5521c00-istiod-ca-cert\") pod \"66eff4e5-734b-4b15-82db-5cccb5521c00\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.958365    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-token\" (UniqueName: \"kubernetes.io/projected/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-token\") pod \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.958385    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-workload-certs\") pod \"a1c33c43-ad1c-409a-91d0-51a15a29304b\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.958403    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istiod-ca-cert\") pod \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.958484    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fdf6241b-c315-455e-961d-76564291e53f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdf6241b-c315-455e-961d-76564291e53f-istiod-ca-cert\") pod \"fdf6241b-c315-455e-961d-76564291e53f\" (UID: \"fdf6241b-c315-455e-961d-76564291e53f\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.958509    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-podinfo\") pod \"66eff4e5-734b-4b15-82db-5cccb5521c00\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.958535    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-workload-socket\") pod \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.958557    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-workload-certs\") pod \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\" (UID: \"5db30e90-72c0-41bd-bc2d-101e8ece1f35\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.958618    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-token\" (UniqueName: \"kubernetes.io/projected/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-token\") pod \"66eff4e5-734b-4b15-82db-5cccb5521c00\" (UID: \"66eff4e5-734b-4b15-82db-5cccb5521c00\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.958669    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-envoy\") pod \"a1c33c43-ad1c-409a-91d0-51a15a29304b\" (UID: \"a1c33c43-ad1c-409a-91d0-51a15a29304b\") "
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.960026    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.960505    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-data" pod "66eff4e5-734b-4b15-82db-5cccb5521c00" (UID: "66eff4e5-734b-4b15-82db-5cccb5521c00"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.960846    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1c33c43-ad1c-409a-91d0-51a15a29304b-istiod-ca-cert" pod "a1c33c43-ad1c-409a-91d0-51a15a29304b" (UID: "a1c33c43-ad1c-409a-91d0-51a15a29304b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.961133    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-credential-socket" pod "a1c33c43-ad1c-409a-91d0-51a15a29304b" (UID: "a1c33c43-ad1c-409a-91d0-51a15a29304b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.961735    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-credential-socket" pod "fdf6241b-c315-455e-961d-76564291e53f" (UID: "fdf6241b-c315-455e-961d-76564291e53f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.961910    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-envoy" pod "5db30e90-72c0-41bd-bc2d-101e8ece1f35" (UID: "5db30e90-72c0-41bd-bc2d-101e8ece1f35"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.961978    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-workload-certs" pod "fdf6241b-c315-455e-961d-76564291e53f" (UID: "fdf6241b-c315-455e-961d-76564291e53f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.962019    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-workload-certs" pod "66eff4e5-734b-4b15-82db-5cccb5521c00" (UID: "66eff4e5-734b-4b15-82db-5cccb5521c00"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.963028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.962110    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-credential-socket" pod "5db30e90-72c0-41bd-bc2d-101e8ece1f35" (UID: "5db30e90-72c0-41bd-bc2d-101e8ece1f35"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.966279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.964679    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-workload-certs" pod "a1c33c43-ad1c-409a-91d0-51a15a29304b" (UID: "a1c33c43-ad1c-409a-91d0-51a15a29304b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.966279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.964947    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-data" pod "a1c33c43-ad1c-409a-91d0-51a15a29304b" (UID: "a1c33c43-ad1c-409a-91d0-51a15a29304b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.966279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.965223    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-credential-socket" pod "66eff4e5-734b-4b15-82db-5cccb5521c00" (UID: "66eff4e5-734b-4b15-82db-5cccb5521c00"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.966279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.965693    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-istio-data" pod "fdf6241b-c315-455e-961d-76564291e53f" (UID: "fdf6241b-c315-455e-961d-76564291e53f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.966279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.966054    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-data" pod "5db30e90-72c0-41bd-bc2d-101e8ece1f35" (UID: "5db30e90-72c0-41bd-bc2d-101e8ece1f35"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.966539 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.966310    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-workload-socket" pod "a1c33c43-ad1c-409a-91d0-51a15a29304b" (UID: "a1c33c43-ad1c-409a-91d0-51a15a29304b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.968909 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.966628    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-workload-certs" pod "5db30e90-72c0-41bd-bc2d-101e8ece1f35" (UID: "5db30e90-72c0-41bd-bc2d-101e8ece1f35"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.968909 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.967098    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istiod-ca-cert" pod "5db30e90-72c0-41bd-bc2d-101e8ece1f35" (UID: "5db30e90-72c0-41bd-bc2d-101e8ece1f35"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:48:47.968909 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.967493    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdf6241b-c315-455e-961d-76564291e53f-istiod-ca-cert" pod "fdf6241b-c315-455e-961d-76564291e53f" (UID: "fdf6241b-c315-455e-961d-76564291e53f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:48:47.968909 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.967774    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-workload-socket" pod "5db30e90-72c0-41bd-bc2d-101e8ece1f35" (UID: "5db30e90-72c0-41bd-bc2d-101e8ece1f35"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.968909 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.968579    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-workload-socket" pod "fdf6241b-c315-455e-961d-76564291e53f" (UID: "fdf6241b-c315-455e-961d-76564291e53f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.981497 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.970653    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-envoy" pod "66eff4e5-734b-4b15-82db-5cccb5521c00" (UID: "66eff4e5-734b-4b15-82db-5cccb5521c00"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.981497 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.974344    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-envoy" pod "a1c33c43-ad1c-409a-91d0-51a15a29304b" (UID: "a1c33c43-ad1c-409a-91d0-51a15a29304b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.981497 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.974465    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-podinfo" pod "66eff4e5-734b-4b15-82db-5cccb5521c00" (UID: "66eff4e5-734b-4b15-82db-5cccb5521c00"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:48:47.981497 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.974711    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-istio-envoy" pod "fdf6241b-c315-455e-961d-76564291e53f" (UID: "fdf6241b-c315-455e-961d-76564291e53f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:47.981497 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.975493    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fdf6241b-c315-455e-961d-76564291e53f-istio-podinfo" pod "fdf6241b-c315-455e-961d-76564291e53f" (UID: "fdf6241b-c315-455e-961d-76564291e53f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:48:47.981497 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.975532    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-token" pod "66eff4e5-734b-4b15-82db-5cccb5521c00" (UID: "66eff4e5-734b-4b15-82db-5cccb5521c00"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:47.981497 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.976953    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66eff4e5-734b-4b15-82db-5cccb5521c00-istiod-ca-cert" pod "66eff4e5-734b-4b15-82db-5cccb5521c00" (UID: "66eff4e5-734b-4b15-82db-5cccb5521c00"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:48:47.981497 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.978820    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-token" pod "5db30e90-72c0-41bd-bc2d-101e8ece1f35" (UID: "5db30e90-72c0-41bd-bc2d-101e8ece1f35"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:47.981497 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.979398    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66eff4e5-734b-4b15-82db-5cccb5521c00-kube-api-access-sb87h" pod "66eff4e5-734b-4b15-82db-5cccb5521c00" (UID: "66eff4e5-734b-4b15-82db-5cccb5521c00"). InnerVolumeSpecName "kube-api-access-sb87h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:47.981497 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.979562    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1c33c43-ad1c-409a-91d0-51a15a29304b-kube-api-access-9hm2f" pod "a1c33c43-ad1c-409a-91d0-51a15a29304b" (UID: "a1c33c43-ad1c-409a-91d0-51a15a29304b"). InnerVolumeSpecName "kube-api-access-9hm2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:47.981497 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.979887    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-podinfo" pod "5db30e90-72c0-41bd-bc2d-101e8ece1f35" (UID: "5db30e90-72c0-41bd-bc2d-101e8ece1f35"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:48:47.981497 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.979959    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdf6241b-c315-455e-961d-76564291e53f-kube-api-access-zxd5q" pod "fdf6241b-c315-455e-961d-76564291e53f" (UID: "fdf6241b-c315-455e-961d-76564291e53f"). InnerVolumeSpecName "kube-api-access-zxd5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:47.981497 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.980046    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdf6241b-c315-455e-961d-76564291e53f-istio-token" pod "fdf6241b-c315-455e-961d-76564291e53f" (UID: "fdf6241b-c315-455e-961d-76564291e53f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:47.981497 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.980833    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-podinfo" pod "a1c33c43-ad1c-409a-91d0-51a15a29304b" (UID: "a1c33c43-ad1c-409a-91d0-51a15a29304b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:48:47.983554 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.983510    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-token" pod "a1c33c43-ad1c-409a-91d0-51a15a29304b" (UID: "a1c33c43-ad1c-409a-91d0-51a15a29304b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:47.984671 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.984631    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5db30e90-72c0-41bd-bc2d-101e8ece1f35-kube-api-access-nczs7" pod "5db30e90-72c0-41bd-bc2d-101e8ece1f35" (UID: "5db30e90-72c0-41bd-bc2d-101e8ece1f35"). InnerVolumeSpecName "kube-api-access-nczs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:47.988720 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:47.988700    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:48:48.063395 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.063342    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-envoy\") pod \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") "
Oct 30 23:48:48.063632 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.063453    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-workload-socket\") pod \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") "
Oct 30 23:48:48.063632 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.063507    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-workload-socket\") pod \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") "
Oct 30 23:48:48.063632 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.063539    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-token\" (UniqueName: \"kubernetes.io/projected/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-token\") pod \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") "
Oct 30 23:48:48.063632 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.063608    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-credential-socket\") pod \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") "
Oct 30 23:48:48.063825 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.063657    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-workload-certs\") pod \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") "
Oct 30 23:48:48.063825 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.063741    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istiod-ca-cert\") pod \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") "
Oct 30 23:48:48.063825 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.063796    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-data\") pod \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") "
Oct 30 23:48:48.063932 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.063844    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-credential-socket\") pod \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") "
Oct 30 23:48:48.063932 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.063879    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-podinfo\") pod \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") "
Oct 30 23:48:48.063932 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.063920    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-envoy\") pod \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") "
Oct 30 23:48:48.064040 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.063971    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-data\") pod \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") "
Oct 30 23:48:48.064040 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.064029    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-token\" (UniqueName: \"kubernetes.io/projected/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-token\") pod \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") "
Oct 30 23:48:48.064116 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.064086    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-workload-certs\") pod \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") "
Oct 30 23:48:48.064163 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.064128    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-kube-api-access-lsm6c\" (UniqueName: \"kubernetes.io/projected/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-kube-api-access-lsm6c\") pod \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") "
Oct 30 23:48:48.064226 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.064158    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-podinfo\") pod \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") "
Oct 30 23:48:48.064226 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.064216    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istiod-ca-cert\") pod \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\" (UID: \"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3\") "
Oct 30 23:48:48.064385 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.064364    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-kube-api-access-zpstg\" (UniqueName: \"kubernetes.io/projected/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-kube-api-access-zpstg\") pod \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\" (UID: \"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9\") "
Oct 30 23:48:48.065561 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065232    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-credential-socket" pod "3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" (UID: "3314cb8c-6ed4-4e6d-80d6-1d38940e88a9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:48.065764 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065701    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hm2f\" (UniqueName: \"kubernetes.io/projected/a1c33c43-ad1c-409a-91d0-51a15a29304b-kube-api-access-9hm2f\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.065764 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065725    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdf6241b-c315-455e-961d-76564291e53f-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.065764 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065742    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.065764 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065757    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065770    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065785    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065799    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065813    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxd5q\" (UniqueName: \"kubernetes.io/projected/fdf6241b-c315-455e-961d-76564291e53f-kube-api-access-zxd5q\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065827    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065841    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065855    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sb87h\" (UniqueName: \"kubernetes.io/projected/66eff4e5-734b-4b15-82db-5cccb5521c00-kube-api-access-sb87h\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065869    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065884    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1c33c43-ad1c-409a-91d0-51a15a29304b-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065898    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdf6241b-c315-455e-961d-76564291e53f-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065911    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065925    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065939    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065953    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065967    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065981    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66eff4e5-734b-4b15-82db-5cccb5521c00-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.065995    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.066009    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.066024    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.066037    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.066053    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf6241b-c315-455e-961d-76564291e53f-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.066054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.066069    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nczs7\" (UniqueName: \"kubernetes.io/projected/5db30e90-72c0-41bd-bc2d-101e8ece1f35-kube-api-access-nczs7\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.068317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.066084    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66eff4e5-734b-4b15-82db-5cccb5521c00-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.068317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.066097    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.068317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.066111    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.068317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.066124    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5db30e90-72c0-41bd-bc2d-101e8ece1f35-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.068317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.066140    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdf6241b-c315-455e-961d-76564291e53f-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.068317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.066153    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.068317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.066240    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.068317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.066256    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5db30e90-72c0-41bd-bc2d-101e8ece1f35-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.068317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.066270    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66eff4e5-734b-4b15-82db-5cccb5521c00-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.068317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.066284    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1c33c43-ad1c-409a-91d0-51a15a29304b-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.069364 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.066873    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-data" pod "1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" (UID: "1425ac60-c9a8-4e11-9abd-b0b0cd652cb3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:48.069448 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.067909    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-workload-certs" pod "1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" (UID: "1425ac60-c9a8-4e11-9abd-b0b0cd652cb3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:48.069448 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.068087    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-credential-socket" pod "1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" (UID: "1425ac60-c9a8-4e11-9abd-b0b0cd652cb3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:48.069448 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.068251    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-workload-socket" pod "3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" (UID: "3314cb8c-6ed4-4e6d-80d6-1d38940e88a9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:48.069448 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.068437    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-workload-socket" pod "1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" (UID: "1425ac60-c9a8-4e11-9abd-b0b0cd652cb3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:48.070639 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.070612    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-envoy" pod "1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" (UID: "1425ac60-c9a8-4e11-9abd-b0b0cd652cb3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:48.071080 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.070758    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istiod-ca-cert" pod "1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" (UID: "1425ac60-c9a8-4e11-9abd-b0b0cd652cb3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:48:48.071080 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.071006    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-data" pod "3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" (UID: "3314cb8c-6ed4-4e6d-80d6-1d38940e88a9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:48.071297 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.071191    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-workload-certs" pod "3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" (UID: "3314cb8c-6ed4-4e6d-80d6-1d38940e88a9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:48.071648 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.071546    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istiod-ca-cert" pod "3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" (UID: "3314cb8c-6ed4-4e6d-80d6-1d38940e88a9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:48:48.071648 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.071610    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-token" pod "3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" (UID: "3314cb8c-6ed4-4e6d-80d6-1d38940e88a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:48.073199 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.073163    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-kube-api-access-zpstg" pod "3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" (UID: "3314cb8c-6ed4-4e6d-80d6-1d38940e88a9"). InnerVolumeSpecName "kube-api-access-zpstg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:48.073296 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.073194    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-envoy" pod "3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" (UID: "3314cb8c-6ed4-4e6d-80d6-1d38940e88a9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:48:48.074017 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.073986    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-kube-api-access-lsm6c" pod "1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" (UID: "1425ac60-c9a8-4e11-9abd-b0b0cd652cb3"). InnerVolumeSpecName "kube-api-access-lsm6c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:48.074222 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.074200    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-token" pod "1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" (UID: "1425ac60-c9a8-4e11-9abd-b0b0cd652cb3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:48:48.074425 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.074404    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-podinfo" pod "1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" (UID: "1425ac60-c9a8-4e11-9abd-b0b0cd652cb3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:48:48.075143 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.075126    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-podinfo" pod "3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" (UID: "3314cb8c-6ed4-4e6d-80d6-1d38940e88a9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:48:48.079655 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.079629    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:48.168726 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.168692    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.168726 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.168727    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.168942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.168742    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.168942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.168756    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.168942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.168770    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.168942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.168786    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.168942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.168800    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.168942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.168814    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsm6c\" (UniqueName: \"kubernetes.io/projected/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-kube-api-access-lsm6c\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.168942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.168829    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.168942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.168842    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.168942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.168867    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpstg\" (UniqueName: \"kubernetes.io/projected/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-kube-api-access-zpstg\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.168942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.168881    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.168942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.168895    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.168942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.168909    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.168942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.168922    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.168942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.168935    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.169416 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.168951    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:48:48.224503 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.224422    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:48.422630 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.418554    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:48.645498 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.645468    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"
Oct 30 23:48:48.645498 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.645472    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp" event={"ID":"66eff4e5-734b-4b15-82db-5cccb5521c00","Type":"ContainerDied","Data":"088825e02d7b42cf4bf3a984ae7e2863a514085aa12bdffac5ba04ebf89d60fd"}
Oct 30 23:48:48.645781 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.645544    4921 scope.go:122] "RemoveContainer" containerID="185d1d0ec04093dfbfe509df88d008d906d4e51754bee71592522684ad2b5b3e"
Oct 30 23:48:48.647004 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.646985    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"
Oct 30 23:48:48.647134 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.647028    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc" event={"ID":"1425ac60-c9a8-4e11-9abd-b0b0cd652cb3","Type":"ContainerDied","Data":"e1516f747fb2dd3531234dd3d3be89047f7d01e75486c6e37e2b6423de00b4f9"}
Oct 30 23:48:48.648769 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.648697    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6" event={"ID":"fdf6241b-c315-455e-961d-76564291e53f","Type":"ContainerDied","Data":"ed5c41c07b5622678d353dc2eef37616ee3726e15d659bf63213d46a6f9aeb46"}
Oct 30 23:48:48.648769 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.648753    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"
Oct 30 23:48:48.654688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.650429    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"
Oct 30 23:48:48.654688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.650431    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g" event={"ID":"3314cb8c-6ed4-4e6d-80d6-1d38940e88a9","Type":"ContainerDied","Data":"d9f95fa3dd5fb59f866b0c790da74475472eb4a336b253eafce61432b0c52124"}
Oct 30 23:48:48.654688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.652645    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"
Oct 30 23:48:48.654688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.652714    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l" event={"ID":"a1c33c43-ad1c-409a-91d0-51a15a29304b","Type":"ContainerDied","Data":"37ac9d2e1f436b3b2984bc96d382ef264d5fa414eabd17259bc7fd784a8efcc6"}
Oct 30 23:48:48.654688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.654163    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz" event={"ID":"5db30e90-72c0-41bd-bc2d-101e8ece1f35","Type":"ContainerDied","Data":"f91e173a364b9cd0439c9798d9f3d9bd2e952141d1b05b7a4bae7e58c3d8c4dd"}
Oct 30 23:48:48.654688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.654228    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"
Oct 30 23:48:48.662022 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.661998    4921 scope.go:122] "RemoveContainer" containerID="d3bfea8ba74449b574a6be42f3d305f29b945cead11937d65d514e131eb6d37b"
Oct 30 23:48:48.676113 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.676090    4921 scope.go:122] "RemoveContainer" containerID="47da05efa7190f4498c7343bc3852a09fb76ee6ee9818d718e054c8285690106"
Oct 30 23:48:48.691080 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.691053    4921 scope.go:122] "RemoveContainer" containerID="119c25b0c8823af3b3bf92dd7e05955cba562a3d597f071d5472aefc0766e8e5"
Oct 30 23:48:48.692263 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.692247    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"]
Oct 30 23:48:48.696884 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.696862    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-t5jhc"]
Oct 30 23:48:48.701440 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.701424    4921 scope.go:122] "RemoveContainer" containerID="fc9bbda83eb3c334bd56791392c5ebaa4492ce008f0d24efb14c1b3983d9b7cc"
Oct 30 23:48:48.707207 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.707186    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"]
Oct 30 23:48:48.713175 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.713156    4921 scope.go:122] "RemoveContainer" containerID="b2206ffad8a33d22224d9364026301fee166c734f82addc735545ae34a787813"
Oct 30 23:48:48.715985 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.715963    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-lsbxp"]
Oct 30 23:48:48.727980 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.727934    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"]
Oct 30 23:48:48.732457 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.732435    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-bvxg6"]
Oct 30 23:48:48.743823 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.743802    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"]
Oct 30 23:48:48.748339 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.748319    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-qvtzz"]
Oct 30 23:48:48.766472 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.766440    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"]
Oct 30 23:48:48.777583 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.777554    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-nkv9g"]
Oct 30 23:48:48.792273 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.792242    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"]
Oct 30 23:48:48.800689 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.800664    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-ztg8l"]
Oct 30 23:48:48.815581 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.815535    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:48.907921 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.907851    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" path="/var/lib/kubelet/pods/1425ac60-c9a8-4e11-9abd-b0b0cd652cb3/volumes"
Oct 30 23:48:48.908496 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.908478    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" path="/var/lib/kubelet/pods/3314cb8c-6ed4-4e6d-80d6-1d38940e88a9/volumes"
Oct 30 23:48:48.908972 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.908957    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5db30e90-72c0-41bd-bc2d-101e8ece1f35" path="/var/lib/kubelet/pods/5db30e90-72c0-41bd-bc2d-101e8ece1f35/volumes"
Oct 30 23:48:48.910006 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.909985    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="66eff4e5-734b-4b15-82db-5cccb5521c00" path="/var/lib/kubelet/pods/66eff4e5-734b-4b15-82db-5cccb5521c00/volumes"
Oct 30 23:48:48.910644 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.910617    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a1c33c43-ad1c-409a-91d0-51a15a29304b" path="/var/lib/kubelet/pods/a1c33c43-ad1c-409a-91d0-51a15a29304b/volumes"
Oct 30 23:48:48.911108 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:48.911086    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fdf6241b-c315-455e-961d-76564291e53f" path="/var/lib/kubelet/pods/fdf6241b-c315-455e-961d-76564291e53f/volumes"
Oct 30 23:48:49.066422 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.066389    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"]
Oct 30 23:48:49.067277 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067254    4921 cpu_manager.go:414] "containerMap: removing container" podUID="3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" containerName="istio-proxy"
Oct 30 23:48:49.067277 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067276    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" containerName="istio-proxy"
Oct 30 23:48:49.067452 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067317    4921 cpu_manager.go:414] "containerMap: removing container" podUID="5db30e90-72c0-41bd-bc2d-101e8ece1f35" containerName="istio-proxy"
Oct 30 23:48:49.067452 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067325    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5db30e90-72c0-41bd-bc2d-101e8ece1f35" containerName="istio-proxy"
Oct 30 23:48:49.067452 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067357    4921 cpu_manager.go:414] "containerMap: removing container" podUID="1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" containerName="istio-proxy"
Oct 30 23:48:49.067452 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067365    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" containerName="istio-proxy"
Oct 30 23:48:49.067452 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067379    4921 cpu_manager.go:414] "containerMap: removing container" podUID="66eff4e5-734b-4b15-82db-5cccb5521c00" containerName="istio-proxy"
Oct 30 23:48:49.067452 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067386    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="66eff4e5-734b-4b15-82db-5cccb5521c00" containerName="istio-proxy"
Oct 30 23:48:49.067452 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067399    4921 cpu_manager.go:414] "containerMap: removing container" podUID="fdf6241b-c315-455e-961d-76564291e53f" containerName="istio-proxy"
Oct 30 23:48:49.067452 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067406    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fdf6241b-c315-455e-961d-76564291e53f" containerName="istio-proxy"
Oct 30 23:48:49.067452 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067428    4921 cpu_manager.go:414] "containerMap: removing container" podUID="a1c33c43-ad1c-409a-91d0-51a15a29304b" containerName="istio-proxy"
Oct 30 23:48:49.067452 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067436    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a1c33c43-ad1c-409a-91d0-51a15a29304b" containerName="istio-proxy"
Oct 30 23:48:49.068015 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067464    4921 cpu_manager.go:414] "containerMap: removing container" podUID="b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317" containerName="maas-api"
Oct 30 23:48:49.068015 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067492    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317" containerName="maas-api"
Oct 30 23:48:49.068015 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067688    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="5db30e90-72c0-41bd-bc2d-101e8ece1f35" containerName="istio-proxy"
Oct 30 23:48:49.068015 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067710    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="1425ac60-c9a8-4e11-9abd-b0b0cd652cb3" containerName="istio-proxy"
Oct 30 23:48:49.068015 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067755    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="66eff4e5-734b-4b15-82db-5cccb5521c00" containerName="istio-proxy"
Oct 30 23:48:49.068015 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067766    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="fdf6241b-c315-455e-961d-76564291e53f" containerName="istio-proxy"
Oct 30 23:48:49.068015 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067781    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="a1c33c43-ad1c-409a-91d0-51a15a29304b" containerName="istio-proxy"
Oct 30 23:48:49.068015 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067796    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="b4ad1fa7-9ddb-41aa-bdfe-13e9f6b17317" containerName="maas-api"
Oct 30 23:48:49.068015 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.067808    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="3314cb8c-6ed4-4e6d-80d6-1d38940e88a9" containerName="istio-proxy"
Oct 30 23:48:49.070196 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.070169    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:49.074284 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.074244    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"
Oct 30 23:48:49.087444 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.087415    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"]
Oct 30 23:48:49.095126 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.093805    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-86d846-serving-cert\""
Oct 30 23:48:49.193400 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.193309    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ef5560-869d-42e3-80d5-090a164ad8e0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj\" (UID: \"95ef5560-869d-42e3-80d5-090a164ad8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"
Oct 30 23:48:49.193587 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.193445    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95ef5560-869d-42e3-80d5-090a164ad8e0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj\" (UID: \"95ef5560-869d-42e3-80d5-090a164ad8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"
Oct 30 23:48:49.193587 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.193475    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95ef5560-869d-42e3-80d5-090a164ad8e0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj\" (UID: \"95ef5560-869d-42e3-80d5-090a164ad8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"
Oct 30 23:48:49.193779 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.193657    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjpfd\" (UniqueName: \"kubernetes.io/projected/95ef5560-869d-42e3-80d5-090a164ad8e0-kube-api-access-sjpfd\") pod \"maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj\" (UID: \"95ef5560-869d-42e3-80d5-090a164ad8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"
Oct 30 23:48:49.210352 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.210329    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:49.305236 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.305193    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjpfd\" (UniqueName: \"kubernetes.io/projected/95ef5560-869d-42e3-80d5-090a164ad8e0-kube-api-access-sjpfd\") pod \"maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj\" (UID: \"95ef5560-869d-42e3-80d5-090a164ad8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"
Oct 30 23:48:49.305466 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.305444    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ef5560-869d-42e3-80d5-090a164ad8e0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj\" (UID: \"95ef5560-869d-42e3-80d5-090a164ad8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"
Oct 30 23:48:49.305573 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.305506    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95ef5560-869d-42e3-80d5-090a164ad8e0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj\" (UID: \"95ef5560-869d-42e3-80d5-090a164ad8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"
Oct 30 23:48:49.305573 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.305525    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95ef5560-869d-42e3-80d5-090a164ad8e0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj\" (UID: \"95ef5560-869d-42e3-80d5-090a164ad8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"
Oct 30 23:48:49.306314 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.306289    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95ef5560-869d-42e3-80d5-090a164ad8e0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj\" (UID: \"95ef5560-869d-42e3-80d5-090a164ad8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"
Oct 30 23:48:49.325673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.323990    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ef5560-869d-42e3-80d5-090a164ad8e0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj\" (UID: \"95ef5560-869d-42e3-80d5-090a164ad8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"
Oct 30 23:48:49.332988 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.332956    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjpfd\" (UniqueName: \"kubernetes.io/projected/95ef5560-869d-42e3-80d5-090a164ad8e0-kube-api-access-sjpfd\") pod \"maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj\" (UID: \"95ef5560-869d-42e3-80d5-090a164ad8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"
Oct 30 23:48:49.360640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.340806    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95ef5560-869d-42e3-80d5-090a164ad8e0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj\" (UID: \"95ef5560-869d-42e3-80d5-090a164ad8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"
Oct 30 23:48:49.365642 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.363967    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:49.401923 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.401701    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"
Oct 30 23:48:49.523678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.522908    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"]
Oct 30 23:48:49.577722 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.573075    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"]
Oct 30 23:48:49.577722 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.573198    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.593814 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.593783    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-f026c1-openshift-default-dockercfg-6hgm8\""
Oct 30 23:48:49.599766 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.599736    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:49.716309 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.716271    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-token\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.716506 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.716332    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-podinfo\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.716506 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.716454    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-workload-certs\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.716675 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.716569    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istiod-ca-cert\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.716745 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.716698    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-workload-socket\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.716886 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.716867    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7zp5\" (UniqueName: \"kubernetes.io/projected/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-kube-api-access-j7zp5\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.716999 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.716979    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-data\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.717123 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.717042    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-credential-socket\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.717123 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.717081    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-envoy\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.815292 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.815127    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:49.858974 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.857215    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7zp5\" (UniqueName: \"kubernetes.io/projected/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-kube-api-access-j7zp5\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.858974 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.857334    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-data\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.858974 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.857378    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-credential-socket\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.858974 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.857409    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-envoy\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.858974 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.857495    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-token\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.858974 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.857531    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-podinfo\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.858974 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.857580    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-workload-certs\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.858974 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.857734    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istiod-ca-cert\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.858974 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.857824    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-workload-socket\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.858974 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.858305    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-workload-socket\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.859564 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.859159    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-data\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.859698 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.859674    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-credential-socket\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.860017 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.859996    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-workload-certs\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.868616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.860493    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istiod-ca-cert\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.882367 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.881553    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-podinfo\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.908635 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.905165    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-envoy\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.941533 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.940278    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-token\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.941533 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.940691    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7zp5\" (UniqueName: \"kubernetes.io/projected/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-kube-api-access-j7zp5\") pod \"e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") " pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:49.977793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:49.977686    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"]
Oct 30 23:48:50.223457 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:50.223426    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:50.330528 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:50.330465    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:50.517831 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:50.517807    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"]
Oct 30 23:48:50.518013 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:48:50.517985    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45c5e91a_a12f_4ac4_b2e5_f6ecacce9b0d.slice/crio-b0b7f9b810ba1c5e88bc25ed744111bdc4c53c97b774681b526320f32e772d6b WatchSource:0}: Error finding container b0b7f9b810ba1c5e88bc25ed744111bdc4c53c97b774681b526320f32e772d6b: Status 404 returned error can't find the container with id b0b7f9b810ba1c5e88bc25ed744111bdc4c53c97b774681b526320f32e772d6b
Oct 30 23:48:50.521725 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:50.521682    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:48:50.521822 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:50.521773    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:48:50.521880 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:50.521820    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:48:50.696668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:50.695656    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj" event={"ID":"95ef5560-869d-42e3-80d5-090a164ad8e0","Type":"ContainerStarted","Data":"6b33cfad9285b3d30ccd7ca3db1009aee098d3c74d82ac4d492601a6bf416458"}
Oct 30 23:48:50.696850 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:50.696704    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"
Oct 30 23:48:50.696850 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:50.696727    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj" event={"ID":"95ef5560-869d-42e3-80d5-090a164ad8e0","Type":"ContainerStarted","Data":"ab11b11ef1fbd3a59e6abba7c5f6c04307d4a0ca0ce2b123fdd8877eb396c02f"}
Oct 30 23:48:50.698421 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:50.698384    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966" event={"ID":"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d","Type":"ContainerStarted","Data":"70e3a6f3ba4b65432b0ece760fb8b6cce809198ecc07203eae346ce5e1255c3d"}
Oct 30 23:48:50.698562 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:50.698441    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966" event={"ID":"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d","Type":"ContainerStarted","Data":"b0b7f9b810ba1c5e88bc25ed744111bdc4c53c97b774681b526320f32e772d6b"}
Oct 30 23:48:50.740900 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:50.740837    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj" podStartSLOduration=1.251510917 podStartE2EDuration="1.740798919s" totalImagesPullingTime="489.288002ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:50.717881335 +0000 UTC m=+1789.962737100" watchObservedRunningTime="2026-10-30 23:48:50.740798919 +0000 UTC m=+1789.985654687"
Oct 30 23:48:50.762587 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:50.762483    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966" podStartSLOduration=1.762469749 podStartE2EDuration="1.762469749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:50.759461384 +0000 UTC m=+1790.004317153" watchObservedRunningTime="2026-10-30 23:48:50.762469749 +0000 UTC m=+1790.007325516"
Oct 30 23:48:51.172310 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:51.172280    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv"
Oct 30 23:48:51.225969 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:51.225938    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:51.232930 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:51.232893    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:51.319877 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:51.319845    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:51.706680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:51.706644    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:51.707471 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:51.707455    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:48:52.220452 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.220419    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:52.360255 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.358231    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:52.654776 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.654739    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:52.678915 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.678879    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk"]
Oct 30 23:48:52.683765 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.683742    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk"
Oct 30 23:48:52.692410 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.692390    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-6a162557\""
Oct 30 23:48:52.692516 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.692392    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-6a162557-dockercfg-tsvsh\""
Oct 30 23:48:52.718535 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.715479    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk"]
Oct 30 23:48:52.750574 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.750540    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt"]
Oct 30 23:48:52.757539 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.757515    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt"
Oct 30 23:48:52.758676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.758644    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt"]
Oct 30 23:48:52.772502 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.772474    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/038d4dac-dd90-4ed7-8404-5ee03b567e8a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt\" (UID: \"038d4dac-dd90-4ed7-8404-5ee03b567e8a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt"
Oct 30 23:48:52.773203 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.773178    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwbgn\" (UniqueName: \"kubernetes.io/projected/9cfc9be7-9612-468a-aecc-611c10916665-kube-api-access-rwbgn\") pod \"payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk\" (UID: \"9cfc9be7-9612-468a-aecc-611c10916665\") " pod="openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk"
Oct 30 23:48:52.773468 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.773449    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2r58\" (UniqueName: \"kubernetes.io/projected/038d4dac-dd90-4ed7-8404-5ee03b567e8a-kube-api-access-n2r58\") pod \"payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt\" (UID: \"038d4dac-dd90-4ed7-8404-5ee03b567e8a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt"
Oct 30 23:48:52.773972 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.773951    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cfc9be7-9612-468a-aecc-611c10916665-plugins-config-volume\") pod \"payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk\" (UID: \"9cfc9be7-9612-468a-aecc-611c10916665\") " pod="openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk"
Oct 30 23:48:52.878685 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.877848    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwbgn\" (UniqueName: \"kubernetes.io/projected/9cfc9be7-9612-468a-aecc-611c10916665-kube-api-access-rwbgn\") pod \"payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk\" (UID: \"9cfc9be7-9612-468a-aecc-611c10916665\") " pod="openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk"
Oct 30 23:48:52.878685 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.877935    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2r58\" (UniqueName: \"kubernetes.io/projected/038d4dac-dd90-4ed7-8404-5ee03b567e8a-kube-api-access-n2r58\") pod \"payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt\" (UID: \"038d4dac-dd90-4ed7-8404-5ee03b567e8a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt"
Oct 30 23:48:52.878685 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.877985    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cfc9be7-9612-468a-aecc-611c10916665-plugins-config-volume\") pod \"payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk\" (UID: \"9cfc9be7-9612-468a-aecc-611c10916665\") " pod="openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk"
Oct 30 23:48:52.878685 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.878234    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/038d4dac-dd90-4ed7-8404-5ee03b567e8a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt\" (UID: \"038d4dac-dd90-4ed7-8404-5ee03b567e8a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt"
Oct 30 23:48:52.880268 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.880124    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cfc9be7-9612-468a-aecc-611c10916665-plugins-config-volume\") pod \"payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk\" (UID: \"9cfc9be7-9612-468a-aecc-611c10916665\") " pod="openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk"
Oct 30 23:48:52.898745 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.898703    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/038d4dac-dd90-4ed7-8404-5ee03b567e8a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt\" (UID: \"038d4dac-dd90-4ed7-8404-5ee03b567e8a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt"
Oct 30 23:48:52.954953 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:52.938507    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:53.122294 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:53.122258    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwbgn\" (UniqueName: \"kubernetes.io/projected/9cfc9be7-9612-468a-aecc-611c10916665-kube-api-access-rwbgn\") pod \"payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk\" (UID: \"9cfc9be7-9612-468a-aecc-611c10916665\") " pod="openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk"
Oct 30 23:48:53.125851 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:53.125784    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2r58\" (UniqueName: \"kubernetes.io/projected/038d4dac-dd90-4ed7-8404-5ee03b567e8a-kube-api-access-n2r58\") pod \"payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt\" (UID: \"038d4dac-dd90-4ed7-8404-5ee03b567e8a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt"
Oct 30 23:48:53.303458 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:53.303362    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk"
Oct 30 23:48:53.341694 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:53.341661    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:53.381757 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:53.381289    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt"
Oct 30 23:48:53.497724 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:53.490093    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:53.614716 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:48:53.614682    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cfc9be7_9612_468a_aecc_611c10916665.slice/crio-b859d5872d1597c05eb6905bdb58110ed6a27ecc1d0c1d081d7058adf6c49fac WatchSource:0}: Error finding container b859d5872d1597c05eb6905bdb58110ed6a27ecc1d0c1d081d7058adf6c49fac: Status 404 returned error can't find the container with id b859d5872d1597c05eb6905bdb58110ed6a27ecc1d0c1d081d7058adf6c49fac
Oct 30 23:48:53.615252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:53.615226    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk"]
Oct 30 23:48:53.708160 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:53.708132    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt"]
Oct 30 23:48:53.708287 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:48:53.708232    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod038d4dac_dd90_4ed7_8404_5ee03b567e8a.slice/crio-8d35cde68d4ed97dc86b13af0ec60f603c949de9dd5bf9eb9d1db38a009b76cb WatchSource:0}: Error finding container 8d35cde68d4ed97dc86b13af0ec60f603c949de9dd5bf9eb9d1db38a009b76cb: Status 404 returned error can't find the container with id 8d35cde68d4ed97dc86b13af0ec60f603c949de9dd5bf9eb9d1db38a009b76cb
Oct 30 23:48:53.734952 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:53.734919    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt" event={"ID":"038d4dac-dd90-4ed7-8404-5ee03b567e8a","Type":"ContainerStarted","Data":"8d35cde68d4ed97dc86b13af0ec60f603c949de9dd5bf9eb9d1db38a009b76cb"}
Oct 30 23:48:53.736933 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:53.736908    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk" event={"ID":"9cfc9be7-9612-468a-aecc-611c10916665","Type":"ContainerStarted","Data":"8f171b25ab7a8022276b18a121a7c9c0972ae64f21e771ee2589c4a4427631de"}
Oct 30 23:48:53.737051 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:53.736962    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk" event={"ID":"9cfc9be7-9612-468a-aecc-611c10916665","Type":"ContainerStarted","Data":"b859d5872d1597c05eb6905bdb58110ed6a27ecc1d0c1d081d7058adf6c49fac"}
Oct 30 23:48:53.775725 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:53.775666    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk" podStartSLOduration=1.7756452999999999 podStartE2EDuration="1.7756453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:53.766907615 +0000 UTC m=+1793.011763382" watchObservedRunningTime="2026-10-30 23:48:53.7756453 +0000 UTC m=+1793.020501068"
Oct 30 23:48:53.869326 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:53.869196    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:54.012655 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:54.010371    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:54.755350 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:54.755302    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt" event={"ID":"038d4dac-dd90-4ed7-8404-5ee03b567e8a","Type":"ContainerStarted","Data":"2185d0dabc97f0602154c69af6e5b173ae52e010bfa0db82f719ff780efe04f8"}
Oct 30 23:48:54.755870 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:54.755853    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk"
Oct 30 23:48:54.790486 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:54.790422    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt" podStartSLOduration=2.790403716 podStartE2EDuration="2.790403716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:54.78513895 +0000 UTC m=+1794.029994718" watchObservedRunningTime="2026-10-30 23:48:54.790403716 +0000 UTC m=+1794.035259485"
Oct 30 23:48:54.812541 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:54.812506    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:54.838573 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:54.838545    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79"]
Oct 30 23:48:54.843453 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:54.843326    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79"
Oct 30 23:48:54.847622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:54.847571    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc"]
Oct 30 23:48:54.853098 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:54.852856    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc"
Oct 30 23:48:54.857813 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:54.857787    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-f026c1-dockercfg-jsmqb\""
Oct 30 23:48:54.858750 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:54.858727    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-f026c1\""
Oct 30 23:48:54.863450 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:54.863427    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79"]
Oct 30 23:48:54.871073 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:54.871033    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc"]
Oct 30 23:48:55.037687 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:54.985925    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35d53e14-1486-48ec-96f3-7a51d4113174-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc\" (UID: \"35d53e14-1486-48ec-96f3-7a51d4113174\") " pod="openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc"
Oct 30 23:48:55.038065 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:55.038031    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g7n7\" (UniqueName: \"kubernetes.io/projected/35d53e14-1486-48ec-96f3-7a51d4113174-kube-api-access-2g7n7\") pod \"payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc\" (UID: \"35d53e14-1486-48ec-96f3-7a51d4113174\") " pod="openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc"
Oct 30 23:48:55.038422 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:55.038391    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqc84\" (UniqueName: \"kubernetes.io/projected/2d48a824-865d-447c-8b1c-64cc99b41dca-kube-api-access-gqc84\") pod \"payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79\" (UID: \"2d48a824-865d-447c-8b1c-64cc99b41dca\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79"
Oct 30 23:48:55.038711 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:55.038690    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d48a824-865d-447c-8b1c-64cc99b41dca-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79\" (UID: \"2d48a824-865d-447c-8b1c-64cc99b41dca\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79"
Oct 30 23:48:55.040201 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:55.002102    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:55.143619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:55.143027    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d48a824-865d-447c-8b1c-64cc99b41dca-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79\" (UID: \"2d48a824-865d-447c-8b1c-64cc99b41dca\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79"
Oct 30 23:48:55.143619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:55.143320    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35d53e14-1486-48ec-96f3-7a51d4113174-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc\" (UID: \"35d53e14-1486-48ec-96f3-7a51d4113174\") " pod="openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc"
Oct 30 23:48:55.143619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:55.143411    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g7n7\" (UniqueName: \"kubernetes.io/projected/35d53e14-1486-48ec-96f3-7a51d4113174-kube-api-access-2g7n7\") pod \"payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc\" (UID: \"35d53e14-1486-48ec-96f3-7a51d4113174\") " pod="openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc"
Oct 30 23:48:55.143952 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:55.143651    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqc84\" (UniqueName: \"kubernetes.io/projected/2d48a824-865d-447c-8b1c-64cc99b41dca-kube-api-access-gqc84\") pod \"payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79\" (UID: \"2d48a824-865d-447c-8b1c-64cc99b41dca\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79"
Oct 30 23:48:55.147617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:55.145143    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d48a824-865d-447c-8b1c-64cc99b41dca-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79\" (UID: \"2d48a824-865d-447c-8b1c-64cc99b41dca\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79"
Oct 30 23:48:55.164651 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:55.162889    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35d53e14-1486-48ec-96f3-7a51d4113174-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc\" (UID: \"35d53e14-1486-48ec-96f3-7a51d4113174\") " pod="openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc"
Oct 30 23:48:55.192617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:55.188753    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqc84\" (UniqueName: \"kubernetes.io/projected/2d48a824-865d-447c-8b1c-64cc99b41dca-kube-api-access-gqc84\") pod \"payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79\" (UID: \"2d48a824-865d-447c-8b1c-64cc99b41dca\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79"
Oct 30 23:48:55.218652 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:55.215335    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g7n7\" (UniqueName: \"kubernetes.io/projected/35d53e14-1486-48ec-96f3-7a51d4113174-kube-api-access-2g7n7\") pod \"payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc\" (UID: \"35d53e14-1486-48ec-96f3-7a51d4113174\") " pod="openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc"
Oct 30 23:48:55.229085 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:55.229051    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:55.462886 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:55.462803    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79"
Oct 30 23:48:55.475108 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:55.475003    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc"
Oct 30 23:48:55.570796 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:55.570764    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn"
Oct 30 23:48:55.763967 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:55.763870    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt"
Oct 30 23:48:55.811755 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:48:55.811716    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d53e14_1486_48ec_96f3_7a51d4113174.slice/crio-fec4ac1bf30b5e9f4370dc12c15f21b8fa0f5e1f56ad492ba648b02aca862fcd WatchSource:0}: Error finding container fec4ac1bf30b5e9f4370dc12c15f21b8fa0f5e1f56ad492ba648b02aca862fcd: Status 404 returned error can't find the container with id fec4ac1bf30b5e9f4370dc12c15f21b8fa0f5e1f56ad492ba648b02aca862fcd
Oct 30 23:48:55.814027 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:55.811827    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc"]
Oct 30 23:48:55.817714 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:48:55.817688    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d48a824_865d_447c_8b1c_64cc99b41dca.slice/crio-2aa38d2c737e40ef556046bf33817329fcebb8d8f1f428428cf06fd1ed018a8b WatchSource:0}: Error finding container 2aa38d2c737e40ef556046bf33817329fcebb8d8f1f428428cf06fd1ed018a8b: Status 404 returned error can't find the container with id 2aa38d2c737e40ef556046bf33817329fcebb8d8f1f428428cf06fd1ed018a8b
Oct 30 23:48:55.818867 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:55.818772    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79"]
Oct 30 23:48:56.160931 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:56.160903    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:56.313139 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:56.313105    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:56.725641 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:56.724697    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"
Oct 30 23:48:56.779186 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:56.779154    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc" event={"ID":"35d53e14-1486-48ec-96f3-7a51d4113174","Type":"ContainerStarted","Data":"6d694c320a56e6248339416cb93d351ec993dcc81e16804e5db97d340788865c"}
Oct 30 23:48:56.779895 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:56.779868    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc" event={"ID":"35d53e14-1486-48ec-96f3-7a51d4113174","Type":"ContainerStarted","Data":"fec4ac1bf30b5e9f4370dc12c15f21b8fa0f5e1f56ad492ba648b02aca862fcd"}
Oct 30 23:48:56.780666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:56.780644    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc"
Oct 30 23:48:56.783518 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:56.783496    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79" event={"ID":"2d48a824-865d-447c-8b1c-64cc99b41dca","Type":"ContainerStarted","Data":"feb2a29fd2722a38bfd96607b385f8db9d974413e47cf52e0fe198f74b68be11"}
Oct 30 23:48:56.783751 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:56.783731    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79" event={"ID":"2d48a824-865d-447c-8b1c-64cc99b41dca","Type":"ContainerStarted","Data":"2aa38d2c737e40ef556046bf33817329fcebb8d8f1f428428cf06fd1ed018a8b"}
Oct 30 23:48:56.783934 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:56.783907    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79"
Oct 30 23:48:56.806481 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:56.806425    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc" podStartSLOduration=2.806406569 podStartE2EDuration="2.806406569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:56.800569509 +0000 UTC m=+1796.045425278" watchObservedRunningTime="2026-10-30 23:48:56.806406569 +0000 UTC m=+1796.051262337"
Oct 30 23:48:56.826240 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:56.826182    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79" podStartSLOduration=2.826163779 podStartE2EDuration="2.826163779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:56.819282049 +0000 UTC m=+1796.064137817" watchObservedRunningTime="2026-10-30 23:48:56.826163779 +0000 UTC m=+1796.071019548"
Oct 30 23:48:57.221471 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:57.221428    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:48:59.196617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:48:59.174405    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:00.109629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:00.102569    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:01.201664 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:01.201626    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:01.573763 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:01.573677    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 30 23:49:01.830686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:01.829065    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 30 23:49:02.361422 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:02.361372    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:02.738297 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:02.684707    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:03.541616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:03.536687    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:04.202420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:04.202377    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:05.293787 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:05.293734    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:05.767766 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:05.767738    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk"
Oct 30 23:49:06.219619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:06.212878    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:06.787287 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:06.787253    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt"
Oct 30 23:49:06.975701 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:06.975585    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:07.660383 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:07.660335    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:07.822528 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:07.822493    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc"
Oct 30 23:49:07.829168 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:07.829134    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79"
Oct 30 23:49:08.622661 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:08.622576    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:09.938623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:09.926905    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:10.752684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:10.752648    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:11.416545 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:49:11.416502    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:11.532585    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"]
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:11.559026    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"]
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:11.559162    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:11.563187    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-f026c1-serving-cert\""
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:11.612726    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:11.710811    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e4866b3-8070-4de5-aaaa-053929c5dcae-maas-api-tls\") pod \"maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv\" (UID: \"9e4866b3-8070-4de5-aaaa-053929c5dcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:11.710899    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e4866b3-8070-4de5-aaaa-053929c5dcae-metrics-certs\") pod \"maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv\" (UID: \"9e4866b3-8070-4de5-aaaa-053929c5dcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:11.711244    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e4866b3-8070-4de5-aaaa-053929c5dcae-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv\" (UID: \"9e4866b3-8070-4de5-aaaa-053929c5dcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:11.711274    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv5hw\" (UniqueName: \"kubernetes.io/projected/9e4866b3-8070-4de5-aaaa-053929c5dcae-kube-api-access-pv5hw\") pod \"maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv\" (UID: \"9e4866b3-8070-4de5-aaaa-053929c5dcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:11.780179    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:11.813032    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e4866b3-8070-4de5-aaaa-053929c5dcae-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv\" (UID: \"9e4866b3-8070-4de5-aaaa-053929c5dcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:11.813076    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv5hw\" (UniqueName: \"kubernetes.io/projected/9e4866b3-8070-4de5-aaaa-053929c5dcae-kube-api-access-pv5hw\") pod \"maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv\" (UID: \"9e4866b3-8070-4de5-aaaa-053929c5dcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:11.813138    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e4866b3-8070-4de5-aaaa-053929c5dcae-maas-api-tls\") pod \"maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv\" (UID: \"9e4866b3-8070-4de5-aaaa-053929c5dcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:11.813217    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e4866b3-8070-4de5-aaaa-053929c5dcae-metrics-certs\") pod \"maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv\" (UID: \"9e4866b3-8070-4de5-aaaa-053929c5dcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:49:11.814344    4921 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-serving-cert: secret "maas-api-e2e-inf-a-f026c1-serving-cert" not found
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:49:11.814420    4921 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e4866b3-8070-4de5-aaaa-053929c5dcae-maas-api-tls podName:9e4866b3-8070-4de5-aaaa-053929c5dcae nodeName:}" failed. No retries permitted until 2026-10-30 23:49:12.314399655 +0000 UTC m=+1811.559255417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9e4866b3-8070-4de5-aaaa-053929c5dcae-maas-api-tls") pod "maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv" (UID: "9e4866b3-8070-4de5-aaaa-053929c5dcae") : secret "maas-api-e2e-inf-a-f026c1-serving-cert" not found
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:11.815518    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e4866b3-8070-4de5-aaaa-053929c5dcae-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv\" (UID: \"9e4866b3-8070-4de5-aaaa-053929c5dcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:11.817019    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e4866b3-8070-4de5-aaaa-053929c5dcae-metrics-certs\") pod \"maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv\" (UID: \"9e4866b3-8070-4de5-aaaa-053929c5dcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:11.830386    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv5hw\" (UniqueName: \"kubernetes.io/projected/9e4866b3-8070-4de5-aaaa-053929c5dcae-kube-api-access-pv5hw\") pod \"maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv\" (UID: \"9e4866b3-8070-4de5-aaaa-053929c5dcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"
Oct 30 23:49:11.996109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:11.967424    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:12.534412 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:12.377507    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e4866b3-8070-4de5-aaaa-053929c5dcae-maas-api-tls\") pod \"maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv\" (UID: \"9e4866b3-8070-4de5-aaaa-053929c5dcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"
Oct 30 23:49:12.534412 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:12.531033    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e4866b3-8070-4de5-aaaa-053929c5dcae-maas-api-tls\") pod \"maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv\" (UID: \"9e4866b3-8070-4de5-aaaa-053929c5dcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"
Oct 30 23:49:12.565668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:12.565459    4921 generic.go:356] "Generic (PLEG): container finished" podID="4993a595-ab1b-49b4-bb75-3efa3f127527" containerID="f1802b43c1ae5d798d2066d9b5191bd5c35fe5f9bd6d6c2744f48323b009c445" exitCode=0
Oct 30 23:49:12.565668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:12.565610    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t" event={"ID":"4993a595-ab1b-49b4-bb75-3efa3f127527","Type":"ContainerDied","Data":"f1802b43c1ae5d798d2066d9b5191bd5c35fe5f9bd6d6c2744f48323b009c445"}
Oct 30 23:49:12.566209 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:12.566185    4921 scope.go:122] "RemoveContainer" containerID="f1802b43c1ae5d798d2066d9b5191bd5c35fe5f9bd6d6c2744f48323b009c445"
Oct 30 23:49:12.569702 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:12.568984    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:12.569702 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:12.569083    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:12.569702 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:12.569129    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:12.685681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:12.685651    4921 patch_prober.go:29] interesting pod/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": read tcp 10.132.0.2:56980->10.132.0.123:15021: read: connection reset by peer" start-of-body=
Oct 30 23:49:12.686398 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:12.685723    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv" podUID="4f146534-bcab-407d-ad28-d9528ca641c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": read tcp 10.132.0.2:56980->10.132.0.123:15021: read: connection reset by peer"
Oct 30 23:49:12.796476 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:12.796427    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"
Oct 30 23:49:12.840579 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:12.840076    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:13.243532 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:13.243495    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"]
Oct 30 23:49:13.602624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:13.602516    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t" event={"ID":"4993a595-ab1b-49b4-bb75-3efa3f127527","Type":"ContainerStarted","Data":"74e402b99c238752fe0e0ffccc1687a3fe275ea11c8c9f949b8f7bf73281cc62"}
Oct 30 23:49:13.604394 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:13.604369    4921 generic.go:356] "Generic (PLEG): container finished" podID="4f146534-bcab-407d-ad28-d9528ca641c3" containerID="8e79abb0b84797a86b7b15786064306fe8b99fae712da6e1f57102470c34b679" exitCode=0
Oct 30 23:49:13.604544 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:13.604447    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv" event={"ID":"4f146534-bcab-407d-ad28-d9528ca641c3","Type":"ContainerDied","Data":"8e79abb0b84797a86b7b15786064306fe8b99fae712da6e1f57102470c34b679"}
Oct 30 23:49:13.604912 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:13.604895    4921 scope.go:122] "RemoveContainer" containerID="8e79abb0b84797a86b7b15786064306fe8b99fae712da6e1f57102470c34b679"
Oct 30 23:49:13.605977 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:13.605951    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv" event={"ID":"9e4866b3-8070-4de5-aaaa-053929c5dcae","Type":"ContainerStarted","Data":"92a942f08bde83660528589ac171b35e73323ebde533518bbf21434f170f436e"}
Oct 30 23:49:13.606955 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:13.606922    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:13.607057 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:13.606998    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:13.607057 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:13.607037    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:13.608038 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:13.608017    4921 generic.go:356] "Generic (PLEG): container finished" podID="76cc079f-13e3-4159-b6f5-ca36d2b3a56a" containerID="2cb64be2c9e0c6f67320cd0a71347c103a1b6c66acfe3ffc415d1a3be0fbab5f" exitCode=0
Oct 30 23:49:13.608579 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:13.608086    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977" event={"ID":"76cc079f-13e3-4159-b6f5-ca36d2b3a56a","Type":"ContainerDied","Data":"2cb64be2c9e0c6f67320cd0a71347c103a1b6c66acfe3ffc415d1a3be0fbab5f"}
Oct 30 23:49:13.615613 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:13.609246    4921 scope.go:122] "RemoveContainer" containerID="2cb64be2c9e0c6f67320cd0a71347c103a1b6c66acfe3ffc415d1a3be0fbab5f"
Oct 30 23:49:13.615613 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:13.615353    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:13.615613 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:13.615496    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:13.615879 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:13.615653    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:13.644495 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:13.644463    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:14.282115 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:14.282078    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:14.527619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:14.526997    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:49:14.547677 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:14.543754    4921 patch_prober.go:29] interesting pod/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 30 23:49:14.547677 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:14.543821    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t" podUID="4993a595-ab1b-49b4-bb75-3efa3f127527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 30 23:49:14.666993 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:14.666949    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv" event={"ID":"4f146534-bcab-407d-ad28-d9528ca641c3","Type":"ContainerStarted","Data":"ec30b3f5b55fdb357570390feeefd4ea98c53f8953f35cb48ce16615fd5448a8"}
Oct 30 23:49:14.678734 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:14.676396    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv" event={"ID":"9e4866b3-8070-4de5-aaaa-053929c5dcae","Type":"ContainerStarted","Data":"6943719abcbf76c3bf7f48a6da1921f3b010e4bacc72ffcbc4ed9f7cf5f26fde"}
Oct 30 23:49:14.697631 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:14.695739    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"
Oct 30 23:49:14.714002 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:14.713968    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977" event={"ID":"76cc079f-13e3-4159-b6f5-ca36d2b3a56a","Type":"ContainerStarted","Data":"54fa122548c1971aa101ecbe593f3a31a646766bf35119199d6cd0baba5b794d"}
Oct 30 23:49:14.770623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:14.762271    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv" podStartSLOduration=3.082465769 podStartE2EDuration="3.762252081s" totalImagesPullingTime="679.786312ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:49:14.746014044 +0000 UTC m=+1813.990869821" watchObservedRunningTime="2026-10-30 23:49:14.762252081 +0000 UTC m=+1814.007107850"
Oct 30 23:49:15.291616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:15.280897    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:49:15.291616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:15.281074    4921 patch_prober.go:29] interesting pod/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 23:49:15.291616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:15.281138    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977" podUID="76cc079f-13e3-4159-b6f5-ca36d2b3a56a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 23:49:15.462679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:15.460510    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:15.527638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:15.526965    4921 patch_prober.go:29] interesting pod/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 30 23:49:15.527638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:15.527022    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t" podUID="4993a595-ab1b-49b4-bb75-3efa3f127527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 30 23:49:15.527901 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:15.527799    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:49:15.547350 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:15.546218    4921 patch_prober.go:29] interesting pod/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 23:49:15.547350 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:15.546288    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv" podUID="4f146534-bcab-407d-ad28-d9528ca641c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 23:49:15.728566 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:15.728529    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:16.047620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.047188    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:49:16.288627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.267996    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:16.307693 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.289072    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"]
Oct 30 23:49:16.398975 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.398940    4921 patch_prober.go:29] interesting pod/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 23:49:16.399263 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.399236    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977" podUID="76cc079f-13e3-4159-b6f5-ca36d2b3a56a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 23:49:16.552537 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.552503    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.728680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.584794    4921 patch_prober.go:29] interesting pod/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 30 23:49:16.728680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.623671    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t" podUID="4993a595-ab1b-49b4-bb75-3efa3f127527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 30 23:49:16.728680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.613174    4921 patch_prober.go:29] interesting pod/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 23:49:16.728680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.624626    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv" podUID="4f146534-bcab-407d-ad28-d9528ca641c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 23:49:16.728680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.638846    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-7fc6e9-openshift-default-dockercfg-f4pvs\""
Oct 30 23:49:16.759619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.733133    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-credential-socket\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.766930 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.766895    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-workload-certs\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.767191 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.767165    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkpql\" (UniqueName: \"kubernetes.io/projected/60266ba7-f106-4558-a4c2-adb24675cf0b-kube-api-access-pkpql\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.767369 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.767350    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-token\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.767661 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.767636    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60266ba7-f106-4558-a4c2-adb24675cf0b-istiod-ca-cert\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.767813 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.767798    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-podinfo\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.768089 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.768065    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-workload-socket\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.768351 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.768332    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-envoy\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.768510 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.768493    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-data\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.794656 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.794585    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:16.939619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.886897    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-workload-certs\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.939619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.886963    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkpql\" (UniqueName: \"kubernetes.io/projected/60266ba7-f106-4558-a4c2-adb24675cf0b-kube-api-access-pkpql\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.939619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.887006    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-token\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.939619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.887102    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60266ba7-f106-4558-a4c2-adb24675cf0b-istiod-ca-cert\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.939619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.887133    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-podinfo\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.939619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.887184    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-workload-socket\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.939619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.887295    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-envoy\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.939619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.887352    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-data\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.939619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.887551    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-credential-socket\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.939619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.918758    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-workload-socket\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.939619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.919087    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-data\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.939619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.919380    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-credential-socket\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.939619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.920064    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-workload-certs\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:16.939619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:16.921086    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60266ba7-f106-4558-a4c2-adb24675cf0b-istiod-ca-cert\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:17.214986 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:17.214924    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:17.261621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:17.257302    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"]
Oct 30 23:49:17.288895 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:17.264335    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-token\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:17.303160 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:17.268148    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-podinfo\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:17.303408 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:17.289783    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkpql\" (UniqueName: \"kubernetes.io/projected/60266ba7-f106-4558-a4c2-adb24675cf0b-kube-api-access-pkpql\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:17.303629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:17.290112    4921 patch_prober.go:29] interesting pod/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 23:49:17.317497 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:17.317460    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977" podUID="76cc079f-13e3-4159-b6f5-ca36d2b3a56a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 23:49:17.325700 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:17.316908    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-envoy\") pod \"e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") " pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:17.402280 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:17.402236    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:49:17.513136 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:17.513035    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:17.668621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:17.561677    4921 patch_prober.go:29] interesting pod/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 23:49:17.668965 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:17.668931    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv" podUID="4f146534-bcab-407d-ad28-d9528ca641c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 23:49:17.669119 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:17.666101    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:17.669488 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:17.624386    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:17.690647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:17.649392    4921 patch_prober.go:29] interesting pod/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 30 23:49:17.690647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:17.689353    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t" podUID="4993a595-ab1b-49b4-bb75-3efa3f127527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 30 23:49:17.832700 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:17.821712    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:17.922776 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:17.861836    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:18.138202 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.138171    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:18.295618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.274847    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:18.295618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.275567    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:49:18.318889 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.304205    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:18.405682 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.360647    4921 patch_prober.go:29] interesting pod/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 23:49:18.405682 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.360715    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977" podUID="76cc079f-13e3-4159-b6f5-ca36d2b3a56a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 23:49:18.464620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.455303    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:18.524622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.506818    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 30 23:49:18.550354 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.550320    4921 patch_prober.go:29] interesting pod/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 30 23:49:18.550624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.550580    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t" podUID="4993a595-ab1b-49b4-bb75-3efa3f127527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 30 23:49:18.557925 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.527853    4921 patch_prober.go:29] interesting pod/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 23:49:18.557925 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.556493    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv" podUID="4f146534-bcab-407d-ad28-d9528ca641c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 23:49:18.647701 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.604385    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:18.669718 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.649201    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:49:18.669718 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.649695    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:49:18.701624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.698056    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:18.701624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.698813    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:49:18.763841 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.763803    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:18.780069 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.780037    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:49:18.908700 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.873881    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:18.908700 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.874262    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:49:18.908700 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.898717    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:49:18.908700 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:18.899453    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:49:19.577544 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.577506    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/health\": context deadline exceeded"
Oct 30 23:49:19.580252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.579386    4921 patch_prober.go:29] interesting pod/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 30 23:49:19.968618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.964208    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t" podUID="4993a595-ab1b-49b4-bb75-3efa3f127527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 30 23:49:19.968618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.581313    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:19.968618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.583325    4921 patch_prober.go:29] interesting pod/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 23:49:19.968618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.964358    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977" podUID="76cc079f-13e3-4159-b6f5-ca36d2b3a56a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 23:49:19.968618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.779334    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:19.968618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.807830    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:20.044626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.657074    4921 patch_prober.go:29] interesting pod/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 23:49:20.044626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.971857    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv" podUID="4f146534-bcab-407d-ad28-d9528ca641c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 23:49:20.044626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.898912    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:20.044626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.883875    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:20.044626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.897057    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:49:20.044626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.972352    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 30 23:49:20.044626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.972398    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:49:20.044626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.900044    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:20.044626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.973452    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:20.044626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.973511    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:20.044626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.908021    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:20.044626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.581345    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2" podUID="09131a8c-6b33-4793-b624-24489d63e66a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.47:8000/ready\": context deadline exceeded"
Oct 30 23:49:20.044626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.580537    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:20.044626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.862793    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:20.044626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:19.977084    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:49:20.075727 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:20.063072    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v" event={"ID":"60266ba7-f106-4558-a4c2-adb24675cf0b","Type":"ContainerStarted","Data":"9abfe30250cc4bd63ddd08c2e5721ff7aee47d3de6b9b5a479edc0ae8cf5262e"}
Oct 30 23:49:20.294638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:20.277384    4921 patch_prober.go:29] interesting pod/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 23:49:20.294638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:20.277448    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977" podUID="76cc079f-13e3-4159-b6f5-ca36d2b3a56a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 23:49:20.339296 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:20.322100    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:49:20.392650 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:20.386778    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:49:20.407616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:20.404069    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:49:20.442110 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:20.412706    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"]
Oct 30 23:49:20.446368 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:20.446343    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:49:20.462727 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:20.462699    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:49:20.466007 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:20.465476    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:49:20.523988 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:20.523954    4921 patch_prober.go:29] interesting pod/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 23:49:20.524270 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:20.524244    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv" podUID="4f146534-bcab-407d-ad28-d9528ca641c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 23:49:21.350743 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:21.350705    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:49:21.357379 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:21.357352    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"
Oct 30 23:49:21.358781 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:21.358543    4921 patch_prober.go:29] interesting pod/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 23:49:21.358781 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:21.358626    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977" podUID="76cc079f-13e3-4159-b6f5-ca36d2b3a56a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 23:49:21.364792 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:21.364462    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:21.465788 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:21.464811    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v" event={"ID":"60266ba7-f106-4558-a4c2-adb24675cf0b","Type":"ContainerStarted","Data":"15d286c56d0ba51bc870c7d657962bcf3022631784c85ead6d9f0285152466e0"}
Oct 30 23:49:21.466429 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:21.466387    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 30 23:49:21.544194 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:21.535922    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:21.544394 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:21.536141    4921 patch_prober.go:29] interesting pod/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 23:49:21.544394 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:21.544282    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv" podUID="4f146534-bcab-407d-ad28-d9528ca641c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 23:49:21.642532 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:21.642499    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:21.656824 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:21.656795    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:21.723889 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:21.723827    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v" podStartSLOduration=5.723806241 podStartE2EDuration="5.723806241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:49:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:49:21.64350697 +0000 UTC m=+1820.888362740" watchObservedRunningTime="2026-10-30 23:49:21.723806241 +0000 UTC m=+1820.968662012"
Oct 30 23:49:22.277067 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:22.277037    4921 patch_prober.go:29] interesting pod/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 23:49:22.277261 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:22.277095    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977" podUID="76cc079f-13e3-4159-b6f5-ca36d2b3a56a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 23:49:22.469731 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:22.469694    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:22.470906 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:22.470839    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:49:22.527195 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:22.527107    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:49:22.527658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:22.527633    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:49:22.529143 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:22.529113    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 30 23:49:22.544510 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:22.544476    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:23.282890 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:23.282858    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:49:23.284118 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:23.284096    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:49:23.619442 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:23.619345    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:24.119306 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:24.119265    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:24.299979 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:24.299950    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:24.712124 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:24.711879    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:25.366166 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:25.366132    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:25.563660 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:25.551761    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:25.838619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:25.835496    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:26.560623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:26.559951    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:27.450537 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:27.450506    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:28.131083 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:28.131048    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:28.763742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:28.763704    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:28.960567 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:28.960539    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:29.121283 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:29.121189    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:29.868479 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:29.868420    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:30.042619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:30.035438    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:30.321584 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:30.321538    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:30.552616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:30.535615    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:31.173791 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:31.173759    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:31.987383 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:31.987322    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:32.876849 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:32.876819    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:33.994928 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:33.994899    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:34.269682 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:34.269605    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:34.415338 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:34.415280    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:35.447712 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:35.443121    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:35.883476 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:35.883443    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:36.017374 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:36.017173    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:37.116327 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:37.116290    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:37.911857 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:37.911808    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:39.015775 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:39.015727    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:39.192178 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:39.192126    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:39.434699 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:39.434662    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:39.581569 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:39.581533    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:39.727325 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:39.727207    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:39.940455 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:39.940395    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:40.130681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:40.093101    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:40.249039 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:40.249006    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:40.552061 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:40.552027    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:41.468922 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:49:41.468885    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:49:41.634681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:41.633110    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:43.052796 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:43.052763    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:43.440155 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:43.440123    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:43.591461 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:43.591426    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:43.722680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:43.722561    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:43.828610 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:43.828541    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk"]
Oct 30 23:49:43.834539 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:43.834510    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt"]
Oct 30 23:49:43.929971 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:43.929889    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:44.125108 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:44.124493    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:44.662278 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:44.662235    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:44.818622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:44.814350    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:45.203883 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:45.203853    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:45.507259 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:45.507176    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:45.651651 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:45.650712    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:46.111716 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:46.111681    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:46.255182 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:46.255144    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:46.755981 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:46.752415    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:46.944284 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:46.943820    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:47.383479 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:47.383440    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:47.551874 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:47.551744    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:47.705167 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:47.705043    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:47.996666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:47.991687    4921 patch_prober.go:29] interesting pod/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:49:47.996666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:47.991785    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b" podUID="441b53d1-a1f2-493b-a111-afff2d1aac61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:49:48.100106 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:48.100031    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:48.831263 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:48.831217    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk" podUID="9cfc9be7-9612-468a-aecc-611c10916665" containerName="payload-processing" containerID="cri-o://8f171b25ab7a8022276b18a121a7c9c0972ae64f21e771ee2589c4a4427631de" gracePeriod=25
Oct 30 23:49:48.835421 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:48.835380    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt" podUID="038d4dac-dd90-4ed7-8404-5ee03b567e8a" containerName="payload-pre-processing" containerID="cri-o://2185d0dabc97f0602154c69af6e5b173ae52e010bfa0db82f719ff780efe04f8" gracePeriod=25
Oct 30 23:49:49.114974 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.114841    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:49.318010 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.317976    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt"
Oct 30 23:49:49.391173 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.388981    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk"
Oct 30 23:49:49.463842 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.462653    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/038d4dac-dd90-4ed7-8404-5ee03b567e8a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/038d4dac-dd90-4ed7-8404-5ee03b567e8a-plugins-config-volume\") pod \"038d4dac-dd90-4ed7-8404-5ee03b567e8a\" (UID: \"038d4dac-dd90-4ed7-8404-5ee03b567e8a\") "
Oct 30 23:49:49.463842 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.462737    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9cfc9be7-9612-468a-aecc-611c10916665-kube-api-access-rwbgn\" (UniqueName: \"kubernetes.io/projected/9cfc9be7-9612-468a-aecc-611c10916665-kube-api-access-rwbgn\") pod \"9cfc9be7-9612-468a-aecc-611c10916665\" (UID: \"9cfc9be7-9612-468a-aecc-611c10916665\") "
Oct 30 23:49:49.463842 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.462769    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/038d4dac-dd90-4ed7-8404-5ee03b567e8a-kube-api-access-n2r58\" (UniqueName: \"kubernetes.io/projected/038d4dac-dd90-4ed7-8404-5ee03b567e8a-kube-api-access-n2r58\") pod \"038d4dac-dd90-4ed7-8404-5ee03b567e8a\" (UID: \"038d4dac-dd90-4ed7-8404-5ee03b567e8a\") "
Oct 30 23:49:49.463842 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.462823    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9cfc9be7-9612-468a-aecc-611c10916665-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cfc9be7-9612-468a-aecc-611c10916665-plugins-config-volume\") pod \"9cfc9be7-9612-468a-aecc-611c10916665\" (UID: \"9cfc9be7-9612-468a-aecc-611c10916665\") "
Oct 30 23:49:49.464369 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.464303    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/038d4dac-dd90-4ed7-8404-5ee03b567e8a-plugins-config-volume" pod "038d4dac-dd90-4ed7-8404-5ee03b567e8a" (UID: "038d4dac-dd90-4ed7-8404-5ee03b567e8a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:49:49.464661 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.464624    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cfc9be7-9612-468a-aecc-611c10916665-plugins-config-volume" pod "9cfc9be7-9612-468a-aecc-611c10916665" (UID: "9cfc9be7-9612-468a-aecc-611c10916665"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:49:49.486714 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.476471    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cfc9be7-9612-468a-aecc-611c10916665-kube-api-access-rwbgn" pod "9cfc9be7-9612-468a-aecc-611c10916665" (UID: "9cfc9be7-9612-468a-aecc-611c10916665"). InnerVolumeSpecName "kube-api-access-rwbgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:49:49.488159 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.487878    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/038d4dac-dd90-4ed7-8404-5ee03b567e8a-kube-api-access-n2r58" pod "038d4dac-dd90-4ed7-8404-5ee03b567e8a" (UID: "038d4dac-dd90-4ed7-8404-5ee03b567e8a"). InnerVolumeSpecName "kube-api-access-n2r58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:49:49.527762 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.527723    4921 generic.go:356] "Generic (PLEG): container finished" podID="038d4dac-dd90-4ed7-8404-5ee03b567e8a" containerID="2185d0dabc97f0602154c69af6e5b173ae52e010bfa0db82f719ff780efe04f8" exitCode=0
Oct 30 23:49:49.527954 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.527778    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt"
Oct 30 23:49:49.527954 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.527810    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt" event={"ID":"038d4dac-dd90-4ed7-8404-5ee03b567e8a","Type":"ContainerDied","Data":"2185d0dabc97f0602154c69af6e5b173ae52e010bfa0db82f719ff780efe04f8"}
Oct 30 23:49:49.527954 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.527887    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt" event={"ID":"038d4dac-dd90-4ed7-8404-5ee03b567e8a","Type":"ContainerDied","Data":"8d35cde68d4ed97dc86b13af0ec60f603c949de9dd5bf9eb9d1db38a009b76cb"}
Oct 30 23:49:49.527954 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.527920    4921 scope.go:122] "RemoveContainer" containerID="2185d0dabc97f0602154c69af6e5b173ae52e010bfa0db82f719ff780efe04f8"
Oct 30 23:49:49.530663 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.530099    4921 generic.go:356] "Generic (PLEG): container finished" podID="9cfc9be7-9612-468a-aecc-611c10916665" containerID="8f171b25ab7a8022276b18a121a7c9c0972ae64f21e771ee2589c4a4427631de" exitCode=0
Oct 30 23:49:49.530663 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.530153    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk"
Oct 30 23:49:49.530663 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.530203    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk" event={"ID":"9cfc9be7-9612-468a-aecc-611c10916665","Type":"ContainerDied","Data":"8f171b25ab7a8022276b18a121a7c9c0972ae64f21e771ee2589c4a4427631de"}
Oct 30 23:49:49.530663 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.530250    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk" event={"ID":"9cfc9be7-9612-468a-aecc-611c10916665","Type":"ContainerDied","Data":"b859d5872d1597c05eb6905bdb58110ed6a27ecc1d0c1d081d7058adf6c49fac"}
Oct 30 23:49:49.542546 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.542520    4921 scope.go:122] "RemoveContainer" containerID="2185d0dabc97f0602154c69af6e5b173ae52e010bfa0db82f719ff780efe04f8"
Oct 30 23:49:49.542901 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:49:49.542880    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2185d0dabc97f0602154c69af6e5b173ae52e010bfa0db82f719ff780efe04f8\": container with ID starting with 2185d0dabc97f0602154c69af6e5b173ae52e010bfa0db82f719ff780efe04f8 not found: ID does not exist" containerID="2185d0dabc97f0602154c69af6e5b173ae52e010bfa0db82f719ff780efe04f8"
Oct 30 23:49:49.543000 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.542913    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2185d0dabc97f0602154c69af6e5b173ae52e010bfa0db82f719ff780efe04f8"} err="failed to get container status \"2185d0dabc97f0602154c69af6e5b173ae52e010bfa0db82f719ff780efe04f8\": rpc error: code = NotFound desc = could not find container \"2185d0dabc97f0602154c69af6e5b173ae52e010bfa0db82f719ff780efe04f8\": container with ID starting with 2185d0dabc97f0602154c69af6e5b173ae52e010bfa0db82f719ff780efe04f8 not found: ID does not exist"
Oct 30 23:49:49.543000 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.542934    4921 scope.go:122] "RemoveContainer" containerID="8f171b25ab7a8022276b18a121a7c9c0972ae64f21e771ee2589c4a4427631de"
Oct 30 23:49:49.555457 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.555427    4921 scope.go:122] "RemoveContainer" containerID="8f171b25ab7a8022276b18a121a7c9c0972ae64f21e771ee2589c4a4427631de"
Oct 30 23:49:49.555943 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:49:49.555916    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f171b25ab7a8022276b18a121a7c9c0972ae64f21e771ee2589c4a4427631de\": container with ID starting with 8f171b25ab7a8022276b18a121a7c9c0972ae64f21e771ee2589c4a4427631de not found: ID does not exist" containerID="8f171b25ab7a8022276b18a121a7c9c0972ae64f21e771ee2589c4a4427631de"
Oct 30 23:49:49.556093 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.555950    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f171b25ab7a8022276b18a121a7c9c0972ae64f21e771ee2589c4a4427631de"} err="failed to get container status \"8f171b25ab7a8022276b18a121a7c9c0972ae64f21e771ee2589c4a4427631de\": rpc error: code = NotFound desc = could not find container \"8f171b25ab7a8022276b18a121a7c9c0972ae64f21e771ee2589c4a4427631de\": container with ID starting with 8f171b25ab7a8022276b18a121a7c9c0972ae64f21e771ee2589c4a4427631de not found: ID does not exist"
Oct 30 23:49:49.559573 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.559548    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk"]
Oct 30 23:49:49.564912 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.564880    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/038d4dac-dd90-4ed7-8404-5ee03b567e8a-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:49:49.564912 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.564906    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwbgn\" (UniqueName: \"kubernetes.io/projected/9cfc9be7-9612-468a-aecc-611c10916665-kube-api-access-rwbgn\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:49:49.564912 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.564915    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2r58\" (UniqueName: \"kubernetes.io/projected/038d4dac-dd90-4ed7-8404-5ee03b567e8a-kube-api-access-n2r58\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:49:49.565185 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.564925    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cfc9be7-9612-468a-aecc-611c10916665-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:49:49.566512 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.566487    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6a162557-5bf59d74bf-qsmbk"]
Oct 30 23:49:49.579837 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.579789    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt"]
Oct 30 23:49:49.583988 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:49.583959    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6a162557-c9f644787-pn8rt"]
Oct 30 23:49:50.181468 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:50.181425    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:50.594204 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:50.594125    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:50.746865 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:50.746833    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:50.887787 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:50.887759    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="038d4dac-dd90-4ed7-8404-5ee03b567e8a" path="/var/lib/kubelet/pods/038d4dac-dd90-4ed7-8404-5ee03b567e8a/volumes"
Oct 30 23:49:50.888323 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:50.888307    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9cfc9be7-9612-468a-aecc-611c10916665" path="/var/lib/kubelet/pods/9cfc9be7-9612-468a-aecc-611c10916665/volumes"
Oct 30 23:49:51.460869 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:51.460487    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:51.708235 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:51.708197    4921 patch_prober.go:29] interesting pod/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused" start-of-body=
Oct 30 23:49:51.710451 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:51.708276    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966" podUID="45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused"
Oct 30 23:49:51.788029 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:51.787946    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:51.922263 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:51.922228    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:52.583700 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:52.576083    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:52.613816 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:52.613749    4921 generic.go:356] "Generic (PLEG): container finished" podID="45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" containerID="70e3a6f3ba4b65432b0ece760fb8b6cce809198ecc07203eae346ce5e1255c3d" exitCode=0
Oct 30 23:49:52.615183 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:52.615135    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966" event={"ID":"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d","Type":"ContainerDied","Data":"70e3a6f3ba4b65432b0ece760fb8b6cce809198ecc07203eae346ce5e1255c3d"}
Oct 30 23:49:52.618535 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:52.615692    4921 scope.go:122] "RemoveContainer" containerID="70e3a6f3ba4b65432b0ece760fb8b6cce809198ecc07203eae346ce5e1255c3d"
Oct 30 23:49:52.618535 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:52.617952    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:52.618535 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:52.618049    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:52.618535 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:52.618095    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:52.641627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:52.640750    4921 generic.go:356] "Generic (PLEG): container finished" podID="441b53d1-a1f2-493b-a111-afff2d1aac61" containerID="cc40c0d08cd7e3d0cffdd160711c9f85f313ce8e064a750b110193a8f9836219" exitCode=0
Oct 30 23:49:52.641627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:52.640866    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b" event={"ID":"441b53d1-a1f2-493b-a111-afff2d1aac61","Type":"ContainerDied","Data":"cc40c0d08cd7e3d0cffdd160711c9f85f313ce8e064a750b110193a8f9836219"}
Oct 30 23:49:52.641627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:52.641418    4921 scope.go:122] "RemoveContainer" containerID="cc40c0d08cd7e3d0cffdd160711c9f85f313ce8e064a750b110193a8f9836219"
Oct 30 23:49:52.644572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:52.644532    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:52.644816 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:52.644793    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:52.644957 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:52.644939    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:53.115430 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:53.115392    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:53.339646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:53.339612    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:53.495499 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:53.493109    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:53.654210 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:53.654179    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966" event={"ID":"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d","Type":"ContainerStarted","Data":"9e3427d8e2366b915a7996ceb8db180a9e1ee6b035a6949396bff865e2dcc378"}
Oct 30 23:49:53.657171 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:53.657146    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b" event={"ID":"441b53d1-a1f2-493b-a111-afff2d1aac61","Type":"ContainerStarted","Data":"a106145efc7a59350e831b833bd3f1792b228092de07ae88a4f01e55d0e8b737"}
Oct 30 23:49:54.224618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:54.224204    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:49:54.224905 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:54.224881    4921 patch_prober.go:29] interesting pod/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused" start-of-body=
Oct 30 23:49:54.224973 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:54.224926    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966" podUID="45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused"
Oct 30 23:49:54.232851 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:54.232823    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:54.257619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:54.253311    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:49:54.266679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:54.264771    4921 patch_prober.go:29] interesting pod/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 30 23:49:54.266679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:54.264850    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b" podUID="441b53d1-a1f2-493b-a111-afff2d1aac61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 30 23:49:55.197620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:55.197510    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:55.228796 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:55.225221    4921 patch_prober.go:29] interesting pod/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused" start-of-body=
Oct 30 23:49:55.228796 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:55.225275    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966" podUID="45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused"
Oct 30 23:49:55.257616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:55.249977    4921 patch_prober.go:29] interesting pod/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 30 23:49:55.257616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:55.250038    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b" podUID="441b53d1-a1f2-493b-a111-afff2d1aac61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 30 23:49:55.959227 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:55.959177    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:56.160627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:56.150615    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:56.244675 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:56.239974    4921 patch_prober.go:29] interesting pod/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused" start-of-body=
Oct 30 23:49:56.244675 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:56.240036    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966" podUID="45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused"
Oct 30 23:49:56.258619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:56.254107    4921 patch_prober.go:29] interesting pod/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 30 23:49:56.258619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:56.254165    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b" podUID="441b53d1-a1f2-493b-a111-afff2d1aac61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 30 23:49:56.863624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:56.858927    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"]
Oct 30 23:49:56.902320 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:56.902283    4921 cpu_manager.go:414] "containerMap: removing container" podUID="9cfc9be7-9612-468a-aecc-611c10916665" containerName="payload-processing"
Oct 30 23:49:56.902556 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:56.902537    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9cfc9be7-9612-468a-aecc-611c10916665" containerName="payload-processing"
Oct 30 23:49:56.902716 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:56.902702    4921 cpu_manager.go:414] "containerMap: removing container" podUID="038d4dac-dd90-4ed7-8404-5ee03b567e8a" containerName="payload-pre-processing"
Oct 30 23:49:56.902812 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:56.902799    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="038d4dac-dd90-4ed7-8404-5ee03b567e8a" containerName="payload-pre-processing"
Oct 30 23:49:56.920619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:56.903149    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="9cfc9be7-9612-468a-aecc-611c10916665" containerName="payload-processing"
Oct 30 23:49:56.920894 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:56.920870    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="038d4dac-dd90-4ed7-8404-5ee03b567e8a" containerName="payload-pre-processing"
Oct 30 23:49:57.015868 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.015808    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.096065 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.067055    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"]
Oct 30 23:49:57.212760 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.201983    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-workload-socket\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.212760 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.202049    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-workload-certs\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.212760 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.202117    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc434507-b343-4714-9a9d-514f80df9da6-istiod-ca-cert\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.212760 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.202161    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc434507-b343-4714-9a9d-514f80df9da6-istio-token\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.212760 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.202219    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-istio-data\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.212760 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.202351    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc434507-b343-4714-9a9d-514f80df9da6-istio-podinfo\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.212760 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.202448    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-credential-socket\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.212760 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.202500    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-istio-envoy\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.212760 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.202565    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czlhr\" (UniqueName: \"kubernetes.io/projected/fc434507-b343-4714-9a9d-514f80df9da6-kube-api-access-czlhr\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.222632 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.221927    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:57.245337 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.235821    4921 patch_prober.go:29] interesting pod/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused" start-of-body=
Oct 30 23:49:57.245337 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.235882    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966" podUID="45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused"
Oct 30 23:49:57.269615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.264785    4921 patch_prober.go:29] interesting pod/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 30 23:49:57.269615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.264848    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b" podUID="441b53d1-a1f2-493b-a111-afff2d1aac61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 30 23:49:57.472700 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.472517    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-workload-socket\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.472700 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.472619    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-workload-certs\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.472700 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.472694    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc434507-b343-4714-9a9d-514f80df9da6-istiod-ca-cert\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.473006 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.472736    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc434507-b343-4714-9a9d-514f80df9da6-istio-token\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.473006 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.472796    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-istio-data\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.473006 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.472928    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc434507-b343-4714-9a9d-514f80df9da6-istio-podinfo\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.473198 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.473030    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-credential-socket\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.473198 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.473077    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-istio-envoy\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.473198 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.473176    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czlhr\" (UniqueName: \"kubernetes.io/projected/fc434507-b343-4714-9a9d-514f80df9da6-kube-api-access-czlhr\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.501315 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.474076    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-workload-socket\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.501315 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.474327    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-workload-certs\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.501315 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.474976    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc434507-b343-4714-9a9d-514f80df9da6-istiod-ca-cert\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.501315 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.475515    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-istio-data\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.501315 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.491373    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-credential-socket\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.664714 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.568301    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc434507-b343-4714-9a9d-514f80df9da6-istio-podinfo\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.664714 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.582043    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czlhr\" (UniqueName: \"kubernetes.io/projected/fc434507-b343-4714-9a9d-514f80df9da6-kube-api-access-czlhr\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.679382 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.671935    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc434507-b343-4714-9a9d-514f80df9da6-istio-token\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.679382 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.675956    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-istio-envoy\") pod \"e2e-mt-6a162557-openshift-default-8677879c89-77kbf\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") " pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:57.740302 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:57.736889    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:58.228653 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:58.225320    4921 patch_prober.go:29] interesting pod/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused" start-of-body=
Oct 30 23:49:58.228653 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:58.225382    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966" podUID="45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused"
Oct 30 23:49:58.237908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:58.237868    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"]
Oct 30 23:49:58.239858 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:58.239824    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:58.239990 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:58.239896    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:58.239990 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:58.239938    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:49:58.250643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:58.249654    4921 patch_prober.go:29] interesting pod/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 30 23:49:58.250643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:58.249730    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b" podUID="441b53d1-a1f2-493b-a111-afff2d1aac61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 30 23:49:58.367048 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:58.366938    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:58.784623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:58.784480    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf" event={"ID":"fc434507-b343-4714-9a9d-514f80df9da6","Type":"ContainerStarted","Data":"a00c119273e4c86cb57c4881e1eb35988ae597b7ba6859684764f2ec503dcc7f"}
Oct 30 23:49:58.784623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:58.784611    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf" event={"ID":"fc434507-b343-4714-9a9d-514f80df9da6","Type":"ContainerStarted","Data":"a9996a71783ac8308f2f920086baaacb7d71f171bed8a015f690fe0a2c4c0b9e"}
Oct 30 23:49:58.832783 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:58.832720    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf" podStartSLOduration=2.832700636 podStartE2EDuration="2.832700636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:49:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:49:58.821510088 +0000 UTC m=+1858.066365857" watchObservedRunningTime="2026-10-30 23:49:58.832700636 +0000 UTC m=+1858.077556405"
Oct 30 23:49:59.236622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:59.234392    4921 patch_prober.go:29] interesting pod/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused" start-of-body=
Oct 30 23:49:59.236622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:59.234457    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966" podUID="45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused"
Oct 30 23:49:59.253619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:59.250073    4921 patch_prober.go:29] interesting pod/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 30 23:49:59.253619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:59.250135    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b" podUID="441b53d1-a1f2-493b-a111-afff2d1aac61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 30 23:49:59.433101 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:59.433053    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:49:59.743189 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:59.743155    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:49:59.744338 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:59.744313    4921 patch_prober.go:29] interesting pod/e2e-mt-6a162557-openshift-default-8677879c89-77kbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused" start-of-body=
Oct 30 23:49:59.744513 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:49:59.744494    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf" podUID="fc434507-b343-4714-9a9d-514f80df9da6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused"
Oct 30 23:50:00.229368 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:00.229340    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:50:00.229870 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:00.229853    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:50:00.230671 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:00.230649    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:50:00.254502 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:00.254480    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:50:00.254937 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:00.254859    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:50:00.255480 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:00.255463    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 30 23:50:00.701113 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:00.701081    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:00.744062 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:00.744026    4921 patch_prober.go:29] interesting pod/e2e-mt-6a162557-openshift-default-8677879c89-77kbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused" start-of-body=
Oct 30 23:50:00.744359 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:00.744321    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf" podUID="fc434507-b343-4714-9a9d-514f80df9da6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused"
Oct 30 23:50:01.258515 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:01.258464    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:01.660522 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:01.660477    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:01.741483 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:01.741443    4921 patch_prober.go:29] interesting pod/e2e-mt-6a162557-openshift-default-8677879c89-77kbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused" start-of-body=
Oct 30 23:50:01.745758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:01.745713    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf" podUID="fc434507-b343-4714-9a9d-514f80df9da6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused"
Oct 30 23:50:02.495797 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:02.495763    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:02.739381 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:02.739348    4921 patch_prober.go:29] interesting pod/e2e-mt-6a162557-openshift-default-8677879c89-77kbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused" start-of-body=
Oct 30 23:50:02.739552 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:02.739397    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf" podUID="fc434507-b343-4714-9a9d-514f80df9da6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused"
Oct 30 23:50:03.261004 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:03.260970    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:03.739312 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:03.739280    4921 patch_prober.go:29] interesting pod/e2e-mt-6a162557-openshift-default-8677879c89-77kbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused" start-of-body=
Oct 30 23:50:03.739815 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:03.739345    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf" podUID="fc434507-b343-4714-9a9d-514f80df9da6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused"
Oct 30 23:50:04.149091 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:04.149056    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:04.280657 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:04.280353    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:04.747622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:04.746773    4921 patch_prober.go:29] interesting pod/e2e-mt-6a162557-openshift-default-8677879c89-77kbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused" start-of-body=
Oct 30 23:50:04.747622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:04.746835    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf" podUID="fc434507-b343-4714-9a9d-514f80df9da6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused"
Oct 30 23:50:05.055790 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:05.055703    4921 scope.go:122] "RemoveContainer" containerID="8e037a38b0faf9f9e893c433250c6723d13375bce492b42b10cf944836172213"
Oct 30 23:50:05.215201 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:05.215161    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:05.753088 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:05.751133    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:50:05.753088 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:05.752933    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:50:05.754769 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:05.754727    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:50:06.051440 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:06.051340    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:06.971357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:06.971320    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:07.708255 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:07.708198    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:07.873241 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:07.873206    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:08.641821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:08.641788    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:09.455710 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:09.455281    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:09.655754 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:09.655715    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:09.895887 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:09.895858    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:10.342342 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:10.342263    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:10.543204 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:10.543169    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:10.762374 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:10.762327    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"]
Oct 30 23:50:10.801514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:10.801466    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"]
Oct 30 23:50:10.801748 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:10.801658    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:10.807623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:10.807571    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f0817c-openshift-default-dockercfg-glcmv\""
Oct 30 23:50:10.909734 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:10.904838    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:10.939620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:10.911184    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-token\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:10.939620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:10.924754    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-workload-certs\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:10.939620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:10.924849    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istiod-ca-cert\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:10.939620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:10.924892    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-envoy\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:10.939620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:10.924934    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-data\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:10.939620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:10.925168    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n6lq\" (UniqueName: \"kubernetes.io/projected/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-kube-api-access-6n6lq\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:10.939620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:10.925219    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-podinfo\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:10.939620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:10.925359    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-workload-socket\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:10.939620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:10.925406    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-credential-socket\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.070674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.069699    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-workload-socket\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.070674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.069775    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-credential-socket\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.070674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.069863    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-token\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.070674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.069927    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-workload-certs\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.070674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.070008    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istiod-ca-cert\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.070674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.070046    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-envoy\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.070674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.070087    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-data\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.070674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.070302    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n6lq\" (UniqueName: \"kubernetes.io/projected/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-kube-api-access-6n6lq\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.070674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.070349    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-podinfo\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.074330 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.072306    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-workload-socket\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.074330 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.072797    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-credential-socket\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.074330 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.073520    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-workload-certs\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.074330 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.074073    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istiod-ca-cert\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.086617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.074939    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-data\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.115234 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.115195    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:11.144025 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.143952    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-podinfo\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.149138 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.148966    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-envoy\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.161837 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.160863    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n6lq\" (UniqueName: \"kubernetes.io/projected/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-kube-api-access-6n6lq\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.162720 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.162675    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-token\") pod \"e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") " pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.418181 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:50:11.418138    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:50:11.421047 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.421028    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:11.645236 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.645204    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:11.717214 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:50:11.717182    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb87a3c1a_c9af_494e_bdf2_b81ee451f79c.slice/crio-d3b8f3f181509bc6aeb8c7b9eb633a8e91b28321ada25c6745172d87e034714b WatchSource:0}: Error finding container d3b8f3f181509bc6aeb8c7b9eb633a8e91b28321ada25c6745172d87e034714b: Status 404 returned error can't find the container with id d3b8f3f181509bc6aeb8c7b9eb633a8e91b28321ada25c6745172d87e034714b
Oct 30 23:50:11.717491 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.717468    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"]
Oct 30 23:50:11.738618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.720867    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:50:11.738618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.720958    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:50:11.738618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:11.720998    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:50:12.160505 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:12.160461    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd" event={"ID":"b87a3c1a-c9af-494e-bdf2-b81ee451f79c","Type":"ContainerStarted","Data":"05bc7afa49cc4862db7a505fef5cdcb24bc595f7346a504556db12a48775cfb0"}
Oct 30 23:50:12.161065 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:12.160516    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd" event={"ID":"b87a3c1a-c9af-494e-bdf2-b81ee451f79c","Type":"ContainerStarted","Data":"d3b8f3f181509bc6aeb8c7b9eb633a8e91b28321ada25c6745172d87e034714b"}
Oct 30 23:50:12.189955 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:12.189903    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd" podStartSLOduration=2.189887253 podStartE2EDuration="2.189887253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:50:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:50:12.184431502 +0000 UTC m=+1871.429287292" watchObservedRunningTime="2026-10-30 23:50:12.189887253 +0000 UTC m=+1871.434743020"
Oct 30 23:50:12.353509 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:12.353476    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:12.425106 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:12.422102    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:12.474653 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:12.470983    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:13.038296 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:13.038242    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:13.173060 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:13.173032    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:13.174073 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:13.174040    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:50:14.058662 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:14.049772    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:14.605096 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:14.605058    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:14.921753 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:14.921718    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:15.077234 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:15.077196    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:15.807018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:15.806985    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:16.048622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:16.043116    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:17.036538 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:17.036498    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:17.912359 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:17.912325    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:18.758574 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:18.758534    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:19.410755 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:19.410723    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:20.089935 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:20.089904    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:20.214948 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:20.214907    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:20.618978 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:20.618948    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:20.983975 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:20.983939    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:21.156625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:21.146315    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:21.749233 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:21.749189    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:21.958317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:21.958274    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:22.722285 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:22.722256    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:23.850582 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:23.850547    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:24.011185 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:24.011141    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:24.952428 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:24.952388    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:25.194099 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:25.194064    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:25.393706 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:25.376815    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:26.989400 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:26.989360    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 23:50:27.015491 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:27.015225    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:50:27.149001 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:27.148965    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:27.152818 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:27.152779    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:50:27.443627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:27.442407    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:27.640580 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:27.640546    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:27.642203 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:27.642145    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd"]
Oct 30 23:50:27.668421 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:27.668396    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd"]
Oct 30 23:50:27.668737 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:27.668691    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd"
Oct 30 23:50:27.705178 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:27.704641    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-32732d-dockercfg-rcltc\""
Oct 30 23:50:27.732354 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:27.732248    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-32732d\""
Oct 30 23:50:27.836627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:27.818032    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:27.866742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:27.860617    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hstk5\" (UniqueName: \"kubernetes.io/projected/7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b-kube-api-access-hstk5\") pod \"payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd\" (UID: \"7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd"
Oct 30 23:50:27.866742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:27.860790    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd\" (UID: \"7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd"
Oct 30 23:50:27.979665 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:27.968109    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd\" (UID: \"7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd"
Oct 30 23:50:27.979665 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:27.968650    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hstk5\" (UniqueName: \"kubernetes.io/projected/7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b-kube-api-access-hstk5\") pod \"payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd\" (UID: \"7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd"
Oct 30 23:50:27.979665 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:27.971277    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd\" (UID: \"7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd"
Oct 30 23:50:27.999504 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:27.999456    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hstk5\" (UniqueName: \"kubernetes.io/projected/7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b-kube-api-access-hstk5\") pod \"payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd\" (UID: \"7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd"
Oct 30 23:50:28.062015 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:28.061972    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd"
Oct 30 23:50:28.511399 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:28.511367    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd"]
Oct 30 23:50:28.615082 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:28.615046    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd" event={"ID":"7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b","Type":"ContainerStarted","Data":"db63303803e5f449e8e3caa7acf773c952c6192ad0c1a716a5be5ccf44c79ea4"}
Oct 30 23:50:28.836405 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:28.836316    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:29.557778 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:29.557742    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:29.665927 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:29.665881    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd" event={"ID":"7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b","Type":"ContainerStarted","Data":"198b9d816847f22e5f87f6213eda38066b2d5ab36661266757c0ac07263667d4"}
Oct 30 23:50:29.686623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:29.667770    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd"
Oct 30 23:50:29.712823 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:29.712643    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd" podStartSLOduration=2.712621773 podStartE2EDuration="2.712621773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:50:29.710991909 +0000 UTC m=+1888.955847677" watchObservedRunningTime="2026-10-30 23:50:29.712621773 +0000 UTC m=+1888.957477543"
Oct 30 23:50:30.218618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:30.200088    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:31.232527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:31.232492    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:32.524793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:32.524754    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:33.551395 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:33.551363    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:33.906837 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:33.906797    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:34.694197 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:34.694162    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:35.407470 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:35.407432    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:36.173899 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.173865    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"]
Oct 30 23:50:36.185607 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.185569    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"]
Oct 30 23:50:36.185805 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.185711    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"
Oct 30 23:50:36.191104 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.191072    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-f0817c-serving-cert\""
Oct 30 23:50:36.230344 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.230308    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:36.295189 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.295150    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbpg2\" (UniqueName: \"kubernetes.io/projected/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-kube-api-access-sbpg2\") pod \"maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929\" (UID: \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"
Oct 30 23:50:36.295385 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.295313    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929\" (UID: \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"
Oct 30 23:50:36.295385 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.295375    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-maas-api-tls\") pod \"maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929\" (UID: \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"
Oct 30 23:50:36.295521 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.295505    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-metrics-certs\") pod \"maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929\" (UID: \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"
Oct 30 23:50:36.393241 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.391981    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:36.397613 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.397378    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929\" (UID: \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"
Oct 30 23:50:36.434669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.398327    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929\" (UID: \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"
Oct 30 23:50:36.434669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.429061    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-maas-api-tls\") pod \"maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929\" (UID: \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"
Oct 30 23:50:36.434669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.429897    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-metrics-certs\") pod \"maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929\" (UID: \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"
Oct 30 23:50:36.434966 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.434664    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbpg2\" (UniqueName: \"kubernetes.io/projected/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-kube-api-access-sbpg2\") pod \"maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929\" (UID: \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"
Oct 30 23:50:36.485614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.475501    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-metrics-certs\") pod \"maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929\" (UID: \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"
Oct 30 23:50:36.485614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.478312    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-maas-api-tls\") pod \"maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929\" (UID: \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"
Oct 30 23:50:36.500736 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.499279    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbpg2\" (UniqueName: \"kubernetes.io/projected/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-kube-api-access-sbpg2\") pod \"maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929\" (UID: \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"
Oct 30 23:50:36.517150 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.516883    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"
Oct 30 23:50:36.804284 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.804203    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:36.824332 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:50:36.824296    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96e378dd_b7e6_4a84_a4f2_65abb0d0c96b.slice/crio-d1ac65f68464c7f6822430106269d3068edff1b47e0b9885c59ae9ed4f59a310 WatchSource:0}: Error finding container d1ac65f68464c7f6822430106269d3068edff1b47e0b9885c59ae9ed4f59a310: Status 404 returned error can't find the container with id d1ac65f68464c7f6822430106269d3068edff1b47e0b9885c59ae9ed4f59a310
Oct 30 23:50:36.824332 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:36.824322    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"]
Oct 30 23:50:37.263881 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:37.263841    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:37.415831 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:37.415794    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:37.730619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:37.728107    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:37.864625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:37.863566    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929" event={"ID":"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b","Type":"ContainerStarted","Data":"d1ac65f68464c7f6822430106269d3068edff1b47e0b9885c59ae9ed4f59a310"}
Oct 30 23:50:38.520782 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:38.520732    4921 patch_prober.go:29] interesting pod/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:50:38.521188 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:38.520796    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v" podUID="60266ba7-f106-4558-a4c2-adb24675cf0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:50:38.561088 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:38.561007    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:38.885156 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:38.885123    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929" event={"ID":"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b","Type":"ContainerStarted","Data":"45b33bbadfa24e2a9e34bffbf3985edb3a42a756cf464856042a7762dc40a317"}
Oct 30 23:50:38.885322 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:38.885172    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"
Oct 30 23:50:38.897976 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:38.897929    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929" podStartSLOduration=2.447611455 podStartE2EDuration="2.89791467s" totalImagesPullingTime="450.303215ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:50:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:50:38.896054511 +0000 UTC m=+1898.140910290" watchObservedRunningTime="2026-10-30 23:50:38.89791467 +0000 UTC m=+1898.142770438"
Oct 30 23:50:39.347731 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:39.347642    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:40.055319 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.055241    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"]
Oct 30 23:50:40.060219 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.060192    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.083717 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.083689    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"]
Oct 30 23:50:40.083957 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.074138    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-23f75e-openshift-default-dockercfg-ngphj\""
Oct 30 23:50:40.091772 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.091718    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f74xg\" (UniqueName: \"kubernetes.io/projected/db14c4d8-1735-4c65-8565-e80c251983b7-kube-api-access-f74xg\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.091959 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.091772    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-workload-socket\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.091959 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.091928    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db14c4d8-1735-4c65-8565-e80c251983b7-istiod-ca-cert\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.092514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.091965    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-workload-certs\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.092514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.092032    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-istio-envoy\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.092514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.092092    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-istio-data\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.092514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.092120    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db14c4d8-1735-4c65-8565-e80c251983b7-istio-token\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.092514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.092174    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-credential-socket\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.092514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.092286    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db14c4d8-1735-4c65-8565-e80c251983b7-istio-podinfo\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.193847 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.193763    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-credential-socket\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.194021 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.193890    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db14c4d8-1735-4c65-8565-e80c251983b7-istio-podinfo\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.194021 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.193928    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f74xg\" (UniqueName: \"kubernetes.io/projected/db14c4d8-1735-4c65-8565-e80c251983b7-kube-api-access-f74xg\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.194021 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.193959    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-workload-socket\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.194203 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.194141    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db14c4d8-1735-4c65-8565-e80c251983b7-istiod-ca-cert\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.194203 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.194181    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-workload-certs\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.194310 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.194214    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-credential-socket\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.194310 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.194277    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-istio-envoy\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.194430 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.194339    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-workload-socket\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.194430 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.194354    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-istio-data\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.194430 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.194386    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db14c4d8-1735-4c65-8565-e80c251983b7-istio-token\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.194586 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.194524    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-workload-certs\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.195027 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.194945    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db14c4d8-1735-4c65-8565-e80c251983b7-istiod-ca-cert\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.195027 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.194956    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-istio-data\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.196563 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.196545    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db14c4d8-1735-4c65-8565-e80c251983b7-istio-podinfo\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.196687 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.196614    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-istio-envoy\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.206810 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.206788    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f74xg\" (UniqueName: \"kubernetes.io/projected/db14c4d8-1735-4c65-8565-e80c251983b7-kube-api-access-f74xg\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.207003 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.206988    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db14c4d8-1735-4c65-8565-e80c251983b7-istio-token\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.374776 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.374731    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:40.396616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.390952    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:40.522421 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.520494    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:40.741549 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.741520    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"]
Oct 30 23:50:40.741927 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:50:40.741885    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb14c4d8_1735_4c65_8565_e80c251983b7.slice/crio-3a05ebdd27aae55dc2e6ad1d7e693fd27f0c0a5c3da07a37c1af1a8413bd53f0 WatchSource:0}: Error finding container 3a05ebdd27aae55dc2e6ad1d7e693fd27f0c0a5c3da07a37c1af1a8413bd53f0: Status 404 returned error can't find the container with id 3a05ebdd27aae55dc2e6ad1d7e693fd27f0c0a5c3da07a37c1af1a8413bd53f0
Oct 30 23:50:40.744984 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.744947    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:50:40.745067 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.745020    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:50:40.745067 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.745051    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:50:40.850262 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.850221    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:40.924379 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.924338    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9" event={"ID":"db14c4d8-1735-4c65-8565-e80c251983b7","Type":"ContainerStarted","Data":"092f570d56d33d12ce6ea25ed3a1d19dae0f0efb3a51df82f604645c9d9c4751"}
Oct 30 23:50:40.924581 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.924439    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9" event={"ID":"db14c4d8-1735-4c65-8565-e80c251983b7","Type":"ContainerStarted","Data":"3a05ebdd27aae55dc2e6ad1d7e693fd27f0c0a5c3da07a37c1af1a8413bd53f0"}
Oct 30 23:50:40.926561 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.926517    4921 generic.go:356] "Generic (PLEG): container finished" podID="60266ba7-f106-4558-a4c2-adb24675cf0b" containerID="15d286c56d0ba51bc870c7d657962bcf3022631784c85ead6d9f0285152466e0" exitCode=0
Oct 30 23:50:40.926757 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.926624    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v" event={"ID":"60266ba7-f106-4558-a4c2-adb24675cf0b","Type":"ContainerDied","Data":"15d286c56d0ba51bc870c7d657962bcf3022631784c85ead6d9f0285152466e0"}
Oct 30 23:50:40.927036 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.927017    4921 scope.go:122] "RemoveContainer" containerID="15d286c56d0ba51bc870c7d657962bcf3022631784c85ead6d9f0285152466e0"
Oct 30 23:50:40.929837 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.929771    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:50:40.929954 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.929892    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:50:40.930103 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.929948    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:50:40.952305 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.952165    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9" podStartSLOduration=0.952149801 podStartE2EDuration="952.149801ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:50:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:50:40.949901942 +0000 UTC m=+1900.194757712" watchObservedRunningTime="2026-10-30 23:50:40.952149801 +0000 UTC m=+1900.197005569"
Oct 30 23:50:40.996649 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:40.993260    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:41.341226 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:41.341145    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:41.396086 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:41.396050    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:41.404027 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:41.403993    4921 patch_prober.go:29] interesting pod/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 23:50:41.404358 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:41.404286    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9" podUID="db14c4d8-1735-4c65-8565-e80c251983b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 23:50:41.513092 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:50:41.511106    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:50:41.706691 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:41.706661    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd"
Oct 30 23:50:41.938058 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:41.938024    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v" event={"ID":"60266ba7-f106-4558-a4c2-adb24675cf0b","Type":"ContainerStarted","Data":"b926282ae127cb6e980ce0cd4fa2fb179128d7cf5e8faeaaf451dbd0b4cd22b1"}
Oct 30 23:50:42.255771 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:42.244144    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:42.457616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:42.419362    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:42.457616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:42.419495    4921 patch_prober.go:29] interesting pod/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 23:50:42.457616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:42.419553    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9" podUID="db14c4d8-1735-4c65-8565-e80c251983b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 23:50:42.636353 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:42.626320    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:50:42.636353 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:42.626491    4921 patch_prober.go:29] interesting pod/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 23:50:42.636353 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:42.626536    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v" podUID="60266ba7-f106-4558-a4c2-adb24675cf0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 23:50:43.087695 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:43.084171    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:43.352913 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:43.334082    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:43.438298 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:43.424961    4921 patch_prober.go:29] interesting pod/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 23:50:43.438298 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:43.426647    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9" podUID="db14c4d8-1735-4c65-8565-e80c251983b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 23:50:43.625880 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:43.625789    4921 patch_prober.go:29] interesting pod/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 23:50:43.643142 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:43.643106    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v" podUID="60266ba7-f106-4558-a4c2-adb24675cf0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 23:50:44.397561 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:44.397525    4921 patch_prober.go:29] interesting pod/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 23:50:44.397896 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:44.397866    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9" podUID="db14c4d8-1735-4c65-8565-e80c251983b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 23:50:44.586335 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:44.586267    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:44.627007 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:44.626966    4921 patch_prober.go:29] interesting pod/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 23:50:44.627681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:44.627647    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v" podUID="60266ba7-f106-4558-a4c2-adb24675cf0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 23:50:45.402618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:45.401815    4921 patch_prober.go:29] interesting pod/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 23:50:45.402618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:45.401876    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9" podUID="db14c4d8-1735-4c65-8565-e80c251983b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 23:50:45.625205 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:45.625168    4921 patch_prober.go:29] interesting pod/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 23:50:45.625393 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:45.625229    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v" podUID="60266ba7-f106-4558-a4c2-adb24675cf0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 23:50:45.634658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:45.629324    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:45.934018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:45.933527    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"
Oct 30 23:50:46.408620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:46.396185    4921 patch_prober.go:29] interesting pod/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 23:50:46.408620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:46.396253    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9" podUID="db14c4d8-1735-4c65-8565-e80c251983b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 23:50:46.459130 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:46.459053    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:46.644449 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:46.644416    4921 patch_prober.go:29] interesting pod/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 23:50:46.645030 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:46.644998    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v" podUID="60266ba7-f106-4558-a4c2-adb24675cf0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 23:50:46.715711 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:46.708922    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:46.866129 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:46.866095    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"]
Oct 30 23:50:46.866424 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:46.866396    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf" podUID="fc434507-b343-4714-9a9d-514f80df9da6" containerName="istio-proxy" containerID="cri-o://a00c119273e4c86cb57c4881e1eb35988ae597b7ba6859684764f2ec503dcc7f" gracePeriod=30
Oct 30 23:50:47.041681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:47.033514    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:47.340673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:47.332766    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"]
Oct 30 23:50:47.340673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:47.333021    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64" podUID="061058ad-359f-44ac-a47b-ee6587a9a906" containerName="istio-proxy" containerID="cri-o://3c9537420621e3d97582f034cf09dabb1dc6977568329d5907ae2b1eb73b3097" gracePeriod=30
Oct 30 23:50:47.393486 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:47.392935    4921 patch_prober.go:29] interesting pod/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 23:50:47.393486 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:47.392992    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9" podUID="db14c4d8-1735-4c65-8565-e80c251983b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 23:50:47.627269 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:47.627096    4921 patch_prober.go:29] interesting pod/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 23:50:47.627269 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:47.627176    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v" podUID="60266ba7-f106-4558-a4c2-adb24675cf0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 23:50:48.130942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:48.130910    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:48.397614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:48.394113    4921 patch_prober.go:29] interesting pod/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 23:50:48.397614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:48.394188    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9" podUID="db14c4d8-1735-4c65-8565-e80c251983b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 23:50:48.625808 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:48.625767    4921 patch_prober.go:29] interesting pod/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 23:50:48.625984 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:48.625835    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v" podUID="60266ba7-f106-4558-a4c2-adb24675cf0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 23:50:48.947871 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:48.947830    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:49.397828 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:49.397786    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:49.398345 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:49.398317    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:49.398961 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:49.398938    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:50:49.629888 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:49.629855    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:50:49.630350 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:49.630334    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:50:49.631004 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:49.630984    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:50:49.847073 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:49.846993    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:50.720957 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.720920    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"]
Oct 30 23:50:50.727387 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.727363    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"
Oct 30 23:50:50.734401 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.734373    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-32732d-serving-cert\""
Oct 30 23:50:50.742390 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.741215    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"]
Oct 30 23:50:50.754926 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.754900    4921 patch_prober.go:29] interesting pod/e2e-mt-6a162557-openshift-default-8677879c89-77kbf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:50:50.755043 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.754972    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf" podUID="fc434507-b343-4714-9a9d-514f80df9da6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:50:50.805978 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.805945    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:50.843814 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.843785    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1084bd3f-7b61-492d-b308-34c2fa15986a-maas-api-tls\") pod \"maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq\" (UID: \"1084bd3f-7b61-492d-b308-34c2fa15986a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"
Oct 30 23:50:50.843950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.843849    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1084bd3f-7b61-492d-b308-34c2fa15986a-metrics-certs\") pod \"maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq\" (UID: \"1084bd3f-7b61-492d-b308-34c2fa15986a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"
Oct 30 23:50:50.844021 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.843992    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf2zj\" (UniqueName: \"kubernetes.io/projected/1084bd3f-7b61-492d-b308-34c2fa15986a-kube-api-access-cf2zj\") pod \"maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq\" (UID: \"1084bd3f-7b61-492d-b308-34c2fa15986a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"
Oct 30 23:50:50.844159 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.844039    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1084bd3f-7b61-492d-b308-34c2fa15986a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq\" (UID: \"1084bd3f-7b61-492d-b308-34c2fa15986a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"
Oct 30 23:50:50.951618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.947130    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1084bd3f-7b61-492d-b308-34c2fa15986a-maas-api-tls\") pod \"maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq\" (UID: \"1084bd3f-7b61-492d-b308-34c2fa15986a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"
Oct 30 23:50:50.951618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.947232    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1084bd3f-7b61-492d-b308-34c2fa15986a-metrics-certs\") pod \"maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq\" (UID: \"1084bd3f-7b61-492d-b308-34c2fa15986a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"
Oct 30 23:50:50.951618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.947354    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf2zj\" (UniqueName: \"kubernetes.io/projected/1084bd3f-7b61-492d-b308-34c2fa15986a-kube-api-access-cf2zj\") pod \"maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq\" (UID: \"1084bd3f-7b61-492d-b308-34c2fa15986a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"
Oct 30 23:50:50.951618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.947402    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1084bd3f-7b61-492d-b308-34c2fa15986a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq\" (UID: \"1084bd3f-7b61-492d-b308-34c2fa15986a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"
Oct 30 23:50:50.951618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.948350    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1084bd3f-7b61-492d-b308-34c2fa15986a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq\" (UID: \"1084bd3f-7b61-492d-b308-34c2fa15986a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"
Oct 30 23:50:50.959735 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.957246    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1084bd3f-7b61-492d-b308-34c2fa15986a-maas-api-tls\") pod \"maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq\" (UID: \"1084bd3f-7b61-492d-b308-34c2fa15986a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"
Oct 30 23:50:50.971777 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.971562    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:50.976203 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.975658    4921 patch_prober.go:29] interesting pod/e2e-mt-6a162557-openshift-default-8677879c89-l7b64 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:50:50.976203 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.975727    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64" podUID="061058ad-359f-44ac-a47b-ee6587a9a906" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:50:50.999578 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:50.999541    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1084bd3f-7b61-492d-b308-34c2fa15986a-metrics-certs\") pod \"maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq\" (UID: \"1084bd3f-7b61-492d-b308-34c2fa15986a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"
Oct 30 23:50:51.007276 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:51.007209    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf2zj\" (UniqueName: \"kubernetes.io/projected/1084bd3f-7b61-492d-b308-34c2fa15986a-kube-api-access-cf2zj\") pod \"maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq\" (UID: \"1084bd3f-7b61-492d-b308-34c2fa15986a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"
Oct 30 23:50:51.055620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:51.054520    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"
Oct 30 23:50:51.345010 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:51.344968    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"]
Oct 30 23:50:51.345175 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:50:51.345099    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1084bd3f_7b61_492d_b308_34c2fa15986a.slice/crio-4ac83942e873942fdd97551a92f376b86d04bb68da493faa273f5a8eff40dbf6 WatchSource:0}: Error finding container 4ac83942e873942fdd97551a92f376b86d04bb68da493faa273f5a8eff40dbf6: Status 404 returned error can't find the container with id 4ac83942e873942fdd97551a92f376b86d04bb68da493faa273f5a8eff40dbf6
Oct 30 23:50:51.843185 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:51.843153    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:52.200069 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.200030    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:50:52.327480 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.327439    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq" event={"ID":"1084bd3f-7b61-492d-b308-34c2fa15986a","Type":"ContainerStarted","Data":"99a2d79ec025bc253de17d41c50315d7231b7d3959872961f07a4ac7df4f92c1"}
Oct 30 23:50:52.327723 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.327507    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq" event={"ID":"1084bd3f-7b61-492d-b308-34c2fa15986a","Type":"ContainerStarted","Data":"4ac83942e873942fdd97551a92f376b86d04bb68da493faa273f5a8eff40dbf6"}
Oct 30 23:50:52.327723 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.327536    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"
Oct 30 23:50:52.329418 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.329388    4921 generic.go:356] "Generic (PLEG): container finished" podID="fc434507-b343-4714-9a9d-514f80df9da6" containerID="a00c119273e4c86cb57c4881e1eb35988ae597b7ba6859684764f2ec503dcc7f" exitCode=0
Oct 30 23:50:52.329542 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.329434    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"
Oct 30 23:50:52.329542 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.329427    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf" event={"ID":"fc434507-b343-4714-9a9d-514f80df9da6","Type":"ContainerDied","Data":"a00c119273e4c86cb57c4881e1eb35988ae597b7ba6859684764f2ec503dcc7f"}
Oct 30 23:50:52.329685 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.329555    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf" event={"ID":"fc434507-b343-4714-9a9d-514f80df9da6","Type":"ContainerDied","Data":"a9996a71783ac8308f2f920086baaacb7d71f171bed8a015f690fe0a2c4c0b9e"}
Oct 30 23:50:52.329685 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.329606    4921 scope.go:122] "RemoveContainer" containerID="a00c119273e4c86cb57c4881e1eb35988ae597b7ba6859684764f2ec503dcc7f"
Oct 30 23:50:52.343730 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.343710    4921 scope.go:122] "RemoveContainer" containerID="a00c119273e4c86cb57c4881e1eb35988ae597b7ba6859684764f2ec503dcc7f"
Oct 30 23:50:52.344063 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:50:52.344037    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a00c119273e4c86cb57c4881e1eb35988ae597b7ba6859684764f2ec503dcc7f\": container with ID starting with a00c119273e4c86cb57c4881e1eb35988ae597b7ba6859684764f2ec503dcc7f not found: ID does not exist" containerID="a00c119273e4c86cb57c4881e1eb35988ae597b7ba6859684764f2ec503dcc7f"
Oct 30 23:50:52.344150 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.344076    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a00c119273e4c86cb57c4881e1eb35988ae597b7ba6859684764f2ec503dcc7f"} err="failed to get container status \"a00c119273e4c86cb57c4881e1eb35988ae597b7ba6859684764f2ec503dcc7f\": rpc error: code = NotFound desc = could not find container \"a00c119273e4c86cb57c4881e1eb35988ae597b7ba6859684764f2ec503dcc7f\": container with ID starting with a00c119273e4c86cb57c4881e1eb35988ae597b7ba6859684764f2ec503dcc7f not found: ID does not exist"
Oct 30 23:50:52.357379 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.357329    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq" podStartSLOduration=1.732801115 podStartE2EDuration="2.357314239s" totalImagesPullingTime="624.513124ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:50:52.351104559 +0000 UTC m=+1911.595960330" watchObservedRunningTime="2026-10-30 23:50:52.357314239 +0000 UTC m=+1911.602170042"
Oct 30 23:50:52.384841 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.384801    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-workload-socket\") pod \"fc434507-b343-4714-9a9d-514f80df9da6\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") "
Oct 30 23:50:52.385026 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.384885    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-istio-data\") pod \"fc434507-b343-4714-9a9d-514f80df9da6\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") "
Oct 30 23:50:52.385026 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.384924    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-istio-envoy\") pod \"fc434507-b343-4714-9a9d-514f80df9da6\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") "
Oct 30 23:50:52.385167 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.385032    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fc434507-b343-4714-9a9d-514f80df9da6-kube-api-access-czlhr\" (UniqueName: \"kubernetes.io/projected/fc434507-b343-4714-9a9d-514f80df9da6-kube-api-access-czlhr\") pod \"fc434507-b343-4714-9a9d-514f80df9da6\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") "
Oct 30 23:50:52.385167 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.385072    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-workload-certs\") pod \"fc434507-b343-4714-9a9d-514f80df9da6\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") "
Oct 30 23:50:52.385336 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.385313    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fc434507-b343-4714-9a9d-514f80df9da6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc434507-b343-4714-9a9d-514f80df9da6-istiod-ca-cert\") pod \"fc434507-b343-4714-9a9d-514f80df9da6\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") "
Oct 30 23:50:52.385454 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.385435    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fc434507-b343-4714-9a9d-514f80df9da6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc434507-b343-4714-9a9d-514f80df9da6-istio-podinfo\") pod \"fc434507-b343-4714-9a9d-514f80df9da6\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") "
Oct 30 23:50:52.385522 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.385495    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-credential-socket\") pod \"fc434507-b343-4714-9a9d-514f80df9da6\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") "
Oct 30 23:50:52.385587 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.385559    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fc434507-b343-4714-9a9d-514f80df9da6-istio-token\" (UniqueName: \"kubernetes.io/projected/fc434507-b343-4714-9a9d-514f80df9da6-istio-token\") pod \"fc434507-b343-4714-9a9d-514f80df9da6\" (UID: \"fc434507-b343-4714-9a9d-514f80df9da6\") "
Oct 30 23:50:52.386315 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.386287    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-workload-socket" pod "fc434507-b343-4714-9a9d-514f80df9da6" (UID: "fc434507-b343-4714-9a9d-514f80df9da6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:50:52.386478 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.386460    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-istio-data" pod "fc434507-b343-4714-9a9d-514f80df9da6" (UID: "fc434507-b343-4714-9a9d-514f80df9da6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:50:52.394786 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.386711    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-workload-certs" pod "fc434507-b343-4714-9a9d-514f80df9da6" (UID: "fc434507-b343-4714-9a9d-514f80df9da6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:50:52.394786 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.386948    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:50:52.394786 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.386965    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:50:52.394786 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.386974    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:50:52.394786 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.387247    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc434507-b343-4714-9a9d-514f80df9da6-istiod-ca-cert" pod "fc434507-b343-4714-9a9d-514f80df9da6" (UID: "fc434507-b343-4714-9a9d-514f80df9da6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:50:52.394786 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.387677    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-credential-socket" pod "fc434507-b343-4714-9a9d-514f80df9da6" (UID: "fc434507-b343-4714-9a9d-514f80df9da6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:50:52.398084 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.398042    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc434507-b343-4714-9a9d-514f80df9da6-istio-token" pod "fc434507-b343-4714-9a9d-514f80df9da6" (UID: "fc434507-b343-4714-9a9d-514f80df9da6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:50:52.398213 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.398173    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-istio-envoy" pod "fc434507-b343-4714-9a9d-514f80df9da6" (UID: "fc434507-b343-4714-9a9d-514f80df9da6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:50:52.399306 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.399274    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc434507-b343-4714-9a9d-514f80df9da6-kube-api-access-czlhr" pod "fc434507-b343-4714-9a9d-514f80df9da6" (UID: "fc434507-b343-4714-9a9d-514f80df9da6"). InnerVolumeSpecName "kube-api-access-czlhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:50:52.405016 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.404475    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc434507-b343-4714-9a9d-514f80df9da6-istio-podinfo" pod "fc434507-b343-4714-9a9d-514f80df9da6" (UID: "fc434507-b343-4714-9a9d-514f80df9da6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:50:52.539939 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.522700    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc434507-b343-4714-9a9d-514f80df9da6-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:50:52.539939 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.522741    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc434507-b343-4714-9a9d-514f80df9da6-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:50:52.539939 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.522756    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:50:52.539939 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.522769    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc434507-b343-4714-9a9d-514f80df9da6-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:50:52.539939 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.522782    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc434507-b343-4714-9a9d-514f80df9da6-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:50:52.539939 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.522795    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czlhr\" (UniqueName: \"kubernetes.io/projected/fc434507-b343-4714-9a9d-514f80df9da6-kube-api-access-czlhr\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:50:52.661881 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.661848    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"]
Oct 30 23:50:52.666117 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.666090    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-77kbf"]
Oct 30 23:50:52.795544 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.795519    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:50:52.861971 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.861937    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:52.886685 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.886653    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fc434507-b343-4714-9a9d-514f80df9da6" path="/var/lib/kubelet/pods/fc434507-b343-4714-9a9d-514f80df9da6/volumes"
Oct 30 23:50:52.964620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.963478    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-istio-envoy\") pod \"061058ad-359f-44ac-a47b-ee6587a9a906\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") "
Oct 30 23:50:52.964620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.963811    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-istio-data\") pod \"061058ad-359f-44ac-a47b-ee6587a9a906\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") "
Oct 30 23:50:52.964620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.964099    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/061058ad-359f-44ac-a47b-ee6587a9a906-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/061058ad-359f-44ac-a47b-ee6587a9a906-istio-podinfo\") pod \"061058ad-359f-44ac-a47b-ee6587a9a906\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") "
Oct 30 23:50:52.964620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.964272    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-credential-socket\") pod \"061058ad-359f-44ac-a47b-ee6587a9a906\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") "
Oct 30 23:50:52.964620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.964305    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-workload-socket\") pod \"061058ad-359f-44ac-a47b-ee6587a9a906\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") "
Oct 30 23:50:53.001688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.966229    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/061058ad-359f-44ac-a47b-ee6587a9a906-istio-token\" (UniqueName: \"kubernetes.io/projected/061058ad-359f-44ac-a47b-ee6587a9a906-istio-token\") pod \"061058ad-359f-44ac-a47b-ee6587a9a906\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") "
Oct 30 23:50:53.001688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.966301    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-workload-certs\") pod \"061058ad-359f-44ac-a47b-ee6587a9a906\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") "
Oct 30 23:50:53.001688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.966344    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/061058ad-359f-44ac-a47b-ee6587a9a906-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/061058ad-359f-44ac-a47b-ee6587a9a906-istiod-ca-cert\") pod \"061058ad-359f-44ac-a47b-ee6587a9a906\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") "
Oct 30 23:50:53.001688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.966501    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/061058ad-359f-44ac-a47b-ee6587a9a906-kube-api-access-gxmbw\" (UniqueName: \"kubernetes.io/projected/061058ad-359f-44ac-a47b-ee6587a9a906-kube-api-access-gxmbw\") pod \"061058ad-359f-44ac-a47b-ee6587a9a906\" (UID: \"061058ad-359f-44ac-a47b-ee6587a9a906\") "
Oct 30 23:50:53.001688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.966925    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-istio-data" pod "061058ad-359f-44ac-a47b-ee6587a9a906" (UID: "061058ad-359f-44ac-a47b-ee6587a9a906"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:50:53.001688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.969563    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-workload-certs" pod "061058ad-359f-44ac-a47b-ee6587a9a906" (UID: "061058ad-359f-44ac-a47b-ee6587a9a906"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:50:53.001688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.970373    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/061058ad-359f-44ac-a47b-ee6587a9a906-istiod-ca-cert" pod "061058ad-359f-44ac-a47b-ee6587a9a906" (UID: "061058ad-359f-44ac-a47b-ee6587a9a906"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:50:53.001688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.974781    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-credential-socket" pod "061058ad-359f-44ac-a47b-ee6587a9a906" (UID: "061058ad-359f-44ac-a47b-ee6587a9a906"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:50:53.001688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.975138    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-workload-socket" pod "061058ad-359f-44ac-a47b-ee6587a9a906" (UID: "061058ad-359f-44ac-a47b-ee6587a9a906"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:50:53.001688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.979334    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-istio-envoy" pod "061058ad-359f-44ac-a47b-ee6587a9a906" (UID: "061058ad-359f-44ac-a47b-ee6587a9a906"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:50:53.001688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.979920    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/061058ad-359f-44ac-a47b-ee6587a9a906-istio-token" pod "061058ad-359f-44ac-a47b-ee6587a9a906" (UID: "061058ad-359f-44ac-a47b-ee6587a9a906"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:50:53.001688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.983091    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/061058ad-359f-44ac-a47b-ee6587a9a906-istio-podinfo" pod "061058ad-359f-44ac-a47b-ee6587a9a906" (UID: "061058ad-359f-44ac-a47b-ee6587a9a906"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:50:53.001688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.983464    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/061058ad-359f-44ac-a47b-ee6587a9a906-kube-api-access-gxmbw" pod "061058ad-359f-44ac-a47b-ee6587a9a906" (UID: "061058ad-359f-44ac-a47b-ee6587a9a906"). InnerVolumeSpecName "kube-api-access-gxmbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:50:53.001688 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:52.994262    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:53.071950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.071840    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:50:53.071950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.071871    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:50:53.071950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.071891    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/061058ad-359f-44ac-a47b-ee6587a9a906-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:50:53.071950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.071900    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:50:53.071950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.071909    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:50:53.071950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.071918    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/061058ad-359f-44ac-a47b-ee6587a9a906-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:50:53.071950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.071926    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/061058ad-359f-44ac-a47b-ee6587a9a906-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:50:53.071950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.071935    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/061058ad-359f-44ac-a47b-ee6587a9a906-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:50:53.071950 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.071944    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxmbw\" (UniqueName: \"kubernetes.io/projected/061058ad-359f-44ac-a47b-ee6587a9a906-kube-api-access-gxmbw\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:50:53.343324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.343225    4921 generic.go:356] "Generic (PLEG): container finished" podID="061058ad-359f-44ac-a47b-ee6587a9a906" containerID="3c9537420621e3d97582f034cf09dabb1dc6977568329d5907ae2b1eb73b3097" exitCode=0
Oct 30 23:50:53.343324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.343289    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64" event={"ID":"061058ad-359f-44ac-a47b-ee6587a9a906","Type":"ContainerDied","Data":"3c9537420621e3d97582f034cf09dabb1dc6977568329d5907ae2b1eb73b3097"}
Oct 30 23:50:53.343324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.343309    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"
Oct 30 23:50:53.343686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.343378    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64" event={"ID":"061058ad-359f-44ac-a47b-ee6587a9a906","Type":"ContainerDied","Data":"9a1ec47d6493b8b97cf2ffe747283d4c8e27633d415ace64d50483e105dc64b4"}
Oct 30 23:50:53.343686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.343414    4921 scope.go:122] "RemoveContainer" containerID="3c9537420621e3d97582f034cf09dabb1dc6977568329d5907ae2b1eb73b3097"
Oct 30 23:50:53.357525 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.357507    4921 scope.go:122] "RemoveContainer" containerID="3c9537420621e3d97582f034cf09dabb1dc6977568329d5907ae2b1eb73b3097"
Oct 30 23:50:53.357862 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:50:53.357839    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c9537420621e3d97582f034cf09dabb1dc6977568329d5907ae2b1eb73b3097\": container with ID starting with 3c9537420621e3d97582f034cf09dabb1dc6977568329d5907ae2b1eb73b3097 not found: ID does not exist" containerID="3c9537420621e3d97582f034cf09dabb1dc6977568329d5907ae2b1eb73b3097"
Oct 30 23:50:53.357949 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.357874    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c9537420621e3d97582f034cf09dabb1dc6977568329d5907ae2b1eb73b3097"} err="failed to get container status \"3c9537420621e3d97582f034cf09dabb1dc6977568329d5907ae2b1eb73b3097\": rpc error: code = NotFound desc = could not find container \"3c9537420621e3d97582f034cf09dabb1dc6977568329d5907ae2b1eb73b3097\": container with ID starting with 3c9537420621e3d97582f034cf09dabb1dc6977568329d5907ae2b1eb73b3097 not found: ID does not exist"
Oct 30 23:50:53.374561 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.374511    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"]
Oct 30 23:50:53.379209 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.379186    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6a162557-openshift-default-8677879c89-l7b64"]
Oct 30 23:50:53.435811 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.435769    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:53.630601 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:53.630508    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:54.439260 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:54.439220    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:54.885693 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:54.885663    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="061058ad-359f-44ac-a47b-ee6587a9a906" path="/var/lib/kubelet/pods/061058ad-359f-44ac-a47b-ee6587a9a906/volumes"
Oct 30 23:50:55.066806 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.066772    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"]
Oct 30 23:50:55.067651 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.067631    4921 cpu_manager.go:414] "containerMap: removing container" podUID="061058ad-359f-44ac-a47b-ee6587a9a906" containerName="istio-proxy"
Oct 30 23:50:55.067651 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.067651    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="061058ad-359f-44ac-a47b-ee6587a9a906" containerName="istio-proxy"
Oct 30 23:50:55.067814 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.067685    4921 cpu_manager.go:414] "containerMap: removing container" podUID="fc434507-b343-4714-9a9d-514f80df9da6" containerName="istio-proxy"
Oct 30 23:50:55.067814 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.067692    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc434507-b343-4714-9a9d-514f80df9da6" containerName="istio-proxy"
Oct 30 23:50:55.067891 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.067818    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="fc434507-b343-4714-9a9d-514f80df9da6" containerName="istio-proxy"
Oct 30 23:50:55.067891 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.067832    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="061058ad-359f-44ac-a47b-ee6587a9a906" containerName="istio-proxy"
Oct 30 23:50:55.073863 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.073845    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.089994 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.089972    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"]
Oct 30 23:50:55.118253 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.118214    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-workload-socket\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.118682 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.118655    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed22a052-789a-4e01-a852-b17c921b386a-istiod-ca-cert\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.119169 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.118969    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed22a052-789a-4e01-a852-b17c921b386a-istio-podinfo\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.119462 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.119441    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2pz9\" (UniqueName: \"kubernetes.io/projected/ed22a052-789a-4e01-a852-b17c921b386a-kube-api-access-w2pz9\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.119694 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.119665    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-istio-envoy\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.119831 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.119780    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-credential-socket\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.119913 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.119836    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-istio-data\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.120021 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.119910    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed22a052-789a-4e01-a852-b17c921b386a-istio-token\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.120021 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.119939    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-workload-certs\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.221545 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.221458    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2pz9\" (UniqueName: \"kubernetes.io/projected/ed22a052-789a-4e01-a852-b17c921b386a-kube-api-access-w2pz9\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.221545 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.221502    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-istio-envoy\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.221818 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.221553    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-credential-socket\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.221818 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.221581    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-istio-data\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.221818 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.221647    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed22a052-789a-4e01-a852-b17c921b386a-istio-token\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.222001 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.221966    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-workload-certs\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.222077 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.222047    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-credential-socket\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.222140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.222113    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-workload-socket\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.222194 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.222146    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-istio-data\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.222194 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.222174    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed22a052-789a-4e01-a852-b17c921b386a-istiod-ca-cert\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.222306 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.222235    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed22a052-789a-4e01-a852-b17c921b386a-istio-podinfo\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.222441 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.222314    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-workload-certs\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.222441 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.222403    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-workload-socket\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.223247 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.223222    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed22a052-789a-4e01-a852-b17c921b386a-istiod-ca-cert\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.224458 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.224435    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-istio-envoy\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.225089 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.225069    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed22a052-789a-4e01-a852-b17c921b386a-istio-podinfo\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.226810 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.226784    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:55.233724 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.233703    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed22a052-789a-4e01-a852-b17c921b386a-istio-token\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.233929 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.233904    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2pz9\" (UniqueName: \"kubernetes.io/projected/ed22a052-789a-4e01-a852-b17c921b386a-kube-api-access-w2pz9\") pod \"e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") " pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.392711 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.392680    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:55.693769 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:50:55.693736    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded22a052_789a_4e01_a852_b17c921b386a.slice/crio-360058a8ef24b9c03b3a65f4c398e27c7afc78f4b71d4978757b76c3de429877 WatchSource:0}: Error finding container 360058a8ef24b9c03b3a65f4c398e27c7afc78f4b71d4978757b76c3de429877: Status 404 returned error can't find the container with id 360058a8ef24b9c03b3a65f4c398e27c7afc78f4b71d4978757b76c3de429877
Oct 30 23:50:55.694934 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.694907    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"]
Oct 30 23:50:55.697372 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.697334    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:50:55.697464 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.697426    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:50:55.697525 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:55.697472    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:50:56.188700 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:56.187204    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:56.406966 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:56.406918    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m" event={"ID":"ed22a052-789a-4e01-a852-b17c921b386a","Type":"ContainerStarted","Data":"d1059167897ff954479bfa0cfd67a3018dd68f6e08e97f4b1ff8b6f00304a7a3"}
Oct 30 23:50:56.406966 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:56.406973    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m" event={"ID":"ed22a052-789a-4e01-a852-b17c921b386a","Type":"ContainerStarted","Data":"360058a8ef24b9c03b3a65f4c398e27c7afc78f4b71d4978757b76c3de429877"}
Oct 30 23:50:56.442173 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:56.442073    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m" podStartSLOduration=1.442059269 podStartE2EDuration="1.442059269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:50:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:50:56.440762951 +0000 UTC m=+1915.685618720" watchObservedRunningTime="2026-10-30 23:50:56.442059269 +0000 UTC m=+1915.686915036"
Oct 30 23:50:57.126658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:57.126626    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:57.393434 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:57.393236    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:50:57.395645 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:57.395570    4921 patch_prober.go:29] interesting pod/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.148:15021/healthz/ready\": dial tcp 10.132.0.148:15021: connect: connection refused" start-of-body=
Oct 30 23:50:57.395792 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:57.395677    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m" podUID="ed22a052-789a-4e01-a852-b17c921b386a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.148:15021/healthz/ready\": dial tcp 10.132.0.148:15021: connect: connection refused"
Oct 30 23:50:58.048739 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:58.048702    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:58.349453 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:58.349380    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"
Oct 30 23:50:58.397636 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:58.393582    4921 patch_prober.go:29] interesting pod/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.148:15021/healthz/ready\": dial tcp 10.132.0.148:15021: connect: connection refused" start-of-body=
Oct 30 23:50:58.397636 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:58.393664    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m" podUID="ed22a052-789a-4e01-a852-b17c921b386a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.148:15021/healthz/ready\": dial tcp 10.132.0.148:15021: connect: connection refused"
Oct 30 23:50:59.043538 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:59.043507    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:50:59.397628 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:59.396937    4921 patch_prober.go:29] interesting pod/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.148:15021/healthz/ready\": dial tcp 10.132.0.148:15021: connect: connection refused" start-of-body=
Oct 30 23:50:59.397628 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:50:59.397009    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m" podUID="ed22a052-789a-4e01-a852-b17c921b386a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.148:15021/healthz/ready\": dial tcp 10.132.0.148:15021: connect: connection refused"
Oct 30 23:51:00.150620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:00.149837    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:00.409706 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:00.407731    4921 patch_prober.go:29] interesting pod/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.148:15021/healthz/ready\": dial tcp 10.132.0.148:15021: connect: connection refused" start-of-body=
Oct 30 23:51:00.409706 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:00.407786    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m" podUID="ed22a052-789a-4e01-a852-b17c921b386a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.148:15021/healthz/ready\": dial tcp 10.132.0.148:15021: connect: connection refused"
Oct 30 23:51:01.407491 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:01.407458    4921 patch_prober.go:29] interesting pod/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.148:15021/healthz/ready\": dial tcp 10.132.0.148:15021: connect: connection refused" start-of-body=
Oct 30 23:51:01.407772 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:01.407529    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m" podUID="ed22a052-789a-4e01-a852-b17c921b386a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.148:15021/healthz/ready\": dial tcp 10.132.0.148:15021: connect: connection refused"
Oct 30 23:51:01.535619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:01.532100    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:02.398709 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:02.398680    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:51:02.399111 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:02.399086    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:51:02.399732 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:02.399712    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:51:02.415743 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:02.415698    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:03.117301 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:03.117273    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:03.839150 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:03.839122    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"]
Oct 30 23:51:03.846991 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:03.846961    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"
Oct 30 23:51:03.856984 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:03.856759    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-7b0299-serving-cert\""
Oct 30 23:51:03.863171 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:03.863139    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"]
Oct 30 23:51:03.905989 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:03.905960    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7321904d-e556-46a4-86cb-a412438cdb71-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms\" (UID: \"7321904d-e556-46a4-86cb-a412438cdb71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"
Oct 30 23:51:03.906202 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:03.906181    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7321904d-e556-46a4-86cb-a412438cdb71-maas-api-tls\") pod \"maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms\" (UID: \"7321904d-e556-46a4-86cb-a412438cdb71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"
Oct 30 23:51:03.906316 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:03.906297    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtbxs\" (UniqueName: \"kubernetes.io/projected/7321904d-e556-46a4-86cb-a412438cdb71-kube-api-access-dtbxs\") pod \"maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms\" (UID: \"7321904d-e556-46a4-86cb-a412438cdb71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"
Oct 30 23:51:03.906410 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:03.906396    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7321904d-e556-46a4-86cb-a412438cdb71-metrics-certs\") pod \"maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms\" (UID: \"7321904d-e556-46a4-86cb-a412438cdb71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"
Oct 30 23:51:03.933248 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:03.933217    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:04.036996 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:04.028523    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7321904d-e556-46a4-86cb-a412438cdb71-maas-api-tls\") pod \"maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms\" (UID: \"7321904d-e556-46a4-86cb-a412438cdb71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"
Oct 30 23:51:04.036996 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:04.030047    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtbxs\" (UniqueName: \"kubernetes.io/projected/7321904d-e556-46a4-86cb-a412438cdb71-kube-api-access-dtbxs\") pod \"maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms\" (UID: \"7321904d-e556-46a4-86cb-a412438cdb71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"
Oct 30 23:51:04.036996 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:04.030381    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7321904d-e556-46a4-86cb-a412438cdb71-metrics-certs\") pod \"maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms\" (UID: \"7321904d-e556-46a4-86cb-a412438cdb71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"
Oct 30 23:51:04.036996 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:04.031280    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7321904d-e556-46a4-86cb-a412438cdb71-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms\" (UID: \"7321904d-e556-46a4-86cb-a412438cdb71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"
Oct 30 23:51:04.046088 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:04.044539    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7321904d-e556-46a4-86cb-a412438cdb71-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms\" (UID: \"7321904d-e556-46a4-86cb-a412438cdb71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"
Oct 30 23:51:04.048502 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:04.048469    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7321904d-e556-46a4-86cb-a412438cdb71-maas-api-tls\") pod \"maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms\" (UID: \"7321904d-e556-46a4-86cb-a412438cdb71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"
Oct 30 23:51:04.061001 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:04.060864    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:04.068026 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:04.067951    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtbxs\" (UniqueName: \"kubernetes.io/projected/7321904d-e556-46a4-86cb-a412438cdb71-kube-api-access-dtbxs\") pod \"maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms\" (UID: \"7321904d-e556-46a4-86cb-a412438cdb71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"
Oct 30 23:51:04.114855 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:04.100377    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7321904d-e556-46a4-86cb-a412438cdb71-metrics-certs\") pod \"maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms\" (UID: \"7321904d-e556-46a4-86cb-a412438cdb71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"
Oct 30 23:51:04.170436 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:04.170404    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"
Oct 30 23:51:04.498178 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:04.498148    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"]
Oct 30 23:51:04.498296 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:51:04.498204    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7321904d_e556_46a4_86cb_a412438cdb71.slice/crio-c4bfe844df9aee01ac0ec1a169a4a92445b11605cb3d574f4bfb194ae0076614 WatchSource:0}: Error finding container c4bfe844df9aee01ac0ec1a169a4a92445b11605cb3d574f4bfb194ae0076614: Status 404 returned error can't find the container with id c4bfe844df9aee01ac0ec1a169a4a92445b11605cb3d574f4bfb194ae0076614
Oct 30 23:51:04.500245 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:04.500223    4921 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 23:51:04.634622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:04.612398    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms" event={"ID":"7321904d-e556-46a4-86cb-a412438cdb71","Type":"ContainerStarted","Data":"c4bfe844df9aee01ac0ec1a169a4a92445b11605cb3d574f4bfb194ae0076614"}
Oct 30 23:51:04.953101 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:04.953068    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:05.157864 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:05.157831    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:05.606340 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:05.606270    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:05.629500 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:05.629457    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms" event={"ID":"7321904d-e556-46a4-86cb-a412438cdb71","Type":"ContainerStarted","Data":"03c81deee397b38cf4f085261b18ad0face5b1725eb1dcb2e789e9cf2e5bae9a"}
Oct 30 23:51:05.630716 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:05.629904    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"
Oct 30 23:51:05.702862 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:05.702794    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms" podStartSLOduration=2.052356118 podStartE2EDuration="2.702770876s" totalImagesPullingTime="650.414758ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:51:05.701958109 +0000 UTC m=+1924.946813878" watchObservedRunningTime="2026-10-30 23:51:05.702770876 +0000 UTC m=+1924.947626645"
Oct 30 23:51:06.063626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:06.061232    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:06.204301 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:06.204269    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:07.080615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:07.079239    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:07.835549 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:07.835489    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:08.705288 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:08.705250    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:08.902060 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:08.902025    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:09.660184 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:09.660148    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:10.354670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:10.354636    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:11.319259 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:11.319224    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:11.462789 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:51:11.462749    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:51:11.644001 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:11.643976    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"
Oct 30 23:51:12.127580 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:12.127500    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:12.923758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:12.923727    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:13.975635 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:13.975552    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:14.731776 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:14.731739    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:15.443828 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:15.443792    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:16.208104 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:16.207496    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:16.364622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:16.359521    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:17.176185 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:17.176149    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:17.930437 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:17.930399    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:18.624181 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:18.624136    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:19.463629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:19.457458    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:20.727317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:20.727282    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:22.122865 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:22.122825    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:22.982862 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:22.982815    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:23.025771 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:23.025718    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:23.221272 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:23.221218    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 23:51:23.383670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:23.363482    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:23.383670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:23.363635    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": context deadline exceeded"
Oct 30 23:51:23.555623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:23.554992    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 23:51:23.732069 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:23.676021    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 23:51:23.774614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:23.691047    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 23:51:23.849780 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:23.838623    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 23:51:24.022827 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:24.022709    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:24.028985 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:24.028949    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:51:24.053719 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:24.029325    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:24.054423 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:24.054393    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:51:24.078582 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:24.078540    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:24.224401 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:24.224355    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:24.262216 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:24.262183    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:51:24.345808 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:24.342181    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:24.457644 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:24.457571    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:24.574626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:24.573207    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:24.574626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:24.573729    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:51:24.727468 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:24.727436    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:51:25.062678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:25.033692    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:25.067027 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:25.066985    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:25.248621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:25.230056    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 30 23:51:25.576281 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:25.576239    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:25.736621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:25.734437    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:25.857700 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:25.854752    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:26.103011 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:26.102931    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 23:51:26.412094 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:26.412051    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:26.485520 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:26.485479    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 23:51:26.531489 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:26.529688    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:26.532017 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:26.531810    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:26.587333 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:26.585839    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:26.587333 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:26.586427    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:26.871679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:26.821728    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 30 23:51:27.159830 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:27.159779    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:27.263732 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:27.263677    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:27.486194 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:27.486099    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:27.512534 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:27.512502    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:51:27.537022 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:27.536611    4921 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/health\": context deadline exceeded"
Oct 30 23:51:27.590729 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:27.590546    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:51:27.591448 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:27.591409    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:51:27.706904 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:27.706862    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:27.732854 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:27.732785    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:51:27.821713 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:27.782248    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 30 23:51:28.023225 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:28.023196    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 30 23:51:28.732536 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:28.732499    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:29.840752 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:29.840725    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:30.178291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:30.178252    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:31.042129 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:31.042077    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:31.694732 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:31.694697    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:31.822988 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:31.822951    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:31.984535 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:31.984459    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:32.463615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:32.438161    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:33.016628 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:33.013063    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:33.214127 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:33.214096    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:33.923978 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:33.923946    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:34.654885 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:34.654857    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:35.416100 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:35.416072    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:36.029801 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:36.029721    4921 generic.go:356] "Generic (PLEG): container finished" podID="b87a3c1a-c9af-494e-bdf2-b81ee451f79c" containerID="05bc7afa49cc4862db7a505fef5cdcb24bc595f7346a504556db12a48775cfb0" exitCode=0
Oct 30 23:51:36.029801 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:36.029764    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd" event={"ID":"b87a3c1a-c9af-494e-bdf2-b81ee451f79c","Type":"ContainerDied","Data":"05bc7afa49cc4862db7a505fef5cdcb24bc595f7346a504556db12a48775cfb0"}
Oct 30 23:51:36.030301 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:36.030282    4921 scope.go:122] "RemoveContainer" containerID="05bc7afa49cc4862db7a505fef5cdcb24bc595f7346a504556db12a48775cfb0"
Oct 30 23:51:36.032341 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:36.032307    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:51:36.032421 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:36.032388    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:51:36.032462 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:36.032426    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:51:36.448773 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:36.443090    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:36.854924 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:36.854836    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:36.991683 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:36.991643    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:37.041454 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:37.041423    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd" event={"ID":"b87a3c1a-c9af-494e-bdf2-b81ee451f79c","Type":"ContainerStarted","Data":"3809325d0ac11657b39a819ee963fce839ac792bbdf6fa926babcaf3b865e1a8"}
Oct 30 23:51:37.253271 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:37.253218    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:37.427619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:37.422925    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:51:37.427619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:37.423062    4921 patch_prober.go:29] interesting pod/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused" start-of-body=
Oct 30 23:51:37.427619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:37.423107    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd" podUID="b87a3c1a-c9af-494e-bdf2-b81ee451f79c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused"
Oct 30 23:51:38.160046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:38.160017    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k"]
Oct 30 23:51:38.165895 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:38.165876    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k"
Oct 30 23:51:38.190756 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:38.190727    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-2b4009\""
Oct 30 23:51:38.194185 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:38.194078    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:38.202877 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:38.202849    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k"]
Oct 30 23:51:38.332625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:38.332122    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k\" (UID: \"ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k"
Oct 30 23:51:38.332625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:38.332235    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k959j\" (UniqueName: \"kubernetes.io/projected/ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991-kube-api-access-k959j\") pod \"payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k\" (UID: \"ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k"
Oct 30 23:51:38.429672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:38.419658    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:38.429672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:38.424224    4921 patch_prober.go:29] interesting pod/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused" start-of-body=
Oct 30 23:51:38.429672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:38.424285    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd" podUID="b87a3c1a-c9af-494e-bdf2-b81ee451f79c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused"
Oct 30 23:51:38.447061 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:38.447027    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k\" (UID: \"ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k"
Oct 30 23:51:38.447391 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:38.447369    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k959j\" (UniqueName: \"kubernetes.io/projected/ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991-kube-api-access-k959j\") pod \"payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k\" (UID: \"ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k"
Oct 30 23:51:38.449154 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:38.449130    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k\" (UID: \"ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k"
Oct 30 23:51:38.519657 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:38.517751    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k959j\" (UniqueName: \"kubernetes.io/projected/ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991-kube-api-access-k959j\") pod \"payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k\" (UID: \"ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k"
Oct 30 23:51:38.812668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:38.812196    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k"
Oct 30 23:51:39.157298 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:39.157270    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k"]
Oct 30 23:51:39.157749 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:51:39.157715    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded8f4e4a_46eb_4ab2_a0b7_5117b48c3991.slice/crio-9209ccd908d70f1a82a293b16fe08c53adcbf7d5bc6e1848c91d69440d994c46 WatchSource:0}: Error finding container 9209ccd908d70f1a82a293b16fe08c53adcbf7d5bc6e1848c91d69440d994c46: Status 404 returned error can't find the container with id 9209ccd908d70f1a82a293b16fe08c53adcbf7d5bc6e1848c91d69440d994c46
Oct 30 23:51:39.301831 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:39.301798    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:39.425583 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:39.425037    4921 patch_prober.go:29] interesting pod/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused" start-of-body=
Oct 30 23:51:39.425583 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:39.425121    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd" podUID="b87a3c1a-c9af-494e-bdf2-b81ee451f79c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused"
Oct 30 23:51:39.897656 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:39.897549    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:40.095868 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:40.095816    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k" event={"ID":"ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991","Type":"ContainerStarted","Data":"3bc3aea6313f94f646417a5d8852d7a0ae237710d2c3c9e9f7d482c198a6af0f"}
Oct 30 23:51:40.096149 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:40.096127    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k" event={"ID":"ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991","Type":"ContainerStarted","Data":"9209ccd908d70f1a82a293b16fe08c53adcbf7d5bc6e1848c91d69440d994c46"}
Oct 30 23:51:40.097556 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:40.097532    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k"
Oct 30 23:51:40.453036 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:40.451732    4921 patch_prober.go:29] interesting pod/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused" start-of-body=
Oct 30 23:51:40.453036 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:40.451802    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd" podUID="b87a3c1a-c9af-494e-bdf2-b81ee451f79c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused"
Oct 30 23:51:40.717677 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:40.714550    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:41.422016 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:41.421981    4921 patch_prober.go:29] interesting pod/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused" start-of-body=
Oct 30 23:51:41.422198 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:41.422050    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd" podUID="b87a3c1a-c9af-494e-bdf2-b81ee451f79c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused"
Oct 30 23:51:41.427968 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:51:41.427941    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:51:41.645757 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:41.645726    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:42.421481 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:42.421448    4921 patch_prober.go:29] interesting pod/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused" start-of-body=
Oct 30 23:51:42.421679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:42.421501    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd" podUID="b87a3c1a-c9af-494e-bdf2-b81ee451f79c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused"
Oct 30 23:51:42.543264 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:42.543218    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:43.173375 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:43.173330    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:51:43.323373 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:43.323338    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:43.456683 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:43.450353    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:51:43.483117 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:43.483062    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k" podStartSLOduration=5.483047149 podStartE2EDuration="5.483047149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:51:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:51:40.152870008 +0000 UTC m=+1959.397725777" watchObservedRunningTime="2026-10-30 23:51:43.483047149 +0000 UTC m=+1962.727902916"
Oct 30 23:51:44.063980 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:44.063938    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:44.209360 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:44.209327    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:51:44.743891 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:44.743850    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:45.510169 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:45.510136    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:45.639265 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:45.639225    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:46.322939 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:46.322905    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:46.605339 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:46.605243    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:47.385483 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:47.385403    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:48.246261 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:48.246206    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:49.114617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:49.110685    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:49.889962 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:49.889927    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:50.661289 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:50.661243    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:51.419755 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:51.419722    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:52.165703 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:52.165665    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:52.168179 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:52.168158    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k"
Oct 30 23:51:52.851844 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:52.851807    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:53.642830 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:53.642800    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:53.954668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:53.950471    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:54.239209 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:54.239136    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:54.961183 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:54.961149    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:56.400653 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:56.400571    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:57.321620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:57.314740    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:57.962802 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:57.962771    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"]
Oct 30 23:51:57.969147 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:57.969119    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"
Oct 30 23:51:57.979320 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:57.979294    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-2b4009-serving-cert\""
Oct 30 23:51:57.980982 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:57.980953    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"]
Oct 30 23:51:58.000249 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:58.000221    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d12b276e-860a-4410-a41b-18c5996d398a-metrics-certs\") pod \"maas-api-e2e-inf-a-2b4009-bf8966647-whwmx\" (UID: \"d12b276e-860a-4410-a41b-18c5996d398a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"
Oct 30 23:51:58.000390 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:58.000367    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxw7h\" (UniqueName: \"kubernetes.io/projected/d12b276e-860a-4410-a41b-18c5996d398a-kube-api-access-rxw7h\") pod \"maas-api-e2e-inf-a-2b4009-bf8966647-whwmx\" (UID: \"d12b276e-860a-4410-a41b-18c5996d398a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"
Oct 30 23:51:58.000456 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:58.000445    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d12b276e-860a-4410-a41b-18c5996d398a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2b4009-bf8966647-whwmx\" (UID: \"d12b276e-860a-4410-a41b-18c5996d398a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"
Oct 30 23:51:58.000637 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:58.000562    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d12b276e-860a-4410-a41b-18c5996d398a-maas-api-tls\") pod \"maas-api-e2e-inf-a-2b4009-bf8966647-whwmx\" (UID: \"d12b276e-860a-4410-a41b-18c5996d398a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"
Oct 30 23:51:58.027851 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:58.027816    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:58.103772 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:58.103730    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d12b276e-860a-4410-a41b-18c5996d398a-maas-api-tls\") pod \"maas-api-e2e-inf-a-2b4009-bf8966647-whwmx\" (UID: \"d12b276e-860a-4410-a41b-18c5996d398a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"
Oct 30 23:51:58.104570 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:58.104175    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d12b276e-860a-4410-a41b-18c5996d398a-metrics-certs\") pod \"maas-api-e2e-inf-a-2b4009-bf8966647-whwmx\" (UID: \"d12b276e-860a-4410-a41b-18c5996d398a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"
Oct 30 23:51:58.105157 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:58.105025    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxw7h\" (UniqueName: \"kubernetes.io/projected/d12b276e-860a-4410-a41b-18c5996d398a-kube-api-access-rxw7h\") pod \"maas-api-e2e-inf-a-2b4009-bf8966647-whwmx\" (UID: \"d12b276e-860a-4410-a41b-18c5996d398a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"
Oct 30 23:51:58.106679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:58.106654    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d12b276e-860a-4410-a41b-18c5996d398a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2b4009-bf8966647-whwmx\" (UID: \"d12b276e-860a-4410-a41b-18c5996d398a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"
Oct 30 23:51:58.111245 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:58.111222    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d12b276e-860a-4410-a41b-18c5996d398a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2b4009-bf8966647-whwmx\" (UID: \"d12b276e-860a-4410-a41b-18c5996d398a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"
Oct 30 23:51:58.114916 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:58.114884    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d12b276e-860a-4410-a41b-18c5996d398a-maas-api-tls\") pod \"maas-api-e2e-inf-a-2b4009-bf8966647-whwmx\" (UID: \"d12b276e-860a-4410-a41b-18c5996d398a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"
Oct 30 23:51:58.168721 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:58.168230    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d12b276e-860a-4410-a41b-18c5996d398a-metrics-certs\") pod \"maas-api-e2e-inf-a-2b4009-bf8966647-whwmx\" (UID: \"d12b276e-860a-4410-a41b-18c5996d398a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"
Oct 30 23:51:58.181626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:58.172245    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxw7h\" (UniqueName: \"kubernetes.io/projected/d12b276e-860a-4410-a41b-18c5996d398a-kube-api-access-rxw7h\") pod \"maas-api-e2e-inf-a-2b4009-bf8966647-whwmx\" (UID: \"d12b276e-860a-4410-a41b-18c5996d398a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"
Oct 30 23:51:58.182493 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:58.172449    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:58.290045 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:58.289936    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"
Oct 30 23:51:58.395143 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:58.395074    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:58.699621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:58.687839    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"]
Oct 30 23:51:58.717845 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:51:58.717795    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd12b276e_860a_4410_a41b_18c5996d398a.slice/crio-7916b571e092064b4921a62483c56192bfbd55cacb012563be37839f8c815414 WatchSource:0}: Error finding container 7916b571e092064b4921a62483c56192bfbd55cacb012563be37839f8c815414: Status 404 returned error can't find the container with id 7916b571e092064b4921a62483c56192bfbd55cacb012563be37839f8c815414
Oct 30 23:51:59.060254 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:59.060167    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:51:59.525028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:59.524993    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx" event={"ID":"d12b276e-860a-4410-a41b-18c5996d398a","Type":"ContainerStarted","Data":"2e89049b48f96a9fe6716788fe00dbb2f45b86e7db0f149cda222600b84a45e2"}
Oct 30 23:51:59.525218 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:59.525050    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx" event={"ID":"d12b276e-860a-4410-a41b-18c5996d398a","Type":"ContainerStarted","Data":"7916b571e092064b4921a62483c56192bfbd55cacb012563be37839f8c815414"}
Oct 30 23:51:59.525218 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:59.525073    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"
Oct 30 23:51:59.548000 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:59.547941    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx" podStartSLOduration=1.99875634 podStartE2EDuration="2.547928857s" totalImagesPullingTime="549.172517ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:51:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:51:59.54612017 +0000 UTC m=+1978.790975938" watchObservedRunningTime="2026-10-30 23:51:59.547928857 +0000 UTC m=+1978.792784624"
Oct 30 23:51:59.975620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:51:59.974062    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:00.852303 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:00.848288    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:01.810814 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:01.810783    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:02.660704 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:02.656263    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:03.419962 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:03.419931    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:04.210926 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:04.210888    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:05.014216 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:05.014181    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:05.538253 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:05.538225    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"
Oct 30 23:52:05.886540 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:05.886512    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:06.560520 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:06.560490    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:07.221956 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.221926    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:07.414422 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.414384    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"]
Oct 30 23:52:07.422794 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.422766    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.429151 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.429123    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-7b0299-openshift-default-dockercfg-cq9kk\""
Oct 30 23:52:07.431996 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.431969    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"]
Oct 30 23:52:07.479007 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.478907    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-podinfo\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.479007 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.478961    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-workload-certs\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.479217 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.479065    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-token\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.479217 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.479103    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-credential-socket\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.479291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.479234    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-envoy\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.479358 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.479338    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmkb9\" (UniqueName: \"kubernetes.io/projected/b4f6ed81-049f-42b9-8b90-244d5598728b-kube-api-access-zmkb9\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.479514 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.479498    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4f6ed81-049f-42b9-8b90-244d5598728b-istiod-ca-cert\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.479658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.479639    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-workload-socket\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.479738 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.479716    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-data\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.581357 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.581322    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-podinfo\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.581897 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.581366    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-workload-certs\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.581897 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.581394    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-token\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.581897 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.581433    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-credential-socket\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.581897 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.581483    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-envoy\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.581897 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.581550    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmkb9\" (UniqueName: \"kubernetes.io/projected/b4f6ed81-049f-42b9-8b90-244d5598728b-kube-api-access-zmkb9\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.581897 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.581705    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4f6ed81-049f-42b9-8b90-244d5598728b-istiod-ca-cert\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.581897 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.581816    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-workload-socket\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.581897 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.581886    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-data\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.582370 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.581989    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-workload-certs\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.582370 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.582251    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-data\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.582370 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.582296    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-workload-socket\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.582764 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.582422    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-credential-socket\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.582764 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.582636    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4f6ed81-049f-42b9-8b90-244d5598728b-istiod-ca-cert\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.584283 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.584254    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-envoy\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.584384 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.584362    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-podinfo\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.594044 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.594022    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-token\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.594267 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.594248    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmkb9\" (UniqueName: \"kubernetes.io/projected/b4f6ed81-049f-42b9-8b90-244d5598728b-kube-api-access-zmkb9\") pod \"e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") " pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:07.741137 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:07.741053    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:08.058185 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:52:08.058149    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4f6ed81_049f_42b9_8b90_244d5598728b.slice/crio-4ebaf8192d513ca1ea9e3321a8c89f9f72d4bcfcd6871e7b1c829d1c3f3341f1 WatchSource:0}: Error finding container 4ebaf8192d513ca1ea9e3321a8c89f9f72d4bcfcd6871e7b1c829d1c3f3341f1: Status 404 returned error can't find the container with id 4ebaf8192d513ca1ea9e3321a8c89f9f72d4bcfcd6871e7b1c829d1c3f3341f1
Oct 30 23:52:08.058431 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:08.058407    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"]
Oct 30 23:52:08.061498 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:08.061464    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:52:08.061613 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:08.061532    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:52:08.061613 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:08.061562    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:52:08.128132 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:08.128101    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:08.651644 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:08.651605    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7" event={"ID":"b4f6ed81-049f-42b9-8b90-244d5598728b","Type":"ContainerStarted","Data":"2b2770832170a0f8179584aa16024d601bd1c90e3c61e80bc582600fa12e2e76"}
Oct 30 23:52:08.652045 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:08.651670    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7" event={"ID":"b4f6ed81-049f-42b9-8b90-244d5598728b","Type":"ContainerStarted","Data":"4ebaf8192d513ca1ea9e3321a8c89f9f72d4bcfcd6871e7b1c829d1c3f3341f1"}
Oct 30 23:52:08.678443 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:08.678378    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7" podStartSLOduration=1.678359634 podStartE2EDuration="1.678359634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:52:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:52:08.67544955 +0000 UTC m=+1987.920305319" watchObservedRunningTime="2026-10-30 23:52:08.678359634 +0000 UTC m=+1987.923215403"
Oct 30 23:52:08.744504 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:08.744464    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:08.922148 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:08.922075    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:09.743149 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:09.743113    4921 patch_prober.go:29] interesting pod/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused" start-of-body=
Oct 30 23:52:09.743779 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:09.743163    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7" podUID="b4f6ed81-049f-42b9-8b90-244d5598728b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused"
Oct 30 23:52:09.744119 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:09.744081    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:10.599625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:10.599104    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:10.742219 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:10.742185    4921 patch_prober.go:29] interesting pod/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused" start-of-body=
Oct 30 23:52:10.742405 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:10.742237    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7" podUID="b4f6ed81-049f-42b9-8b90-244d5598728b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused"
Oct 30 23:52:11.374616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:11.366829    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:11.546619 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:52:11.537943    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:52:11.742212 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:11.742179    4921 patch_prober.go:29] interesting pod/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused" start-of-body=
Oct 30 23:52:11.742397 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:11.742249    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7" podUID="b4f6ed81-049f-42b9-8b90-244d5598728b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused"
Oct 30 23:52:12.235870 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:12.235833    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:12.741390 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:12.741359    4921 patch_prober.go:29] interesting pod/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused" start-of-body=
Oct 30 23:52:12.741815 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:12.741416    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7" podUID="b4f6ed81-049f-42b9-8b90-244d5598728b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused"
Oct 30 23:52:13.141358 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:13.141324    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:13.742171 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:13.742138    4921 patch_prober.go:29] interesting pod/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused" start-of-body=
Oct 30 23:52:13.742566 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:13.742197    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7" podUID="b4f6ed81-049f-42b9-8b90-244d5598728b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused"
Oct 30 23:52:14.008821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:14.008720    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:14.747072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:14.747040    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:14.747516 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:14.747408    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:14.748156 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:14.748137    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:52:14.860196 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:14.860159    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:15.726788 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:15.726752    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:16.519381 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:16.519334    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:17.252220 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:17.252185    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:17.757046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:17.757012    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:18.017713 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:18.017576    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:18.714867 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:18.714834    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:19.944836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:19.944762    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:20.789971 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:20.789931    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:21.575988 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:21.564157    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:22.286977 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:22.286948    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:22.751679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:22.751636    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:23.118431 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:23.118340    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:23.250629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:23.249329    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:23.722952 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:23.722210    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:24.504921 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:24.504885    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:24.654912 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:24.654878    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:25.363295 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:25.363255    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:26.222646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:26.222604    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:27.137318 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:27.137282    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:27.864486 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:27.864421    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:27.994288 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:27.994263    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:28.133995 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:28.130730    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:28.963616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:28.958242    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:29.117713 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:29.117676    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:29.165665 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:29.165636    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf"]
Oct 30 23:52:29.171569 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:29.171546    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf"
Oct 30 23:52:29.178435 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:29.178409    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-df3b5f\""
Oct 30 23:52:29.203071 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:29.203035    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf"]
Oct 30 23:52:29.254563 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:29.254451    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:29.268657 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:29.268621    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf\" (UID: \"2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9\") " pod="openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf"
Oct 30 23:52:29.268839 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:29.268703    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n6vj\" (UniqueName: \"kubernetes.io/projected/2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9-kube-api-access-6n6vj\") pod \"payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf\" (UID: \"2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9\") " pod="openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf"
Oct 30 23:52:29.408222 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:29.408167    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf\" (UID: \"2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9\") " pod="openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf"
Oct 30 23:52:29.439755 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:29.439718    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n6vj\" (UniqueName: \"kubernetes.io/projected/2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9-kube-api-access-6n6vj\") pod \"payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf\" (UID: \"2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9\") " pod="openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf"
Oct 30 23:52:29.440555 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:29.421528    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf\" (UID: \"2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9\") " pod="openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf"
Oct 30 23:52:29.495400 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:29.495364    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n6vj\" (UniqueName: \"kubernetes.io/projected/2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9-kube-api-access-6n6vj\") pod \"payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf\" (UID: \"2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9\") " pod="openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf"
Oct 30 23:52:29.509054 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:29.504382    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf"
Oct 30 23:52:29.956317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:29.956281    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf"]
Oct 30 23:52:29.956641 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:52:29.956572    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b29f8f6_6c33_4f0b_8e66_cb742ba79ea9.slice/crio-abc61217212bc0a4765887d7a2b4a852639886efff817c04132620b1551b6942 WatchSource:0}: Error finding container abc61217212bc0a4765887d7a2b4a852639886efff817c04132620b1551b6942: Status 404 returned error can't find the container with id abc61217212bc0a4765887d7a2b4a852639886efff817c04132620b1551b6942
Oct 30 23:52:30.023350 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:30.023323    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:30.152617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:30.146350    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf" event={"ID":"2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9","Type":"ContainerStarted","Data":"abc61217212bc0a4765887d7a2b4a852639886efff817c04132620b1551b6942"}
Oct 30 23:52:31.125637 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:31.121701    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:31.183686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:31.183609    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf" event={"ID":"2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9","Type":"ContainerStarted","Data":"20519ac7ee1754b8a3c1342bb3c0a597d31b26f46473ee97c567e0ddbac8268d"}
Oct 30 23:52:31.184122 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:31.184097    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf"
Oct 30 23:52:31.215062 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:31.215011    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf" podStartSLOduration=2.214994676 podStartE2EDuration="2.214994676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:52:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:52:31.212548324 +0000 UTC m=+2010.457404103" watchObservedRunningTime="2026-10-30 23:52:31.214994676 +0000 UTC m=+2010.459850443"
Oct 30 23:52:31.961530 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:31.961487    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:32.614322 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:32.614294    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:33.407290 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:33.407261    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:34.090409 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:34.090374    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:34.799539 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:34.799505    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:35.793616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:35.788640    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:36.674619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:36.673286    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:38.400619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:38.396244    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:39.389572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:39.387550    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:40.234013 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:40.233971    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:41.406097 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:52:41.406056    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:52:42.193811 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:42.193775    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf"
Oct 30 23:52:48.353715 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:48.353669    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:49.037658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:49.037584    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:49.851642 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:49.851586    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:50.527999 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:50.527968    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:51.338452 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:51.338416    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:53.690797 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:53.690763    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:54.023231 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:54.023147    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:52:59.749324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:52:59.749291    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:02.728031 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:02.727979    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:03.194326 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:03.194283    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:03.355617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:03.352279    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:05.200914 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:05.200880    4921 scope.go:122] "RemoveContainer" containerID="d1cc7e1a024e192e1b2bb692845d3ef6dbd4ed493d852740d0b6b06eebe7b078"
Oct 30 23:53:10.321779 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:10.321735    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:11.028477 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:11.028435    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:11.405943 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:53:11.405900    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:53:11.854680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:11.853642    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:12.683957 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:12.683918    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:12.847649 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:12.830251    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:13.619750 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:13.619719    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:14.435204 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:14.435173    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:15.119108 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:15.119071    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:15.920953 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:15.920908    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:16.652874 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:16.652835    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:17.429178 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:17.429144    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:18.098052 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:18.098021    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:18.892071 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:18.892037    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:19.584948 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:19.584915    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:20.376633 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:20.376560    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:21.148893 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:21.148859    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:21.835995 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:21.835954    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:22.519663 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:22.519630    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:23.254668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:23.254630    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:24.018761 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:24.018731    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:24.722713 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:24.722677    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:25.543907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:25.543854    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:26.230963 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:26.230926    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:26.949195 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:26.949158    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:27.681002 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:27.680949    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:28.342619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:28.342081    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:28.772508 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:28.769538    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:29.914862 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:29.913955    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:30.090620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:30.084078    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:30.258283 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:30.258198    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:31.010293 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:31.010255    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:31.228617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:31.228102    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:31.419952 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:31.419919    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:31.715471 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:31.715381    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:32.027447 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:32.027374    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:32.167615 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:32.167554    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:32.879363 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:32.879332    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:33.089899 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:33.089868    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:33.849600 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:33.849564    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:34.646979 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:34.643796    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:35.218273 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:35.218241    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:35.382618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:35.382165    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:35.745184 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:35.745150    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:36.059923 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:36.059830    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:36.816842 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:36.816810    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:37.520937 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:37.520902    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:38.292470 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:38.292433    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:38.990672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:38.990639    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:39.922280 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:39.922173    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:40.540330 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:40.540294    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:41.207719 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:41.207684    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:41.406326 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:53:41.406290    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:53:41.924032 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:41.923999    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:42.695834 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:42.695714    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:43.362455 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:43.362400    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:44.055138 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:44.055102    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:44.770251 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:44.770215    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:45.416626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:45.416577    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:46.694865 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:46.694830    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:46.923995 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:46.923967    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:47.711108 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:47.711072    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:48.445198 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:48.445165    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:49.223436 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:49.223403    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:49.888957 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:49.888906    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:50.770325 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:50.770244    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:51.616566 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:51.616536    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:52.324462 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:52.324423    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:53.050638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:53.050571    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:53.759452 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:53.759415    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:53.886066 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:53.886033    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:54.453972 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:54.453931    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:55.145788 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:55.145753    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:55.925616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:55.923333    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:56.628618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:56.625402    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:57.235553 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:57.235519    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:58.021724 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:58.021675    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:58.821663 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:58.821564    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:53:59.698623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:53:59.682201    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:00.406310 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:00.406279    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:01.116479 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:01.116449    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:01.836220 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:01.836176    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:01.985643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:01.985573    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 30 23:54:02.004533 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:02.004506    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 30 23:54:02.667172 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:02.667044    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:03.302946 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:03.302912    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:04.124631 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:04.117624    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:04.735004 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:04.734970    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:05.470177 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:05.470135    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:06.140087 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:06.140049    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:07.016117 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:07.016082    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:07.712984 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:07.712951    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:08.443587 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:08.443535    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:09.125140 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:09.125110    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:09.840926 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:09.840888    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:10.645475 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:10.645441    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:11.407755 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:54:11.407721    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:54:11.457617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:11.442416    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:12.083305 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:12.083264    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:12.741297 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:12.741258    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:13.469028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:13.468993    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:14.445352 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:14.445313    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:15.289754 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:15.289715    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:16.048805 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:16.048757    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:16.224331 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:16.224292    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:16.763666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:16.763538    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:16.934698 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:16.934642    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:17.563504 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:17.563471    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:18.446568 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:18.446539    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:18.591923 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:18.591890    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:18.739618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:18.739133    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:18.876515 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:18.876485    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:20.036485 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:20.036444    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:21.011471 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:21.011385    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:22.041087 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:22.041057    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:23.294617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:23.290482    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:24.568587 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:24.568554    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:25.888321 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:25.888287    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:26.919618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:26.913160    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:28.008296 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:28.008251    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:29.023668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:29.023629    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:30.190300 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:30.190260    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:30.374473 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:30.374441    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:31.146633 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:31.146574    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:31.953273 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:31.953232    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:32.735220 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:32.735184    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:33.418259 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:33.418218    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:34.211897 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:34.211861    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:35.398829 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:35.398789    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:36.216858 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:36.216821    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:37.055820 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:37.055787    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:37.884125 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:37.870007    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:38.571620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:38.563837    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:39.279635 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:39.267666    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:40.021391 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:40.021359    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:40.871730 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:40.871701    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:41.406823 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:54:41.406785    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:54:41.913619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:41.910059    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:42.847474 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:42.847434    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:43.590559 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:43.590526    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:44.330936 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:44.329717    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:44.505356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:44.505317    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:45.087078 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:45.087034    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:45.937556 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:45.937521    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:46.614611 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:46.614568    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:47.358359 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:47.358311    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:48.043611 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:48.043551    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:48.753003 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:48.744304    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:49.396168 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:49.396134    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:50.324926 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:50.324893    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:51.132794 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:51.132761    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:51.930951 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:51.930916    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:52.668364 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:52.668328    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:53.426958 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:53.426922    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:53.803584 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:53.803474    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:54.116945 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:54.116869    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:54.215040 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:54.215002    4921 ???:1] "http: TLS handshake error from 10.0.137.81:43403: EOF"
Oct 30 23:54:54.838559 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:54.838513    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:55.537827 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:55.537797    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:56.234325 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:56.234279    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:56.971295 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:56.971264    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:57.827307 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:57.827274    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:58.561878 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:58.561840    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:54:59.775717 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:54:59.775641    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:00.532246 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:00.532214    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:01.250678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:01.250645    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:02.038217 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:02.038181    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:02.764625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:02.761351    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:03.443022 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:03.442990    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:04.139411 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:04.139295    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:04.923192 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:04.923142    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:05.750486 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:05.750445    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:06.435696 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:06.435665    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:07.122749 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:07.122689    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:07.968620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:07.964032    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:08.624989 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:08.624952    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:09.346616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:09.344661    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:10.140169 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:10.140135    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:10.915930 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:10.915895    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:11.407051 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:55:11.407014    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:55:11.665183 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:11.665087    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:12.451746 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:12.451709    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:13.156367 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:13.156334    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:13.938652 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:13.938616    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:14.753398 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:14.753366    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:14.928081 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:14.928033    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:15.521565 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:15.521530    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:16.268869 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:16.268786    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:17.125408 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:17.125365    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:17.831245 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:17.831211    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:18.494680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:18.494576    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:19.382478 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:19.382425    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:20.196231 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:20.196190    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:20.921923 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:20.921871    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:21.641818 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:21.641785    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:22.325220 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:22.325176    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:23.037915 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:23.037881    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:23.756680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:23.756649    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:24.426100 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:24.426065    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:25.198788 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:25.198757    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:25.947025 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:25.946996    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:26.745067 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:26.744993    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:27.602104 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:27.602037    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:28.565157 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:28.565120    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:29.467651 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:29.463801    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:30.400533 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:30.400487    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:31.139399 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:31.139331    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:31.943851 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:31.943809    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:32.704624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:32.698885    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:33.467632 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:33.465552    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:34.333050 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:34.333020    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:34.623524 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:34.623295    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:34.771373 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:34.771341    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:35.039740 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:35.039703    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:35.754202 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:35.754172    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:36.563793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:36.563755    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:37.348028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:37.347958    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:37.557359 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:37.550362    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k"]
Oct 30 23:55:37.643407 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:37.643379    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:37.932247 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:37.932155    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:38.590614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:38.590511    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:39.355708 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:39.355656    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:40.030319 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:40.030286    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:40.867972 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:40.867932    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:41.406795 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:55:41.406755    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:55:41.593097 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:41.593012    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:42.375309 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:42.369226    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:42.551125 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:42.551091    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k" podUID="ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991" containerName="payload-pre-processing" containerID="cri-o://3bc3aea6313f94f646417a5d8852d7a0ae237710d2c3c9e9f7d482c198a6af0f" gracePeriod=25
Oct 30 23:55:42.861857 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:42.861831    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k"
Oct 30 23:55:42.922742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:42.922663    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991-kube-api-access-k959j\" (UniqueName: \"kubernetes.io/projected/ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991-kube-api-access-k959j\") pod \"ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991\" (UID: \"ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991\") "
Oct 30 23:55:42.922742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:42.922733    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991-plugins-config-volume\") pod \"ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991\" (UID: \"ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991\") "
Oct 30 23:55:42.923229 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:42.923198    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991-plugins-config-volume" pod "ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991" (UID: "ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:55:42.923721 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:42.923698    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:55:42.925208 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:42.925179    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991-kube-api-access-k959j" pod "ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991" (UID: "ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991"). InnerVolumeSpecName "kube-api-access-k959j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:55:43.024904 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:43.024871    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k959j\" (UniqueName: \"kubernetes.io/projected/ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991-kube-api-access-k959j\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:55:43.040363 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:43.040331    4921 generic.go:356] "Generic (PLEG): container finished" podID="ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991" containerID="3bc3aea6313f94f646417a5d8852d7a0ae237710d2c3c9e9f7d482c198a6af0f" exitCode=0
Oct 30 23:55:43.040363 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:43.040367    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k"
Oct 30 23:55:43.040564 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:43.040401    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k" event={"ID":"ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991","Type":"ContainerDied","Data":"3bc3aea6313f94f646417a5d8852d7a0ae237710d2c3c9e9f7d482c198a6af0f"}
Oct 30 23:55:43.040564 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:43.040457    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k" event={"ID":"ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991","Type":"ContainerDied","Data":"9209ccd908d70f1a82a293b16fe08c53adcbf7d5bc6e1848c91d69440d994c46"}
Oct 30 23:55:43.040564 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:43.040479    4921 scope.go:122] "RemoveContainer" containerID="3bc3aea6313f94f646417a5d8852d7a0ae237710d2c3c9e9f7d482c198a6af0f"
Oct 30 23:55:43.056813 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:43.054286    4921 scope.go:122] "RemoveContainer" containerID="3bc3aea6313f94f646417a5d8852d7a0ae237710d2c3c9e9f7d482c198a6af0f"
Oct 30 23:55:43.056813 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:55:43.054654    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bc3aea6313f94f646417a5d8852d7a0ae237710d2c3c9e9f7d482c198a6af0f\": container with ID starting with 3bc3aea6313f94f646417a5d8852d7a0ae237710d2c3c9e9f7d482c198a6af0f not found: ID does not exist" containerID="3bc3aea6313f94f646417a5d8852d7a0ae237710d2c3c9e9f7d482c198a6af0f"
Oct 30 23:55:43.060778 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:43.060738    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bc3aea6313f94f646417a5d8852d7a0ae237710d2c3c9e9f7d482c198a6af0f"} err="failed to get container status \"3bc3aea6313f94f646417a5d8852d7a0ae237710d2c3c9e9f7d482c198a6af0f\": rpc error: code = NotFound desc = could not find container \"3bc3aea6313f94f646417a5d8852d7a0ae237710d2c3c9e9f7d482c198a6af0f\": container with ID starting with 3bc3aea6313f94f646417a5d8852d7a0ae237710d2c3c9e9f7d482c198a6af0f not found: ID does not exist"
Oct 30 23:55:43.086566 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:43.086534    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k"]
Oct 30 23:55:43.093644 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:55:43.093577    4921 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded8f4e4a_46eb_4ab2_a0b7_5117b48c3991.slice\": RecentStats: unable to find data in memory cache]"
Oct 30 23:55:43.154569 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:43.154534    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:43.210663 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:43.209260    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-2b4009-74d999f67-slq9k"]
Oct 30 23:55:43.826079 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:43.826046    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:44.719622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:44.710070    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:44.887941 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:44.887906    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991" path="/var/lib/kubelet/pods/ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991/volumes"
Oct 30 23:55:45.758775 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:45.752224    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:46.533079 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:46.533049    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:47.480060 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:47.475228    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:48.309620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:48.303015    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:49.080627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:49.068184    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:49.842673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:49.842640    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:50.516998 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:50.516955    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:51.294618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:51.292574    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:51.820849 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:51.820817    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"]
Oct 30 23:55:51.821110 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:51.821076    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx" podUID="d12b276e-860a-4410-a41b-18c5996d398a" containerName="maas-api" containerID="cri-o://2e89049b48f96a9fe6716788fe00dbb2f45b86e7db0f149cda222600b84a45e2" gracePeriod=30
Oct 30 23:55:51.902933 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:51.902894    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:52.086791 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.080631    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:52.414258 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.406612    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:52.554837 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.554806    4921 generic.go:356] "Generic (PLEG): container finished" podID="d12b276e-860a-4410-a41b-18c5996d398a" containerID="2e89049b48f96a9fe6716788fe00dbb2f45b86e7db0f149cda222600b84a45e2" exitCode=0
Oct 30 23:55:52.555383 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.555336    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx" event={"ID":"d12b276e-860a-4410-a41b-18c5996d398a","Type":"ContainerDied","Data":"2e89049b48f96a9fe6716788fe00dbb2f45b86e7db0f149cda222600b84a45e2"}
Oct 30 23:55:52.557036 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.557011    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:52.633613 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.614449    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"
Oct 30 23:55:52.737673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.735681    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"]
Oct 30 23:55:52.747907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.740066    4921 cpu_manager.go:414] "containerMap: removing container" podUID="ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991" containerName="payload-pre-processing"
Oct 30 23:55:52.747907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.740094    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991" containerName="payload-pre-processing"
Oct 30 23:55:52.747907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.740124    4921 cpu_manager.go:414] "containerMap: removing container" podUID="d12b276e-860a-4410-a41b-18c5996d398a" containerName="maas-api"
Oct 30 23:55:52.747907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.740131    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d12b276e-860a-4410-a41b-18c5996d398a" containerName="maas-api"
Oct 30 23:55:52.747907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.740379    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="ed8f4e4a-46eb-4ab2-a0b7-5117b48c3991" containerName="payload-pre-processing"
Oct 30 23:55:52.747907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.740394    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="d12b276e-860a-4410-a41b-18c5996d398a" containerName="maas-api"
Oct 30 23:55:52.761281 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.761244    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d12b276e-860a-4410-a41b-18c5996d398a-kube-api-access-rxw7h\" (UniqueName: \"kubernetes.io/projected/d12b276e-860a-4410-a41b-18c5996d398a-kube-api-access-rxw7h\") pod \"d12b276e-860a-4410-a41b-18c5996d398a\" (UID: \"d12b276e-860a-4410-a41b-18c5996d398a\") "
Oct 30 23:55:52.761462 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.761341    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d12b276e-860a-4410-a41b-18c5996d398a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d12b276e-860a-4410-a41b-18c5996d398a-maas-api-tls\") pod \"d12b276e-860a-4410-a41b-18c5996d398a\" (UID: \"d12b276e-860a-4410-a41b-18c5996d398a\") "
Oct 30 23:55:52.761462 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.761385    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d12b276e-860a-4410-a41b-18c5996d398a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d12b276e-860a-4410-a41b-18c5996d398a-openshift-service-ca\") pod \"d12b276e-860a-4410-a41b-18c5996d398a\" (UID: \"d12b276e-860a-4410-a41b-18c5996d398a\") "
Oct 30 23:55:52.761570 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.761548    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d12b276e-860a-4410-a41b-18c5996d398a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d12b276e-860a-4410-a41b-18c5996d398a-metrics-certs\") pod \"d12b276e-860a-4410-a41b-18c5996d398a\" (UID: \"d12b276e-860a-4410-a41b-18c5996d398a\") "
Oct 30 23:55:52.763674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.763646    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d12b276e-860a-4410-a41b-18c5996d398a-openshift-service-ca" pod "d12b276e-860a-4410-a41b-18c5996d398a" (UID: "d12b276e-860a-4410-a41b-18c5996d398a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:55:52.772137 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.772073    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.773869 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.773848    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"]
Oct 30 23:55:52.781667 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.781638    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-6b38a4-openshift-default-dockercfg-rvxph\""
Oct 30 23:55:52.784711 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.784477    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d12b276e-860a-4410-a41b-18c5996d398a-kube-api-access-rxw7h" pod "d12b276e-860a-4410-a41b-18c5996d398a" (UID: "d12b276e-860a-4410-a41b-18c5996d398a"). InnerVolumeSpecName "kube-api-access-rxw7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:55:52.793009 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.792424    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d12b276e-860a-4410-a41b-18c5996d398a-metrics-certs" pod "d12b276e-860a-4410-a41b-18c5996d398a" (UID: "d12b276e-860a-4410-a41b-18c5996d398a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:55:52.794333 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.794308    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d12b276e-860a-4410-a41b-18c5996d398a-maas-api-tls" pod "d12b276e-860a-4410-a41b-18c5996d398a" (UID: "d12b276e-860a-4410-a41b-18c5996d398a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:55:52.864332 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.864300    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-data\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.864482 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.864438    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-envoy\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.864535 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.864501    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-credential-socket\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.864607 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.864581    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-podinfo\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.864664 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.864649    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnr8m\" (UniqueName: \"kubernetes.io/projected/62106426-3aa0-4918-b5db-ab1a0a70d1e5-kube-api-access-nnr8m\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.864709 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.864676    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-token\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.864709 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.864700    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-workload-socket\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.864908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.864884    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-workload-certs\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.864989 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.864973    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istiod-ca-cert\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.865145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.865127    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxw7h\" (UniqueName: \"kubernetes.io/projected/d12b276e-860a-4410-a41b-18c5996d398a-kube-api-access-rxw7h\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:55:52.865195 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.865150    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d12b276e-860a-4410-a41b-18c5996d398a-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:55:52.865195 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.865161    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d12b276e-860a-4410-a41b-18c5996d398a-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:55:52.865195 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.865170    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d12b276e-860a-4410-a41b-18c5996d398a-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:55:52.966061 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.966028    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-data\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.966263 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.966127    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-envoy\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.966263 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.966188    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-credential-socket\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.966263 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.966247    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-podinfo\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.966453 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.966273    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnr8m\" (UniqueName: \"kubernetes.io/projected/62106426-3aa0-4918-b5db-ab1a0a70d1e5-kube-api-access-nnr8m\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.966453 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.966301    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-token\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.966453 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.966338    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-workload-socket\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.966655 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.966493    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-data\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.966655 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.966580    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-credential-socket\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.966779 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.966674    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-workload-certs\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.966843 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.966775    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istiod-ca-cert\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.967055 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.967005    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-workload-socket\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.967165 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.967128    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-workload-certs\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.967522 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.967497    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istiod-ca-cert\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.969313 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.969287    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-envoy\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.969668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.969640    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-podinfo\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.982141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.982111    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-token\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:52.983316 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:52.983290    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnr8m\" (UniqueName: \"kubernetes.io/projected/62106426-3aa0-4918-b5db-ab1a0a70d1e5-kube-api-access-nnr8m\") pod \"e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") " pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:53.009361 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:53.009253    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:53.135252 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:53.135216    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:53.599647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:53.588827    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx" event={"ID":"d12b276e-860a-4410-a41b-18c5996d398a","Type":"ContainerDied","Data":"7916b571e092064b4921a62483c56192bfbd55cacb012563be37839f8c815414"}
Oct 30 23:55:53.599647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:53.588906    4921 scope.go:122] "RemoveContainer" containerID="2e89049b48f96a9fe6716788fe00dbb2f45b86e7db0f149cda222600b84a45e2"
Oct 30 23:55:53.599647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:53.589088    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"
Oct 30 23:55:53.649188 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:53.649155    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"]
Oct 30 23:55:53.654348 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:53.654305    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2b4009-bf8966647-whwmx"]
Oct 30 23:55:53.658090 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:55:53.658047    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62106426_3aa0_4918_b5db_ab1a0a70d1e5.slice/crio-d96978bd72be2aa86647a86231d681f2509c219ec5f76ec345647b3988127d19 WatchSource:0}: Error finding container d96978bd72be2aa86647a86231d681f2509c219ec5f76ec345647b3988127d19: Status 404 returned error can't find the container with id d96978bd72be2aa86647a86231d681f2509c219ec5f76ec345647b3988127d19
Oct 30 23:55:53.659380 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:53.659349    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"]
Oct 30 23:55:53.661381 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:53.661344    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:55:53.661505 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:53.661428    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:55:53.661505 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:53.661476    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:55:53.887046 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:53.887012    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:54.040557 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:54.040514    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:54.599883 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:54.599850    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd" event={"ID":"62106426-3aa0-4918-b5db-ab1a0a70d1e5","Type":"ContainerStarted","Data":"f64bb7c0a9df2391acc1f595476c8045327c17ee0c2437cd3c90c5b98e573135"}
Oct 30 23:55:54.600261 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:54.599900    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd" event={"ID":"62106426-3aa0-4918-b5db-ab1a0a70d1e5","Type":"ContainerStarted","Data":"d96978bd72be2aa86647a86231d681f2509c219ec5f76ec345647b3988127d19"}
Oct 30 23:55:54.640317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:54.640257    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd" podStartSLOduration=171.640237463 podStartE2EDuration="2m51.640237463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:53:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:55:54.633029554 +0000 UTC m=+2213.877885342" watchObservedRunningTime="2026-10-30 23:55:54.640237463 +0000 UTC m=+2213.885093232"
Oct 30 23:55:54.862463 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:54.862371    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc"]
Oct 30 23:55:54.871985 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:54.871927    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79"]
Oct 30 23:55:54.914493 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:54.914461    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d12b276e-860a-4410-a41b-18c5996d398a" path="/var/lib/kubelet/pods/d12b276e-860a-4410-a41b-18c5996d398a/volumes"
Oct 30 23:55:55.005817 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:55.005779    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:55.136139 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:55.136113    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:55.142037 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:55.142011    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:55.205310 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:55.198642    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:55.385624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:55.383512    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:55.616754 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:55.614683    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:55.626612 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:55.626571    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:55:56.379995 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:56.379951    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:57.213663 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:57.213633    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:57.389369 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:57.389335    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:57.606298 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:57.605202    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:58.443301 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:58.443268    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:58.486844 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:58.486809    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn"]
Oct 30 23:55:58.493515 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:58.493484    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn"
Oct 30 23:55:58.499659 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:58.498676    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-6b38a4-dockercfg-cb5m6\""
Oct 30 23:55:58.518896 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:58.518864    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn"]
Oct 30 23:55:58.595911 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:58.595870    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-6b38a4\""
Oct 30 23:55:58.620371 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:58.620336    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pn2z\" (UniqueName: \"kubernetes.io/projected/55ce736b-a050-4941-a887-7d9a6229427f-kube-api-access-5pn2z\") pod \"payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn\" (UID: \"55ce736b-a050-4941-a887-7d9a6229427f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn"
Oct 30 23:55:58.620575 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:58.620553    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55ce736b-a050-4941-a887-7d9a6229427f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn\" (UID: \"55ce736b-a050-4941-a887-7d9a6229427f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn"
Oct 30 23:55:58.664758 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:58.664724    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:58.739276 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:58.722375    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pn2z\" (UniqueName: \"kubernetes.io/projected/55ce736b-a050-4941-a887-7d9a6229427f-kube-api-access-5pn2z\") pod \"payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn\" (UID: \"55ce736b-a050-4941-a887-7d9a6229427f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn"
Oct 30 23:55:58.739276 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:58.722614    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55ce736b-a050-4941-a887-7d9a6229427f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn\" (UID: \"55ce736b-a050-4941-a887-7d9a6229427f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn"
Oct 30 23:55:58.767617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:58.756784    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55ce736b-a050-4941-a887-7d9a6229427f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn\" (UID: \"55ce736b-a050-4941-a887-7d9a6229427f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn"
Oct 30 23:55:58.771619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:58.771491    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pn2z\" (UniqueName: \"kubernetes.io/projected/55ce736b-a050-4941-a887-7d9a6229427f-kube-api-access-5pn2z\") pod \"payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn\" (UID: \"55ce736b-a050-4941-a887-7d9a6229427f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn"
Oct 30 23:55:58.828619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:58.816058    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn"
Oct 30 23:55:58.878647 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:58.872250    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:59.360207 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:59.360129    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:59.437512 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:59.437483    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn"]
Oct 30 23:55:59.438007 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:55:59.437982    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55ce736b_a050_4941_a887_7d9a6229427f.slice/crio-9d762ee66d73f88666637e67810e2d5a41b53dfd4447a72cbb302a626b8c7a4e WatchSource:0}: Error finding container 9d762ee66d73f88666637e67810e2d5a41b53dfd4447a72cbb302a626b8c7a4e: Status 404 returned error can't find the container with id 9d762ee66d73f88666637e67810e2d5a41b53dfd4447a72cbb302a626b8c7a4e
Oct 30 23:55:59.536411 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:59.536386    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:55:59.649627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:59.649557    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn" event={"ID":"55ce736b-a050-4941-a887-7d9a6229427f","Type":"ContainerStarted","Data":"0c3bd7f269e14f555a877cd8a8961f8120d3a622eddc63b1424dae8e20dcec64"}
Oct 30 23:55:59.649820 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:59.649672    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn" event={"ID":"55ce736b-a050-4941-a887-7d9a6229427f","Type":"ContainerStarted","Data":"9d762ee66d73f88666637e67810e2d5a41b53dfd4447a72cbb302a626b8c7a4e"}
Oct 30 23:55:59.649820 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:59.649710    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn"
Oct 30 23:55:59.681508 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:59.681449    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn" podStartSLOduration=1.681435536 podStartE2EDuration="1.681435536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:55:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:55:59.677347233 +0000 UTC m=+2218.922203021" watchObservedRunningTime="2026-10-30 23:55:59.681435536 +0000 UTC m=+2218.926291303"
Oct 30 23:55:59.865205 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:59.863715    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc" podUID="35d53e14-1486-48ec-96f3-7a51d4113174" containerName="payload-processing" containerID="cri-o://6d694c320a56e6248339416cb93d351ec993dcc81e16804e5db97d340788865c" gracePeriod=25
Oct 30 23:55:59.872741 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:55:59.872674    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79" podUID="2d48a824-865d-447c-8b1c-64cc99b41dca" containerName="payload-pre-processing" containerID="cri-o://feb2a29fd2722a38bfd96607b385f8db9d974413e47cf52e0fe198f74b68be11" gracePeriod=25
Oct 30 23:56:00.242624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.236521    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:00.318692 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.318572    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc"
Oct 30 23:56:00.336921 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.336892    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79"
Oct 30 23:56:00.455119 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.455084    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d48a824-865d-447c-8b1c-64cc99b41dca-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d48a824-865d-447c-8b1c-64cc99b41dca-plugins-config-volume\") pod \"2d48a824-865d-447c-8b1c-64cc99b41dca\" (UID: \"2d48a824-865d-447c-8b1c-64cc99b41dca\") "
Oct 30 23:56:00.455330 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.455280    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d48a824-865d-447c-8b1c-64cc99b41dca-kube-api-access-gqc84\" (UniqueName: \"kubernetes.io/projected/2d48a824-865d-447c-8b1c-64cc99b41dca-kube-api-access-gqc84\") pod \"2d48a824-865d-447c-8b1c-64cc99b41dca\" (UID: \"2d48a824-865d-447c-8b1c-64cc99b41dca\") "
Oct 30 23:56:00.455451 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.455433    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/35d53e14-1486-48ec-96f3-7a51d4113174-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35d53e14-1486-48ec-96f3-7a51d4113174-plugins-config-volume\") pod \"35d53e14-1486-48ec-96f3-7a51d4113174\" (UID: \"35d53e14-1486-48ec-96f3-7a51d4113174\") "
Oct 30 23:56:00.455587 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.455541    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/35d53e14-1486-48ec-96f3-7a51d4113174-kube-api-access-2g7n7\" (UniqueName: \"kubernetes.io/projected/35d53e14-1486-48ec-96f3-7a51d4113174-kube-api-access-2g7n7\") pod \"35d53e14-1486-48ec-96f3-7a51d4113174\" (UID: \"35d53e14-1486-48ec-96f3-7a51d4113174\") "
Oct 30 23:56:00.456039 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.456013    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d48a824-865d-447c-8b1c-64cc99b41dca-plugins-config-volume" pod "2d48a824-865d-447c-8b1c-64cc99b41dca" (UID: "2d48a824-865d-447c-8b1c-64cc99b41dca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:56:00.456341 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.456279    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35d53e14-1486-48ec-96f3-7a51d4113174-plugins-config-volume" pod "35d53e14-1486-48ec-96f3-7a51d4113174" (UID: "35d53e14-1486-48ec-96f3-7a51d4113174"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:56:00.456691 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.456671    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d48a824-865d-447c-8b1c-64cc99b41dca-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:56:00.456852 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.456838    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35d53e14-1486-48ec-96f3-7a51d4113174-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:56:00.458666 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.458645    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d48a824-865d-447c-8b1c-64cc99b41dca-kube-api-access-gqc84" pod "2d48a824-865d-447c-8b1c-64cc99b41dca" (UID: "2d48a824-865d-447c-8b1c-64cc99b41dca"). InnerVolumeSpecName "kube-api-access-gqc84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:56:00.458849 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.458812    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35d53e14-1486-48ec-96f3-7a51d4113174-kube-api-access-2g7n7" pod "35d53e14-1486-48ec-96f3-7a51d4113174" (UID: "35d53e14-1486-48ec-96f3-7a51d4113174"). InnerVolumeSpecName "kube-api-access-2g7n7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:56:00.558614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.558503    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqc84\" (UniqueName: \"kubernetes.io/projected/2d48a824-865d-447c-8b1c-64cc99b41dca-kube-api-access-gqc84\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:56:00.558614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.558535    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2g7n7\" (UniqueName: \"kubernetes.io/projected/35d53e14-1486-48ec-96f3-7a51d4113174-kube-api-access-2g7n7\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:56:00.659317 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.659282    4921 generic.go:356] "Generic (PLEG): container finished" podID="35d53e14-1486-48ec-96f3-7a51d4113174" containerID="6d694c320a56e6248339416cb93d351ec993dcc81e16804e5db97d340788865c" exitCode=0
Oct 30 23:56:00.659491 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.659328    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc"
Oct 30 23:56:00.659491 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.659369    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc" event={"ID":"35d53e14-1486-48ec-96f3-7a51d4113174","Type":"ContainerDied","Data":"6d694c320a56e6248339416cb93d351ec993dcc81e16804e5db97d340788865c"}
Oct 30 23:56:00.659491 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.659421    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc" event={"ID":"35d53e14-1486-48ec-96f3-7a51d4113174","Type":"ContainerDied","Data":"fec4ac1bf30b5e9f4370dc12c15f21b8fa0f5e1f56ad492ba648b02aca862fcd"}
Oct 30 23:56:00.659491 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.659447    4921 scope.go:122] "RemoveContainer" containerID="6d694c320a56e6248339416cb93d351ec993dcc81e16804e5db97d340788865c"
Oct 30 23:56:00.661321 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.661299    4921 generic.go:356] "Generic (PLEG): container finished" podID="2d48a824-865d-447c-8b1c-64cc99b41dca" containerID="feb2a29fd2722a38bfd96607b385f8db9d974413e47cf52e0fe198f74b68be11" exitCode=0
Oct 30 23:56:00.661437 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.661416    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79"
Oct 30 23:56:00.661504 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.661443    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79" event={"ID":"2d48a824-865d-447c-8b1c-64cc99b41dca","Type":"ContainerDied","Data":"feb2a29fd2722a38bfd96607b385f8db9d974413e47cf52e0fe198f74b68be11"}
Oct 30 23:56:00.661504 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.661499    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79" event={"ID":"2d48a824-865d-447c-8b1c-64cc99b41dca","Type":"ContainerDied","Data":"2aa38d2c737e40ef556046bf33817329fcebb8d8f1f428428cf06fd1ed018a8b"}
Oct 30 23:56:00.673364 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.673348    4921 scope.go:122] "RemoveContainer" containerID="6d694c320a56e6248339416cb93d351ec993dcc81e16804e5db97d340788865c"
Oct 30 23:56:00.673678 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:56:00.673659    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d694c320a56e6248339416cb93d351ec993dcc81e16804e5db97d340788865c\": container with ID starting with 6d694c320a56e6248339416cb93d351ec993dcc81e16804e5db97d340788865c not found: ID does not exist" containerID="6d694c320a56e6248339416cb93d351ec993dcc81e16804e5db97d340788865c"
Oct 30 23:56:00.673742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.673686    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d694c320a56e6248339416cb93d351ec993dcc81e16804e5db97d340788865c"} err="failed to get container status \"6d694c320a56e6248339416cb93d351ec993dcc81e16804e5db97d340788865c\": rpc error: code = NotFound desc = could not find container \"6d694c320a56e6248339416cb93d351ec993dcc81e16804e5db97d340788865c\": container with ID starting with 6d694c320a56e6248339416cb93d351ec993dcc81e16804e5db97d340788865c not found: ID does not exist"
Oct 30 23:56:00.673742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.673705    4921 scope.go:122] "RemoveContainer" containerID="feb2a29fd2722a38bfd96607b385f8db9d974413e47cf52e0fe198f74b68be11"
Oct 30 23:56:00.684331 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.684300    4921 scope.go:122] "RemoveContainer" containerID="feb2a29fd2722a38bfd96607b385f8db9d974413e47cf52e0fe198f74b68be11"
Oct 30 23:56:00.684695 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:56:00.684635    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"feb2a29fd2722a38bfd96607b385f8db9d974413e47cf52e0fe198f74b68be11\": container with ID starting with feb2a29fd2722a38bfd96607b385f8db9d974413e47cf52e0fe198f74b68be11 not found: ID does not exist" containerID="feb2a29fd2722a38bfd96607b385f8db9d974413e47cf52e0fe198f74b68be11"
Oct 30 23:56:00.684695 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.684671    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feb2a29fd2722a38bfd96607b385f8db9d974413e47cf52e0fe198f74b68be11"} err="failed to get container status \"feb2a29fd2722a38bfd96607b385f8db9d974413e47cf52e0fe198f74b68be11\": rpc error: code = NotFound desc = could not find container \"feb2a29fd2722a38bfd96607b385f8db9d974413e47cf52e0fe198f74b68be11\": container with ID starting with feb2a29fd2722a38bfd96607b385f8db9d974413e47cf52e0fe198f74b68be11 not found: ID does not exist"
Oct 30 23:56:00.693981 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.693955    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc"]
Oct 30 23:56:00.699368 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.699348    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-f026c1-55c877f65-wsppc"]
Oct 30 23:56:00.722073 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.722053    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79"]
Oct 30 23:56:00.727487 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.727466    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-f026c1-6658578995-jqq79"]
Oct 30 23:56:00.886571 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.886545    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d48a824-865d-447c-8b1c-64cc99b41dca" path="/var/lib/kubelet/pods/2d48a824-865d-447c-8b1c-64cc99b41dca/volumes"
Oct 30 23:56:00.887075 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:00.887059    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="35d53e14-1486-48ec-96f3-7a51d4113174" path="/var/lib/kubelet/pods/35d53e14-1486-48ec-96f3-7a51d4113174/volumes"
Oct 30 23:56:01.341538 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:01.341463    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:01.549438 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:01.549408    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:02.414071 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:02.414041    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:03.118762 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:03.118725    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:03.921209 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:03.921169    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:04.862371 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:04.862335    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:05.669446 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:05.669403    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:06.349629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:06.348756    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:07.368620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:07.363184    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:08.325584 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:08.325537    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:09.573709 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:09.573675    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:10.376209 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:10.376173    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:10.665138 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:10.665108    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn"
Oct 30 23:56:10.939748 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:10.939668    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"]
Oct 30 23:56:10.939938 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:10.939913    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv" podUID="9e4866b3-8070-4de5-aaaa-053929c5dcae" containerName="maas-api" containerID="cri-o://6943719abcbf76c3bf7f48a6da1921f3b010e4bacc72ffcbc4ed9f7cf5f26fde" gracePeriod=30
Oct 30 23:56:11.024942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.024911    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:11.292663 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.288209    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:11.627551 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:56:11.627498    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:56:11.643109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.643075    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:11.666359 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.666328    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"
Oct 30 23:56:11.675781 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.675753    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e4866b3-8070-4de5-aaaa-053929c5dcae-kube-api-access-pv5hw\" (UniqueName: \"kubernetes.io/projected/9e4866b3-8070-4de5-aaaa-053929c5dcae-kube-api-access-pv5hw\") pod \"9e4866b3-8070-4de5-aaaa-053929c5dcae\" (UID: \"9e4866b3-8070-4de5-aaaa-053929c5dcae\") "
Oct 30 23:56:11.676026 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.676009    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9e4866b3-8070-4de5-aaaa-053929c5dcae-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e4866b3-8070-4de5-aaaa-053929c5dcae-openshift-service-ca\") pod \"9e4866b3-8070-4de5-aaaa-053929c5dcae\" (UID: \"9e4866b3-8070-4de5-aaaa-053929c5dcae\") "
Oct 30 23:56:11.676420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.676391    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e4866b3-8070-4de5-aaaa-053929c5dcae-openshift-service-ca" pod "9e4866b3-8070-4de5-aaaa-053929c5dcae" (UID: "9e4866b3-8070-4de5-aaaa-053929c5dcae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:56:11.676838 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.676807    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e4866b3-8070-4de5-aaaa-053929c5dcae-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:56:11.678095 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.678071    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e4866b3-8070-4de5-aaaa-053929c5dcae-kube-api-access-pv5hw" pod "9e4866b3-8070-4de5-aaaa-053929c5dcae" (UID: "9e4866b3-8070-4de5-aaaa-053929c5dcae"). InnerVolumeSpecName "kube-api-access-pv5hw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:56:11.709424 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.709388    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"]
Oct 30 23:56:11.710785 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.710762    4921 cpu_manager.go:414] "containerMap: removing container" podUID="9e4866b3-8070-4de5-aaaa-053929c5dcae" containerName="maas-api"
Oct 30 23:56:11.710785 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.710786    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e4866b3-8070-4de5-aaaa-053929c5dcae" containerName="maas-api"
Oct 30 23:56:11.711007 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.710828    4921 cpu_manager.go:414] "containerMap: removing container" podUID="35d53e14-1486-48ec-96f3-7a51d4113174" containerName="payload-processing"
Oct 30 23:56:11.711007 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.710838    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="35d53e14-1486-48ec-96f3-7a51d4113174" containerName="payload-processing"
Oct 30 23:56:11.711007 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.710855    4921 cpu_manager.go:414] "containerMap: removing container" podUID="2d48a824-865d-447c-8b1c-64cc99b41dca" containerName="payload-pre-processing"
Oct 30 23:56:11.711007 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.710863    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d48a824-865d-447c-8b1c-64cc99b41dca" containerName="payload-pre-processing"
Oct 30 23:56:11.712145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.711140    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e4866b3-8070-4de5-aaaa-053929c5dcae" containerName="maas-api"
Oct 30 23:56:11.712145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.711163    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="35d53e14-1486-48ec-96f3-7a51d4113174" containerName="payload-processing"
Oct 30 23:56:11.712145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.711173    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d48a824-865d-447c-8b1c-64cc99b41dca" containerName="payload-pre-processing"
Oct 30 23:56:11.716086 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.716067    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"
Oct 30 23:56:11.725258 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.725235    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-df3b5f-serving-cert\""
Oct 30 23:56:11.764450 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.764421    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"]
Oct 30 23:56:11.777411 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.777379    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e4866b3-8070-4de5-aaaa-053929c5dcae-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e4866b3-8070-4de5-aaaa-053929c5dcae-metrics-certs\") pod \"9e4866b3-8070-4de5-aaaa-053929c5dcae\" (UID: \"9e4866b3-8070-4de5-aaaa-053929c5dcae\") "
Oct 30 23:56:11.777714 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.777686    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e4866b3-8070-4de5-aaaa-053929c5dcae-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e4866b3-8070-4de5-aaaa-053929c5dcae-maas-api-tls\") pod \"9e4866b3-8070-4de5-aaaa-053929c5dcae\" (UID: \"9e4866b3-8070-4de5-aaaa-053929c5dcae\") "
Oct 30 23:56:11.778304 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.778272    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6a2835-2c28-4db4-8e3d-8934f5478952-openshift-service-ca\") pod \"maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr\" (UID: \"2c6a2835-2c28-4db4-8e3d-8934f5478952\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"
Oct 30 23:56:11.778432 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.778332    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c6a2835-2c28-4db4-8e3d-8934f5478952-metrics-certs\") pod \"maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr\" (UID: \"2c6a2835-2c28-4db4-8e3d-8934f5478952\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"
Oct 30 23:56:11.778749 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.778721    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxmqv\" (UniqueName: \"kubernetes.io/projected/2c6a2835-2c28-4db4-8e3d-8934f5478952-kube-api-access-fxmqv\") pod \"maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr\" (UID: \"2c6a2835-2c28-4db4-8e3d-8934f5478952\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"
Oct 30 23:56:11.778930 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.778911    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c6a2835-2c28-4db4-8e3d-8934f5478952-maas-api-tls\") pod \"maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr\" (UID: \"2c6a2835-2c28-4db4-8e3d-8934f5478952\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"
Oct 30 23:56:11.779092 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.779075    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pv5hw\" (UniqueName: \"kubernetes.io/projected/9e4866b3-8070-4de5-aaaa-053929c5dcae-kube-api-access-pv5hw\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:56:11.783860 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.780243    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e4866b3-8070-4de5-aaaa-053929c5dcae-maas-api-tls" pod "9e4866b3-8070-4de5-aaaa-053929c5dcae" (UID: "9e4866b3-8070-4de5-aaaa-053929c5dcae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:56:11.785763 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.784783    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e4866b3-8070-4de5-aaaa-053929c5dcae-metrics-certs" pod "9e4866b3-8070-4de5-aaaa-053929c5dcae" (UID: "9e4866b3-8070-4de5-aaaa-053929c5dcae"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:56:11.788578 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.788548    4921 generic.go:356] "Generic (PLEG): container finished" podID="9e4866b3-8070-4de5-aaaa-053929c5dcae" containerID="6943719abcbf76c3bf7f48a6da1921f3b010e4bacc72ffcbc4ed9f7cf5f26fde" exitCode=0
Oct 30 23:56:11.788722 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.788703    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv" event={"ID":"9e4866b3-8070-4de5-aaaa-053929c5dcae","Type":"ContainerDied","Data":"6943719abcbf76c3bf7f48a6da1921f3b010e4bacc72ffcbc4ed9f7cf5f26fde"}
Oct 30 23:56:11.788794 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.788758    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv" event={"ID":"9e4866b3-8070-4de5-aaaa-053929c5dcae","Type":"ContainerDied","Data":"92a942f08bde83660528589ac171b35e73323ebde533518bbf21434f170f436e"}
Oct 30 23:56:11.788794 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.788788    4921 scope.go:122] "RemoveContainer" containerID="6943719abcbf76c3bf7f48a6da1921f3b010e4bacc72ffcbc4ed9f7cf5f26fde"
Oct 30 23:56:11.788982 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.788966    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"
Oct 30 23:56:11.799166 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.799143    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:11.876674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.871283    4921 scope.go:122] "RemoveContainer" containerID="6943719abcbf76c3bf7f48a6da1921f3b010e4bacc72ffcbc4ed9f7cf5f26fde"
Oct 30 23:56:11.907617 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:56:11.902518    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6943719abcbf76c3bf7f48a6da1921f3b010e4bacc72ffcbc4ed9f7cf5f26fde\": container with ID starting with 6943719abcbf76c3bf7f48a6da1921f3b010e4bacc72ffcbc4ed9f7cf5f26fde not found: ID does not exist" containerID="6943719abcbf76c3bf7f48a6da1921f3b010e4bacc72ffcbc4ed9f7cf5f26fde"
Oct 30 23:56:11.907617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.902576    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6943719abcbf76c3bf7f48a6da1921f3b010e4bacc72ffcbc4ed9f7cf5f26fde"} err="failed to get container status \"6943719abcbf76c3bf7f48a6da1921f3b010e4bacc72ffcbc4ed9f7cf5f26fde\": rpc error: code = NotFound desc = could not find container \"6943719abcbf76c3bf7f48a6da1921f3b010e4bacc72ffcbc4ed9f7cf5f26fde\": container with ID starting with 6943719abcbf76c3bf7f48a6da1921f3b010e4bacc72ffcbc4ed9f7cf5f26fde not found: ID does not exist"
Oct 30 23:56:11.907617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.903016    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c6a2835-2c28-4db4-8e3d-8934f5478952-maas-api-tls\") pod \"maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr\" (UID: \"2c6a2835-2c28-4db4-8e3d-8934f5478952\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"
Oct 30 23:56:11.907617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.903147    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6a2835-2c28-4db4-8e3d-8934f5478952-openshift-service-ca\") pod \"maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr\" (UID: \"2c6a2835-2c28-4db4-8e3d-8934f5478952\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"
Oct 30 23:56:11.907617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.903187    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c6a2835-2c28-4db4-8e3d-8934f5478952-metrics-certs\") pod \"maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr\" (UID: \"2c6a2835-2c28-4db4-8e3d-8934f5478952\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"
Oct 30 23:56:11.907617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.903400    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxmqv\" (UniqueName: \"kubernetes.io/projected/2c6a2835-2c28-4db4-8e3d-8934f5478952-kube-api-access-fxmqv\") pod \"maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr\" (UID: \"2c6a2835-2c28-4db4-8e3d-8934f5478952\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"
Oct 30 23:56:11.907617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.904912    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6a2835-2c28-4db4-8e3d-8934f5478952-openshift-service-ca\") pod \"maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr\" (UID: \"2c6a2835-2c28-4db4-8e3d-8934f5478952\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"
Oct 30 23:56:11.927675 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.917273    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e4866b3-8070-4de5-aaaa-053929c5dcae-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:56:11.927675 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.917338    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e4866b3-8070-4de5-aaaa-053929c5dcae-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:56:11.927675 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.922661    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"]
Oct 30 23:56:11.930572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.930538    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f026c1-cf876b65d-9vxcv"]
Oct 30 23:56:11.933134 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.933069    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c6a2835-2c28-4db4-8e3d-8934f5478952-maas-api-tls\") pod \"maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr\" (UID: \"2c6a2835-2c28-4db4-8e3d-8934f5478952\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"
Oct 30 23:56:11.934201 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.934177    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c6a2835-2c28-4db4-8e3d-8934f5478952-metrics-certs\") pod \"maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr\" (UID: \"2c6a2835-2c28-4db4-8e3d-8934f5478952\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"
Oct 30 23:56:11.935026 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:11.935002    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxmqv\" (UniqueName: \"kubernetes.io/projected/2c6a2835-2c28-4db4-8e3d-8934f5478952-kube-api-access-fxmqv\") pod \"maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr\" (UID: \"2c6a2835-2c28-4db4-8e3d-8934f5478952\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"
Oct 30 23:56:12.039475 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:12.039444    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"
Oct 30 23:56:12.281236 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:12.281195    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:12.346152 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:56:12.346118    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6a2835_2c28_4db4_8e3d_8934f5478952.slice/crio-d50611e1f67acb98925023d622a4c9aba4d1e786a725e370dce4d15056a191b8 WatchSource:0}: Error finding container d50611e1f67acb98925023d622a4c9aba4d1e786a725e370dce4d15056a191b8: Status 404 returned error can't find the container with id d50611e1f67acb98925023d622a4c9aba4d1e786a725e370dce4d15056a191b8
Oct 30 23:56:12.347656 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:12.347632    4921 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 23:56:12.347811 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:12.347687    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"]
Oct 30 23:56:12.665610 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:12.662720    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:12.799262 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:12.799221    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr" event={"ID":"2c6a2835-2c28-4db4-8e3d-8934f5478952","Type":"ContainerStarted","Data":"d50611e1f67acb98925023d622a4c9aba4d1e786a725e370dce4d15056a191b8"}
Oct 30 23:56:12.886573 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:12.886542    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e4866b3-8070-4de5-aaaa-053929c5dcae" path="/var/lib/kubelet/pods/9e4866b3-8070-4de5-aaaa-053929c5dcae/volumes"
Oct 30 23:56:13.517618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:13.509258    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:13.810969 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:13.810885    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr" event={"ID":"2c6a2835-2c28-4db4-8e3d-8934f5478952","Type":"ContainerStarted","Data":"4a6f3fb711e0c7c91d63437ed38f1851b85480c6bcd0eb4bf3b3f7ea545c0aac"}
Oct 30 23:56:13.810969 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:13.810948    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"
Oct 30 23:56:13.838887 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:13.838831    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr" podStartSLOduration=181.274285756 podStartE2EDuration="3m1.838812133s" totalImagesPullingTime="564.526377ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:53:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:56:13.834777621 +0000 UTC m=+2233.079633395" watchObservedRunningTime="2026-10-30 23:56:13.838812133 +0000 UTC m=+2233.083667903"
Oct 30 23:56:14.478697 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:14.478526    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:15.441617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:15.439532    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:16.287520 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:16.287467    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:17.089079 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:17.089032    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:17.288635 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:17.288565    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:17.524662 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:17.520210    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:18.181622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:18.178678    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:18.909331 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:18.908705    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:19.668155 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:19.668120    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:19.841210 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:19.841166    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:19.848300 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:19.848275    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"
Oct 30 23:56:20.007355 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:20.007267    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:20.819850 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:20.818554    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:21.792230 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:21.792184    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:22.826510 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:22.826477    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:23.740148 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:23.740110    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:24.430334 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:24.430298    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:24.848304 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:24.848213    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:25.052385 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:25.052345    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:25.217449 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:25.217410    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:25.643401 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:25.643362    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:26.772153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:26.772116    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:26.937328 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:26.937292    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:27.869015 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:27.868980    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:28.745523 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:28.745489    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:29.742628 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:29.740408    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:30.761103 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:30.759741    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:30.968374 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:30.968343    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:31.605680 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:31.605620    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:32.542367 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:32.542326    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:33.436619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:33.432781    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:34.230532 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:34.230353    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:35.073045 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:35.072999    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:35.831669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:35.822117    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:36.689637 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:36.687194    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:37.422970 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:37.422913    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:38.058440 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:38.058407    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:38.713637 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:38.713557    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:38.903350 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:38.903317    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:39.860622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:39.857859    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:40.798927 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:40.798889    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:40.967268 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:40.967126    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:41.408391 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:56:41.408353    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:56:41.679608 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:41.679487    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:42.663442 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:42.655793    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:43.946705 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:43.946663    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:44.717091 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:44.717047    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:45.467728 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:45.467677    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:46.338547 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:46.338497    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:47.258614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:47.254844    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:47.952189 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:47.952156    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:48.264546 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:48.264457    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:48.800250 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:48.800209    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:48.961295 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:48.961259    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:49.283058 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:49.283020    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:49.490537 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:49.490489    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:49.694018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:49.693982    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:50.568712 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:50.568672    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:51.432150 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:51.432080    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:52.274862 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:52.274824    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:52.681393 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:52.681345    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:53.496532 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:53.496493    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:53.927902 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:53.927866    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:54.463803 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:54.463684    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:54.630024 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:54.629988    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:55.301788 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:55.301751    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:56.100196 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:56.100133    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:57.368319 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:57.368233    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:56:59.070409 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:56:59.070285    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:00.487756 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:00.487716    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:01.455690 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:01.455637    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:02.537630 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:02.529095    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:03.300620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:03.297503    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:04.123737 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:04.123707    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:05.046660 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:05.046329    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:05.754632 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:05.754400    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:06.497234 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:06.497096    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:07.225638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:07.223139    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:08.032695 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:08.032654    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:08.737395 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:08.737330    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:09.611690 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:09.605957    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:09.910793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:09.910760    4921 generic.go:356] "Generic (PLEG): container finished" podID="62106426-3aa0-4918-b5db-ab1a0a70d1e5" containerID="f64bb7c0a9df2391acc1f595476c8045327c17ee0c2437cd3c90c5b98e573135" exitCode=0
Oct 30 23:57:09.911188 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:09.910830    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd" event={"ID":"62106426-3aa0-4918-b5db-ab1a0a70d1e5","Type":"ContainerDied","Data":"f64bb7c0a9df2391acc1f595476c8045327c17ee0c2437cd3c90c5b98e573135"}
Oct 30 23:57:09.911285 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:09.911268    4921 scope.go:122] "RemoveContainer" containerID="f64bb7c0a9df2391acc1f595476c8045327c17ee0c2437cd3c90c5b98e573135"
Oct 30 23:57:09.913208 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:09.913178    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:57:09.913288 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:09.913255    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:57:09.913326 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:09.913289    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:57:10.339265 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:10.339169    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:10.615268 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:10.615182    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:57:10.920501 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:10.920462    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd" event={"ID":"62106426-3aa0-4918-b5db-ab1a0a70d1e5","Type":"ContainerStarted","Data":"8f569d39ce2ee816adb0b6857cd63e09a31e99c36d3ece0f4fd6223b015f60f4"}
Oct 30 23:57:11.183664 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:11.162657    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:57:11.183664 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:11.181782    4921 patch_prober.go:29] interesting pod/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.154:15021/healthz/ready\": dial tcp 10.132.0.154:15021: connect: connection refused" start-of-body=
Oct 30 23:57:11.183664 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:11.181876    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd" podUID="62106426-3aa0-4918-b5db-ab1a0a70d1e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.154:15021/healthz/ready\": dial tcp 10.132.0.154:15021: connect: connection refused"
Oct 30 23:57:11.241617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:11.239094    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:11.406987 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:57:11.406924    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:57:11.996915 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:11.996818    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:12.144197 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:12.144159    4921 patch_prober.go:29] interesting pod/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.154:15021/healthz/ready\": dial tcp 10.132.0.154:15021: connect: connection refused" start-of-body=
Oct 30 23:57:12.144907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:12.144864    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd" podUID="62106426-3aa0-4918-b5db-ab1a0a70d1e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.154:15021/healthz/ready\": dial tcp 10.132.0.154:15021: connect: connection refused"
Oct 30 23:57:12.875627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:12.875573    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:13.135532 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:13.135501    4921 patch_prober.go:29] interesting pod/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.154:15021/healthz/ready\": dial tcp 10.132.0.154:15021: connect: connection refused" start-of-body=
Oct 30 23:57:13.135989 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:13.135561    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd" podUID="62106426-3aa0-4918-b5db-ab1a0a70d1e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.154:15021/healthz/ready\": dial tcp 10.132.0.154:15021: connect: connection refused"
Oct 30 23:57:13.805616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:13.801566    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:14.135495 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:14.135468    4921 patch_prober.go:29] interesting pod/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.154:15021/healthz/ready\": dial tcp 10.132.0.154:15021: connect: connection refused" start-of-body=
Oct 30 23:57:14.135701 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:14.135522    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd" podUID="62106426-3aa0-4918-b5db-ab1a0a70d1e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.154:15021/healthz/ready\": dial tcp 10.132.0.154:15021: connect: connection refused"
Oct 30 23:57:14.644984 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:14.644950    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:15.135861 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:15.135835    4921 patch_prober.go:29] interesting pod/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.154:15021/healthz/ready\": dial tcp 10.132.0.154:15021: connect: connection refused" start-of-body=
Oct 30 23:57:15.136265 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:15.135886    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd" podUID="62106426-3aa0-4918-b5db-ab1a0a70d1e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.154:15021/healthz/ready\": dial tcp 10.132.0.154:15021: connect: connection refused"
Oct 30 23:57:15.552691 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:15.552458    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:16.135528 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:16.135497    4921 patch_prober.go:29] interesting pod/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.154:15021/healthz/ready\": dial tcp 10.132.0.154:15021: connect: connection refused" start-of-body=
Oct 30 23:57:16.135748 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:16.135556    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd" podUID="62106426-3aa0-4918-b5db-ab1a0a70d1e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.154:15021/healthz/ready\": dial tcp 10.132.0.154:15021: connect: connection refused"
Oct 30 23:57:16.367874 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:16.367814    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:17.128120 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:17.128080    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:17.189656 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:17.189569    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:57:17.191529 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:17.191506    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:57:17.217629 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:17.206981    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 30 23:57:17.949260 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:17.949218    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:18.328679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:18.328561    4921 ???:1] "http: TLS handshake error from 10.0.137.81:52103: read tcp 10.0.142.208:10250->10.0.137.81:52103: read: connection reset by peer"
Oct 30 23:57:18.328857 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:18.328752    4921 ???:1] "http: TLS handshake error from 10.0.137.81:35450: EOF"
Oct 30 23:57:18.328857 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:18.328788    4921 ???:1] "http: TLS handshake error from 10.0.137.81:57581: EOF"
Oct 30 23:57:18.698992 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:18.698958    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:19.506651 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:19.506614    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:20.238350 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:20.238314    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:20.584579 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:20.584501    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:20.805804 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:20.805746    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:20.975249 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:20.975193    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:21.110092 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:21.110058    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:21.265483 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:21.265379    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:21.746731 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:21.746695    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:22.575434 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:22.575385    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:23.265478 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:23.265437    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:23.471618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:23.447205    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:24.330694 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:24.330614    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:25.363049 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:25.363008    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:26.291624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:26.291304    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:26.947671 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:26.947641    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:28.038619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:28.027240    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:28.839810 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:28.839773    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:29.647632 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:29.647566    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:30.387203 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:30.387165    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:31.300025 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:31.299912    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:32.038759 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:32.038730    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:32.820822 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:32.820783    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:33.541998 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:33.541952    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:33.974070 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:33.974034    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf"]
Oct 30 23:57:34.087230 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:34.087192    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:34.215579 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:34.215546    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:34.373651 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:34.366700    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:35.270080 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:35.270029    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:36.050746 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:36.050716    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:36.844828 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:36.843855    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:36.979045 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:36.979009    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:37.522571 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:37.522364    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:38.296217 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:38.295760    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:38.946269 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:38.946194    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:38.975723 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:38.975674    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf" podUID="2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9" containerName="payload-processing" containerID="cri-o://20519ac7ee1754b8a3c1342bb3c0a597d31b26f46473ee97c567e0ddbac8268d" gracePeriod=25
Oct 30 23:57:39.270334 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.270293    4921 generic.go:356] "Generic (PLEG): container finished" podID="2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9" containerID="20519ac7ee1754b8a3c1342bb3c0a597d31b26f46473ee97c567e0ddbac8268d" exitCode=0
Oct 30 23:57:39.270496 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.270370    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf" event={"ID":"2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9","Type":"ContainerDied","Data":"20519ac7ee1754b8a3c1342bb3c0a597d31b26f46473ee97c567e0ddbac8268d"}
Oct 30 23:57:39.302624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.302579    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf"
Oct 30 23:57:39.340797 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.340768    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"]
Oct 30 23:57:39.341701 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.341684    4921 cpu_manager.go:414] "containerMap: removing container" podUID="2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9" containerName="payload-processing"
Oct 30 23:57:39.341763 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.341702    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9" containerName="payload-processing"
Oct 30 23:57:39.341827 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.341818    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9" containerName="payload-processing"
Oct 30 23:57:39.345978 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.345948    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.356214 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.356186    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-e5934f-openshift-default-dockercfg-8mhfk\""
Oct 30 23:57:39.370564 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.370531    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"]
Oct 30 23:57:39.410249 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.410216    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9-kube-api-access-6n6vj\" (UniqueName: \"kubernetes.io/projected/2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9-kube-api-access-6n6vj\") pod \"2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9\" (UID: \"2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9\") "
Oct 30 23:57:39.410485 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.410423    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9-plugins-config-volume\") pod \"2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9\" (UID: \"2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9\") "
Oct 30 23:57:39.410842 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.410813    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9-plugins-config-volume" pod "2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9" (UID: "2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:57:39.410959 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.410840    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-data\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.411013 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.410978    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-credential-socket\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.411064 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.411045    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-token\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.411156 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.411138    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-workload-certs\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.411247 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.411220    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-workload-socket\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.411345 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.411328    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-envoy\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.411443 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.411428    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8rtr\" (UniqueName: \"kubernetes.io/projected/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-kube-api-access-p8rtr\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.411566 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.411541    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istiod-ca-cert\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.411748 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.411660    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-podinfo\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.411896 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.411875    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:39.414375 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.414351    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9-kube-api-access-6n6vj" pod "2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9" (UID: "2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9"). InnerVolumeSpecName "kube-api-access-6n6vj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:39.513385 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.513294    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istiod-ca-cert\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.513385 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.513374    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-podinfo\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.513693 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.513457    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-data\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.513693 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.513513    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-credential-socket\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.513693 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.513562    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-token\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.513693 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.513610    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-workload-certs\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.513693 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.513673    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-workload-socket\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.513961 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.513720    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-envoy\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.513961 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.513816    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8rtr\" (UniqueName: \"kubernetes.io/projected/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-kube-api-access-p8rtr\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.513961 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.513923    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-data\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.514132 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.513968    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-credential-socket\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.514132 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.514049    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n6vj\" (UniqueName: \"kubernetes.io/projected/2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9-kube-api-access-6n6vj\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:39.514237 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.514142    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istiod-ca-cert\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.514237 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.514205    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-workload-certs\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.514507 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.514285    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-workload-socket\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.516215 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.516193    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-envoy\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.516356 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.516333    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-podinfo\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.526035 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.526008    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-token\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.526300 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.526280    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8rtr\" (UniqueName: \"kubernetes.io/projected/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-kube-api-access-p8rtr\") pod \"e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") " pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.667028 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.666990    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:39.794122 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.793892    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:39.978692 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:57:39.978656    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc52bd2b2_c6ff_4c45_aa3e_3d44586b5970.slice/crio-deec2e4e8d713260c5ed16b682aa9b3668b96656363add70274ffcfb0ad91bb0 WatchSource:0}: Error finding container deec2e4e8d713260c5ed16b682aa9b3668b96656363add70274ffcfb0ad91bb0: Status 404 returned error can't find the container with id deec2e4e8d713260c5ed16b682aa9b3668b96656363add70274ffcfb0ad91bb0
Oct 30 23:57:39.979971 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.979947    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"]
Oct 30 23:57:39.982560 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.982521    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:57:39.982675 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.982616    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:57:39.982675 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:39.982658    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:57:40.280907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:40.280876    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf"
Oct 30 23:57:40.280907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:40.280888    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf" event={"ID":"2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9","Type":"ContainerDied","Data":"abc61217212bc0a4765887d7a2b4a852639886efff817c04132620b1551b6942"}
Oct 30 23:57:40.281155 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:40.280957    4921 scope.go:122] "RemoveContainer" containerID="20519ac7ee1754b8a3c1342bb3c0a597d31b26f46473ee97c567e0ddbac8268d"
Oct 30 23:57:40.282976 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:40.282946    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb" event={"ID":"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970","Type":"ContainerStarted","Data":"a2b529fb72214c4a17fcd9d66173ef5653d9ba697d4fa9f5333129f410b2bb25"}
Oct 30 23:57:40.283128 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:40.283004    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb" event={"ID":"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970","Type":"ContainerStarted","Data":"deec2e4e8d713260c5ed16b682aa9b3668b96656363add70274ffcfb0ad91bb0"}
Oct 30 23:57:40.316864 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:40.316763    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb" podStartSLOduration=51.316749344 podStartE2EDuration="51.316749344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:56:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:57:40.31334964 +0000 UTC m=+2319.558205447" watchObservedRunningTime="2026-10-30 23:57:40.316749344 +0000 UTC m=+2319.561605111"
Oct 30 23:57:40.333669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:40.333642    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf"]
Oct 30 23:57:40.340840 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:40.340815    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-df3b5f-8f75bcbf5-fq9pf"]
Oct 30 23:57:40.667261 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:40.667232    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:40.796973 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:40.796931    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:40.908037 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:40.908003    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9" path="/var/lib/kubelet/pods/2b29f8f6-6c33-4f0b-8e66-cb742ba79ea9/volumes"
Oct 30 23:57:41.407765 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:57:41.407720    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:57:41.674642 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:41.674525    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:41.744622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:41.742932    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:42.310992 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:42.310964    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:42.311855 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:42.311834    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 30 23:57:42.597019 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:42.596893    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"]
Oct 30 23:57:42.597610 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:42.597142    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966" podUID="45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" containerName="istio-proxy" containerID="cri-o://9e3427d8e2366b915a7996ceb8db180a9e1ee6b035a6949396bff865e2dcc378" gracePeriod=30
Oct 30 23:57:42.656301 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:42.656266    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:43.301716 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:43.301681    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:43.605763 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:43.604471    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:43.831396 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:43.831365    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:44.820033 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:44.819995    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:44.889735 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:44.889702    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6"]
Oct 30 23:57:44.911785 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:44.910627    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6"
Oct 30 23:57:44.929805 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:44.929776    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6"]
Oct 30 23:57:44.933199 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:44.933056    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-e5934f\""
Oct 30 23:57:44.933199 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:44.933167    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-e5934f-dockercfg-cn8lx\""
Oct 30 23:57:45.023206 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:45.023168    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6\" (UID: \"a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6"
Oct 30 23:57:45.024154 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:45.024109    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzvnv\" (UniqueName: \"kubernetes.io/projected/a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90-kube-api-access-pzvnv\") pod \"payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6\" (UID: \"a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6"
Oct 30 23:57:45.032136 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:45.032110    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:45.126217 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:45.126109    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzvnv\" (UniqueName: \"kubernetes.io/projected/a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90-kube-api-access-pzvnv\") pod \"payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6\" (UID: \"a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6"
Oct 30 23:57:45.126613 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:45.126573    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6\" (UID: \"a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6"
Oct 30 23:57:45.127426 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:45.127402    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6\" (UID: \"a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6"
Oct 30 23:57:45.154168 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:45.154144    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzvnv\" (UniqueName: \"kubernetes.io/projected/a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90-kube-api-access-pzvnv\") pod \"payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6\" (UID: \"a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6"
Oct 30 23:57:45.232019 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:45.231984    4921 patch_prober.go:29] interesting pod/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:57:45.232193 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:45.232060    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966" podUID="45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:57:45.236368 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:45.236339    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6"
Oct 30 23:57:45.491673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:45.439366    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:45.786902 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:57:45.786874    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda98e6303_d1d9_47aa_8d6e_a99d7d6c2c90.slice/crio-f673f3d99da3854f4ae3ee4b407c80acb610cabaade368ab0fcd003b27a46383 WatchSource:0}: Error finding container f673f3d99da3854f4ae3ee4b407c80acb610cabaade368ab0fcd003b27a46383: Status 404 returned error can't find the container with id f673f3d99da3854f4ae3ee4b407c80acb610cabaade368ab0fcd003b27a46383
Oct 30 23:57:45.788279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:45.788248    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6"]
Oct 30 23:57:46.558110 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:46.558073    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6" event={"ID":"a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90","Type":"ContainerStarted","Data":"2aa1107dcd4feb5aaa86a3567ec5272c5b8cd5271e14e4e27e687757e4ca150b"}
Oct 30 23:57:46.558707 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:46.558134    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6" event={"ID":"a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90","Type":"ContainerStarted","Data":"f673f3d99da3854f4ae3ee4b407c80acb610cabaade368ab0fcd003b27a46383"}
Oct 30 23:57:46.559577 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:46.559551    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6"
Oct 30 23:57:46.596883 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:46.596834    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6" podStartSLOduration=2.596821502 podStartE2EDuration="2.596821502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:57:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:57:46.593681375 +0000 UTC m=+2325.838537146" watchObservedRunningTime="2026-10-30 23:57:46.596821502 +0000 UTC m=+2325.841677269"
Oct 30 23:57:47.006859 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.006823    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:47.917125 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.917098    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:57:47.949777 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.949747    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:47.965420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.965393    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5"]
Oct 30 23:57:47.966436 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.966372    4921 cpu_manager.go:414] "containerMap: removing container" podUID="45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" containerName="istio-proxy"
Oct 30 23:57:47.966436 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.966394    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" containerName="istio-proxy"
Oct 30 23:57:47.966436 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.966422    4921 cpu_manager.go:414] "containerMap: removing container" podUID="45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" containerName="istio-proxy"
Oct 30 23:57:47.966436 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.966429    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" containerName="istio-proxy"
Oct 30 23:57:47.966681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.966562    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" containerName="istio-proxy"
Oct 30 23:57:47.966681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.966581    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" containerName="istio-proxy"
Oct 30 23:57:47.970525 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.970503    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5"
Oct 30 23:57:47.986914 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.986890    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5"]
Oct 30 23:57:47.994922 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.994896    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-podinfo\") pod \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") "
Oct 30 23:57:47.995194 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.994953    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-workload-certs\") pod \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") "
Oct 30 23:57:47.995482 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.995435    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-credential-socket\") pod \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") "
Oct 30 23:57:47.995611 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.995518    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-token\" (UniqueName: \"kubernetes.io/projected/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-token\") pod \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") "
Oct 30 23:57:47.995940 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.995916    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-workload-certs" pod "45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" (UID: "45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:47.996068 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.996018    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-data\") pod \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") "
Oct 30 23:57:48.001572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.996243    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-data" pod "45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" (UID: "45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:48.001572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.996639    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-credential-socket" pod "45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" (UID: "45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:48.001572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.998705    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-token" pod "45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" (UID: "45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:48.001572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.999060    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-podinfo" pod "45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" (UID: "45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:57:48.001572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.999779    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-envoy\") pod \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") "
Oct 30 23:57:48.001572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.999870    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-kube-api-access-j7zp5\" (UniqueName: \"kubernetes.io/projected/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-kube-api-access-j7zp5\") pod \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") "
Oct 30 23:57:48.001572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.999913    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-workload-socket\") pod \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") "
Oct 30 23:57:48.001572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:47.999944    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istiod-ca-cert\") pod \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\" (UID: \"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d\") "
Oct 30 23:57:48.001572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.000565    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-workload-socket" pod "45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" (UID: "45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:48.001572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.000620    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30e1183d-5ec4-44bc-a3ff-585db970d413-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5\" (UID: \"30e1183d-5ec4-44bc-a3ff-585db970d413\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5"
Oct 30 23:57:48.001572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.000668    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmj8n\" (UniqueName: \"kubernetes.io/projected/30e1183d-5ec4-44bc-a3ff-585db970d413-kube-api-access-wmj8n\") pod \"payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5\" (UID: \"30e1183d-5ec4-44bc-a3ff-585db970d413\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5"
Oct 30 23:57:48.001572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.000919    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:48.001572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.000936    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:48.001572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.000915    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istiod-ca-cert" pod "45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" (UID: "45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:57:48.001572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.000992    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:48.001572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.001007    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:48.001572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.001019    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:48.001572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.001030    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:48.003513 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.003485    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-kube-api-access-j7zp5" pod "45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" (UID: "45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d"). InnerVolumeSpecName "kube-api-access-j7zp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:48.003672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.003564    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-envoy" pod "45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" (UID: "45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:48.103171 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.103132    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30e1183d-5ec4-44bc-a3ff-585db970d413-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5\" (UID: \"30e1183d-5ec4-44bc-a3ff-585db970d413\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5"
Oct 30 23:57:48.103399 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.103194    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmj8n\" (UniqueName: \"kubernetes.io/projected/30e1183d-5ec4-44bc-a3ff-585db970d413-kube-api-access-wmj8n\") pod \"payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5\" (UID: \"30e1183d-5ec4-44bc-a3ff-585db970d413\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5"
Oct 30 23:57:48.103399 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.103293    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:48.103399 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.103306    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7zp5\" (UniqueName: \"kubernetes.io/projected/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-kube-api-access-j7zp5\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:48.103399 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.103315    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:48.103991 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.103967    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30e1183d-5ec4-44bc-a3ff-585db970d413-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5\" (UID: \"30e1183d-5ec4-44bc-a3ff-585db970d413\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5"
Oct 30 23:57:48.117328 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.117303    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmj8n\" (UniqueName: \"kubernetes.io/projected/30e1183d-5ec4-44bc-a3ff-585db970d413-kube-api-access-wmj8n\") pod \"payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5\" (UID: \"30e1183d-5ec4-44bc-a3ff-585db970d413\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5"
Oct 30 23:57:48.160135 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.160099    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:48.328621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.320861    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5"
Oct 30 23:57:48.763451 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.763361    4921 generic.go:356] "Generic (PLEG): container finished" podID="45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" containerID="9e3427d8e2366b915a7996ceb8db180a9e1ee6b035a6949396bff865e2dcc378" exitCode=0
Oct 30 23:57:48.764409 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.764375    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"
Oct 30 23:57:48.764867 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.764582    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966" event={"ID":"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d","Type":"ContainerDied","Data":"9e3427d8e2366b915a7996ceb8db180a9e1ee6b035a6949396bff865e2dcc378"}
Oct 30 23:57:48.765113 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.765076    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966" event={"ID":"45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d","Type":"ContainerDied","Data":"b0b7f9b810ba1c5e88bc25ed744111bdc4c53c97b774681b526320f32e772d6b"}
Oct 30 23:57:48.765269 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:48.765253    4921 scope.go:122] "RemoveContainer" containerID="9e3427d8e2366b915a7996ceb8db180a9e1ee6b035a6949396bff865e2dcc378"
Oct 30 23:57:49.038230 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:49.038148    4921 scope.go:122] "RemoveContainer" containerID="70e3a6f3ba4b65432b0ece760fb8b6cce809198ecc07203eae346ce5e1255c3d"
Oct 30 23:57:49.070990 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:49.070969    4921 scope.go:122] "RemoveContainer" containerID="9e3427d8e2366b915a7996ceb8db180a9e1ee6b035a6949396bff865e2dcc378"
Oct 30 23:57:49.071393 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:57:49.071368    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e3427d8e2366b915a7996ceb8db180a9e1ee6b035a6949396bff865e2dcc378\": container with ID starting with 9e3427d8e2366b915a7996ceb8db180a9e1ee6b035a6949396bff865e2dcc378 not found: ID does not exist" containerID="9e3427d8e2366b915a7996ceb8db180a9e1ee6b035a6949396bff865e2dcc378"
Oct 30 23:57:49.071527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:49.071402    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e3427d8e2366b915a7996ceb8db180a9e1ee6b035a6949396bff865e2dcc378"} err="failed to get container status \"9e3427d8e2366b915a7996ceb8db180a9e1ee6b035a6949396bff865e2dcc378\": rpc error: code = NotFound desc = could not find container \"9e3427d8e2366b915a7996ceb8db180a9e1ee6b035a6949396bff865e2dcc378\": container with ID starting with 9e3427d8e2366b915a7996ceb8db180a9e1ee6b035a6949396bff865e2dcc378 not found: ID does not exist"
Oct 30 23:57:49.071527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:49.071422    4921 scope.go:122] "RemoveContainer" containerID="70e3a6f3ba4b65432b0ece760fb8b6cce809198ecc07203eae346ce5e1255c3d"
Oct 30 23:57:49.071791 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:57:49.071771    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70e3a6f3ba4b65432b0ece760fb8b6cce809198ecc07203eae346ce5e1255c3d\": container with ID starting with 70e3a6f3ba4b65432b0ece760fb8b6cce809198ecc07203eae346ce5e1255c3d not found: ID does not exist" containerID="70e3a6f3ba4b65432b0ece760fb8b6cce809198ecc07203eae346ce5e1255c3d"
Oct 30 23:57:49.071852 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:49.071802    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70e3a6f3ba4b65432b0ece760fb8b6cce809198ecc07203eae346ce5e1255c3d"} err="failed to get container status \"70e3a6f3ba4b65432b0ece760fb8b6cce809198ecc07203eae346ce5e1255c3d\": rpc error: code = NotFound desc = could not find container \"70e3a6f3ba4b65432b0ece760fb8b6cce809198ecc07203eae346ce5e1255c3d\": container with ID starting with 70e3a6f3ba4b65432b0ece760fb8b6cce809198ecc07203eae346ce5e1255c3d not found: ID does not exist"
Oct 30 23:57:49.084751 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:49.084721    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"]
Oct 30 23:57:49.089757 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:49.089372    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-f026c1-openshift-default-5bf6b99cc5-fh966"]
Oct 30 23:57:49.217657 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:49.217622    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5"]
Oct 30 23:57:49.218782 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:57:49.218752    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30e1183d_5ec4_44bc_a3ff_585db970d413.slice/crio-4ce68f6ad1e7c0d5316942a4c02daef98dfafdf410b73130ba92f7340e8e859c WatchSource:0}: Error finding container 4ce68f6ad1e7c0d5316942a4c02daef98dfafdf410b73130ba92f7340e8e859c: Status 404 returned error can't find the container with id 4ce68f6ad1e7c0d5316942a4c02daef98dfafdf410b73130ba92f7340e8e859c
Oct 30 23:57:49.484617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:49.480370    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:49.735445 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:49.735414    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:49.774209 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:49.774180    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5" event={"ID":"30e1183d-5ec4-44bc-a3ff-585db970d413","Type":"ContainerStarted","Data":"5acbbb8d21278c8abc15f5f1e1f978ac482d8fecad6b01be69688f32b19b779f"}
Oct 30 23:57:49.774402 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:49.774234    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5" event={"ID":"30e1183d-5ec4-44bc-a3ff-585db970d413","Type":"ContainerStarted","Data":"4ce68f6ad1e7c0d5316942a4c02daef98dfafdf410b73130ba92f7340e8e859c"}
Oct 30 23:57:49.774402 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:49.774280    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5"
Oct 30 23:57:49.882048 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:49.881989    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5" podStartSLOduration=5.881968123 podStartE2EDuration="5.881968123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:57:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:57:49.829639646 +0000 UTC m=+2329.074495410" watchObservedRunningTime="2026-10-30 23:57:49.881968123 +0000 UTC m=+2329.126823892"
Oct 30 23:57:49.883114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:49.883088    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:50.730952 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:50.730914    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:50.891838 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:50.891806    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d" path="/var/lib/kubelet/pods/45c5e91a-a12f-4ac4-b2e5-f6ecacce9b0d/volumes"
Oct 30 23:57:51.407112 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:51.407078    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"]
Oct 30 23:57:51.407368 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:51.407338    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt" podUID="67756018-6320-4b57-9c9d-5087aae29907" containerName="istio-proxy" containerID="cri-o://c71954f68fb773e46fbb1ab2215b5db67b9f0c2a99193d6e5965ff1f21acf460" gracePeriod=30
Oct 30 23:57:51.551746 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:51.551670    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"]
Oct 30 23:57:51.552267 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:51.552235    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn" podUID="dedc712d-832a-4a02-bbd6-83a7d728835c" containerName="istio-proxy" containerID="cri-o://a60500426d00451bc572110c0531e063d5002eee389b112992b7a9a7fdbd8560" gracePeriod=30
Oct 30 23:57:51.556798 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:51.556774    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"]
Oct 30 23:57:51.556972 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:51.556952    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy" containerID="cri-o://bf9196c0c339cb385b852e11e2e7be7a2187f68e0e79cf376a84fac3d9e68ae4" gracePeriod=30
Oct 30 23:57:51.603572 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:51.603523    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:51.708091 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:51.708011    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"]
Oct 30 23:57:51.708284 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:51.708259    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq" podUID="31849433-47df-48bc-87c0-903660560055" containerName="istio-proxy" containerID="cri-o://a32a2a13e914be4b03a146c58733e49e61cb7a2c854ae6fdc797318d640a6232" gracePeriod=30
Oct 30 23:57:52.657855 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:52.657818    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:53.208782 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:53.208727    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:53.293352 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:53.293299    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"]
Oct 30 23:57:53.294519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:53.294484    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr" podUID="2c6a2835-2c28-4db4-8e3d-8934f5478952" containerName="maas-api" containerID="cri-o://4a6f3fb711e0c7c91d63437ed38f1851b85480c6bcd0eb4bf3b3f7ea545c0aac" gracePeriod=30
Oct 30 23:57:53.371219 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:53.371186    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:53.619617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:53.617122    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:53.755047 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:53.754580    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:54.115717 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:54.114691    4921 generic.go:356] "Generic (PLEG): container finished" podID="2c6a2835-2c28-4db4-8e3d-8934f5478952" containerID="4a6f3fb711e0c7c91d63437ed38f1851b85480c6bcd0eb4bf3b3f7ea545c0aac" exitCode=0
Oct 30 23:57:54.116338 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:54.116244    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr" event={"ID":"2c6a2835-2c28-4db4-8e3d-8934f5478952","Type":"ContainerDied","Data":"4a6f3fb711e0c7c91d63437ed38f1851b85480c6bcd0eb4bf3b3f7ea545c0aac"}
Oct 30 23:57:54.471619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:54.389918    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:54.587619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:54.586684    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:57:54.702618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:54.679047    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:54.817093 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:54.817000    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:57:54.862616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:54.849388    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:57:54.879419 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:54.877574    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:57:54.933821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:54.933792    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"
Oct 30 23:57:55.100364 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:55.100270    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2c6a2835-2c28-4db4-8e3d-8934f5478952-kube-api-access-fxmqv\" (UniqueName: \"kubernetes.io/projected/2c6a2835-2c28-4db4-8e3d-8934f5478952-kube-api-access-fxmqv\") pod \"2c6a2835-2c28-4db4-8e3d-8934f5478952\" (UID: \"2c6a2835-2c28-4db4-8e3d-8934f5478952\") "
Oct 30 23:57:55.100703 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:55.100678    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2c6a2835-2c28-4db4-8e3d-8934f5478952-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c6a2835-2c28-4db4-8e3d-8934f5478952-maas-api-tls\") pod \"2c6a2835-2c28-4db4-8e3d-8934f5478952\" (UID: \"2c6a2835-2c28-4db4-8e3d-8934f5478952\") "
Oct 30 23:57:55.101002 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:55.100960    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2c6a2835-2c28-4db4-8e3d-8934f5478952-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c6a2835-2c28-4db4-8e3d-8934f5478952-metrics-certs\") pod \"2c6a2835-2c28-4db4-8e3d-8934f5478952\" (UID: \"2c6a2835-2c28-4db4-8e3d-8934f5478952\") "
Oct 30 23:57:55.101148 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:55.101122    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2c6a2835-2c28-4db4-8e3d-8934f5478952-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6a2835-2c28-4db4-8e3d-8934f5478952-openshift-service-ca\") pod \"2c6a2835-2c28-4db4-8e3d-8934f5478952\" (UID: \"2c6a2835-2c28-4db4-8e3d-8934f5478952\") "
Oct 30 23:57:55.101567 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:55.101538    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c6a2835-2c28-4db4-8e3d-8934f5478952-openshift-service-ca" pod "2c6a2835-2c28-4db4-8e3d-8934f5478952" (UID: "2c6a2835-2c28-4db4-8e3d-8934f5478952"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:57:55.102261 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:55.102242    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6a2835-2c28-4db4-8e3d-8934f5478952-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:55.103653 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:55.103629    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c6a2835-2c28-4db4-8e3d-8934f5478952-maas-api-tls" pod "2c6a2835-2c28-4db4-8e3d-8934f5478952" (UID: "2c6a2835-2c28-4db4-8e3d-8934f5478952"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:57:55.104481 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:55.104460    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c6a2835-2c28-4db4-8e3d-8934f5478952-kube-api-access-fxmqv" pod "2c6a2835-2c28-4db4-8e3d-8934f5478952" (UID: "2c6a2835-2c28-4db4-8e3d-8934f5478952"). InnerVolumeSpecName "kube-api-access-fxmqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:55.104742 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:55.104716    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c6a2835-2c28-4db4-8e3d-8934f5478952-metrics-certs" pod "2c6a2835-2c28-4db4-8e3d-8934f5478952" (UID: "2c6a2835-2c28-4db4-8e3d-8934f5478952"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:57:55.126401 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:55.126366    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"
Oct 30 23:57:55.126525 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:55.126388    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr" event={"ID":"2c6a2835-2c28-4db4-8e3d-8934f5478952","Type":"ContainerDied","Data":"d50611e1f67acb98925023d622a4c9aba4d1e786a725e370dce4d15056a191b8"}
Oct 30 23:57:55.126525 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:55.126465    4921 scope.go:122] "RemoveContainer" containerID="4a6f3fb711e0c7c91d63437ed38f1851b85480c6bcd0eb4bf3b3f7ea545c0aac"
Oct 30 23:57:55.162577 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:55.162545    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"]
Oct 30 23:57:55.170933 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:55.170909    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr"]
Oct 30 23:57:55.203737 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:55.203708    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxmqv\" (UniqueName: \"kubernetes.io/projected/2c6a2835-2c28-4db4-8e3d-8934f5478952-kube-api-access-fxmqv\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:55.203737 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:55.203731    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c6a2835-2c28-4db4-8e3d-8934f5478952-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:55.203899 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:55.203741    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c6a2835-2c28-4db4-8e3d-8934f5478952-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:55.794909 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:55.794873    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:55.969922 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:55.969893    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:56.831108 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.828918    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:57:56.885628 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.876324    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:57:56.903358 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.901375    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2c6a2835-2c28-4db4-8e3d-8934f5478952" path="/var/lib/kubelet/pods/2c6a2835-2c28-4db4-8e3d-8934f5478952/volumes"
Oct 30 23:57:56.936800 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.936778    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:57:56.988018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.986790    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dedc712d-832a-4a02-bbd6-83a7d728835c-kube-api-access-kbvz9\" (UniqueName: \"kubernetes.io/projected/dedc712d-832a-4a02-bbd6-83a7d728835c-kube-api-access-kbvz9\") pod \"dedc712d-832a-4a02-bbd6-83a7d728835c\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") "
Oct 30 23:57:56.988018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.986862    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-credential-socket\") pod \"67756018-6320-4b57-9c9d-5087aae29907\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") "
Oct 30 23:57:56.988018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.987023    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-podinfo\") pod \"dedc712d-832a-4a02-bbd6-83a7d728835c\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") "
Oct 30 23:57:56.988018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.987060    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dedc712d-832a-4a02-bbd6-83a7d728835c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dedc712d-832a-4a02-bbd6-83a7d728835c-istiod-ca-cert\") pod \"dedc712d-832a-4a02-bbd6-83a7d728835c\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") "
Oct 30 23:57:56.988018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.987152    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-credential-socket" pod "67756018-6320-4b57-9c9d-5087aae29907" (UID: "67756018-6320-4b57-9c9d-5087aae29907"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:56.988018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.987162    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-data\") pod \"dedc712d-832a-4a02-bbd6-83a7d728835c\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") "
Oct 30 23:57:56.988018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.987250    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-istio-envoy\") pod \"67756018-6320-4b57-9c9d-5087aae29907\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") "
Oct 30 23:57:56.988018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.987374    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/67756018-6320-4b57-9c9d-5087aae29907-kube-api-access-wct9v\" (UniqueName: \"kubernetes.io/projected/67756018-6320-4b57-9c9d-5087aae29907-kube-api-access-wct9v\") pod \"67756018-6320-4b57-9c9d-5087aae29907\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") "
Oct 30 23:57:56.988018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.987459    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-istio-data\") pod \"67756018-6320-4b57-9c9d-5087aae29907\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") "
Oct 30 23:57:56.988018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.987511    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/67756018-6320-4b57-9c9d-5087aae29907-istio-token\" (UniqueName: \"kubernetes.io/projected/67756018-6320-4b57-9c9d-5087aae29907-istio-token\") pod \"67756018-6320-4b57-9c9d-5087aae29907\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") "
Oct 30 23:57:56.988018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.987625    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/67756018-6320-4b57-9c9d-5087aae29907-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67756018-6320-4b57-9c9d-5087aae29907-istio-podinfo\") pod \"67756018-6320-4b57-9c9d-5087aae29907\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") "
Oct 30 23:57:56.988018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.987663    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/67756018-6320-4b57-9c9d-5087aae29907-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67756018-6320-4b57-9c9d-5087aae29907-istiod-ca-cert\") pod \"67756018-6320-4b57-9c9d-5087aae29907\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") "
Oct 30 23:57:56.988018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.987788    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-envoy\") pod \"dedc712d-832a-4a02-bbd6-83a7d728835c\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") "
Oct 30 23:57:56.988018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.987845    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-token\" (UniqueName: \"kubernetes.io/projected/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-token\") pod \"dedc712d-832a-4a02-bbd6-83a7d728835c\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") "
Oct 30 23:57:56.988018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.987926    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-workload-socket\") pod \"dedc712d-832a-4a02-bbd6-83a7d728835c\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") "
Oct 30 23:57:56.988018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.987973    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-credential-socket\") pod \"dedc712d-832a-4a02-bbd6-83a7d728835c\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") "
Oct 30 23:57:56.988018 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.988027    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-workload-certs\") pod \"dedc712d-832a-4a02-bbd6-83a7d728835c\" (UID: \"dedc712d-832a-4a02-bbd6-83a7d728835c\") "
Oct 30 23:57:56.989538 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.988167    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-workload-socket\") pod \"67756018-6320-4b57-9c9d-5087aae29907\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") "
Oct 30 23:57:56.989538 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.988274    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-workload-certs\") pod \"67756018-6320-4b57-9c9d-5087aae29907\" (UID: \"67756018-6320-4b57-9c9d-5087aae29907\") "
Oct 30 23:57:56.990709 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.989803    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:56.990709 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.990064    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-workload-certs" pod "67756018-6320-4b57-9c9d-5087aae29907" (UID: "67756018-6320-4b57-9c9d-5087aae29907"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:56.991001 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.990975    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-istio-data" pod "67756018-6320-4b57-9c9d-5087aae29907" (UID: "67756018-6320-4b57-9c9d-5087aae29907"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:56.991295 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.991274    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dedc712d-832a-4a02-bbd6-83a7d728835c-istiod-ca-cert" pod "dedc712d-832a-4a02-bbd6-83a7d728835c" (UID: "dedc712d-832a-4a02-bbd6-83a7d728835c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:57:56.993096 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.992384    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-data" pod "dedc712d-832a-4a02-bbd6-83a7d728835c" (UID: "dedc712d-832a-4a02-bbd6-83a7d728835c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:56.994006 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.993959    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67756018-6320-4b57-9c9d-5087aae29907-istiod-ca-cert" pod "67756018-6320-4b57-9c9d-5087aae29907" (UID: "67756018-6320-4b57-9c9d-5087aae29907"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:57:56.994108 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.994037    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-workload-socket" pod "dedc712d-832a-4a02-bbd6-83a7d728835c" (UID: "dedc712d-832a-4a02-bbd6-83a7d728835c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:56.994363 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.994342    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-workload-certs" pod "dedc712d-832a-4a02-bbd6-83a7d728835c" (UID: "dedc712d-832a-4a02-bbd6-83a7d728835c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:56.994652 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.994616    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-workload-socket" pod "67756018-6320-4b57-9c9d-5087aae29907" (UID: "67756018-6320-4b57-9c9d-5087aae29907"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:56.994652 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.992765    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-credential-socket" pod "dedc712d-832a-4a02-bbd6-83a7d728835c" (UID: "dedc712d-832a-4a02-bbd6-83a7d728835c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:56.995301 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.995184    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-istio-envoy" pod "67756018-6320-4b57-9c9d-5087aae29907" (UID: "67756018-6320-4b57-9c9d-5087aae29907"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:56.995301 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.995253    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67756018-6320-4b57-9c9d-5087aae29907-istio-token" pod "67756018-6320-4b57-9c9d-5087aae29907" (UID: "67756018-6320-4b57-9c9d-5087aae29907"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:56.995301 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.995274    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-envoy" pod "dedc712d-832a-4a02-bbd6-83a7d728835c" (UID: "dedc712d-832a-4a02-bbd6-83a7d728835c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:56.995495 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.995334    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-podinfo" pod "dedc712d-832a-4a02-bbd6-83a7d728835c" (UID: "dedc712d-832a-4a02-bbd6-83a7d728835c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:57:56.995698 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.995675    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67756018-6320-4b57-9c9d-5087aae29907-kube-api-access-wct9v" pod "67756018-6320-4b57-9c9d-5087aae29907" (UID: "67756018-6320-4b57-9c9d-5087aae29907"). InnerVolumeSpecName "kube-api-access-wct9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:56.997013 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.996985    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67756018-6320-4b57-9c9d-5087aae29907-istio-podinfo" pod "67756018-6320-4b57-9c9d-5087aae29907" (UID: "67756018-6320-4b57-9c9d-5087aae29907"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:57:56.997327 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.997305    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-token" pod "dedc712d-832a-4a02-bbd6-83a7d728835c" (UID: "dedc712d-832a-4a02-bbd6-83a7d728835c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:56.998019 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:56.997972    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dedc712d-832a-4a02-bbd6-83a7d728835c-kube-api-access-kbvz9" pod "dedc712d-832a-4a02-bbd6-83a7d728835c" (UID: "dedc712d-832a-4a02-bbd6-83a7d728835c"). InnerVolumeSpecName "kube-api-access-kbvz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:57.047703 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.047671    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:57:57.091213 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.091175    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-credential-socket\") pod \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") "
Oct 30 23:57:57.091426 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.091305    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istiod-ca-cert\") pod \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") "
Oct 30 23:57:57.091426 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.091380    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-kube-api-access-9sfh7\" (UniqueName: \"kubernetes.io/projected/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-kube-api-access-9sfh7\") pod \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") "
Oct 30 23:57:57.091566 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.091454    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-data\") pod \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") "
Oct 30 23:57:57.091566 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.091479    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-workload-socket\") pod \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") "
Oct 30 23:57:57.091566 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.091511    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-podinfo\") pod \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") "
Oct 30 23:57:57.091799 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.091775    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-workload-certs\") pod \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") "
Oct 30 23:57:57.091951 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.091926    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-envoy\") pod \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") "
Oct 30 23:57:57.092091 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.092068    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-token\" (UniqueName: \"kubernetes.io/projected/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-token\") pod \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\" (UID: \"6923aee3-e3d4-4aac-8b12-7815ea7e2afc\") "
Oct 30 23:57:57.093119 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.093088    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wct9v\" (UniqueName: \"kubernetes.io/projected/67756018-6320-4b57-9c9d-5087aae29907-kube-api-access-wct9v\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.093242 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.093124    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.093242 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.093139    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67756018-6320-4b57-9c9d-5087aae29907-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.093242 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.093155    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67756018-6320-4b57-9c9d-5087aae29907-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.093242 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.093170    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67756018-6320-4b57-9c9d-5087aae29907-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.093242 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.093184    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.093242 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.093198    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.093242 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.093211    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.093242 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.093224    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.093242 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.093237    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.093796 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.093251    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.093796 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.093266    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.093796 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.093278    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbvz9\" (UniqueName: \"kubernetes.io/projected/dedc712d-832a-4a02-bbd6-83a7d728835c-kube-api-access-kbvz9\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.093796 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.093292    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.093796 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.093306    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dedc712d-832a-4a02-bbd6-83a7d728835c-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.093796 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.093318    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dedc712d-832a-4a02-bbd6-83a7d728835c-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.093796 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.093331    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67756018-6320-4b57-9c9d-5087aae29907-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.093796 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.091922    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-workload-socket" pod "6923aee3-e3d4-4aac-8b12-7815ea7e2afc" (UID: "6923aee3-e3d4-4aac-8b12-7815ea7e2afc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:57.093796 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.092490    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-data" pod "6923aee3-e3d4-4aac-8b12-7815ea7e2afc" (UID: "6923aee3-e3d4-4aac-8b12-7815ea7e2afc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:57.093796 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.092907    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istiod-ca-cert" pod "6923aee3-e3d4-4aac-8b12-7815ea7e2afc" (UID: "6923aee3-e3d4-4aac-8b12-7815ea7e2afc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:57:57.097126 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.093842    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-workload-certs" pod "6923aee3-e3d4-4aac-8b12-7815ea7e2afc" (UID: "6923aee3-e3d4-4aac-8b12-7815ea7e2afc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:57.097126 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.094251    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-credential-socket" pod "6923aee3-e3d4-4aac-8b12-7815ea7e2afc" (UID: "6923aee3-e3d4-4aac-8b12-7815ea7e2afc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:57.097126 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.096830    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-token" pod "6923aee3-e3d4-4aac-8b12-7815ea7e2afc" (UID: "6923aee3-e3d4-4aac-8b12-7815ea7e2afc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:57.097360 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.097268    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-kube-api-access-9sfh7" pod "6923aee3-e3d4-4aac-8b12-7815ea7e2afc" (UID: "6923aee3-e3d4-4aac-8b12-7815ea7e2afc"). InnerVolumeSpecName "kube-api-access-9sfh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:57.097708 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.097672    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-podinfo" pod "6923aee3-e3d4-4aac-8b12-7815ea7e2afc" (UID: "6923aee3-e3d4-4aac-8b12-7815ea7e2afc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:57:57.098221 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.098192    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-envoy" pod "6923aee3-e3d4-4aac-8b12-7815ea7e2afc" (UID: "6923aee3-e3d4-4aac-8b12-7815ea7e2afc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:57.141655 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.141618    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:57.207141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.203933    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-istio-envoy\") pod \"31849433-47df-48bc-87c0-903660560055\" (UID: \"31849433-47df-48bc-87c0-903660560055\") "
Oct 30 23:57:57.207141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.204059    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-credential-socket\") pod \"31849433-47df-48bc-87c0-903660560055\" (UID: \"31849433-47df-48bc-87c0-903660560055\") "
Oct 30 23:57:57.207141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.204168    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-workload-socket\") pod \"31849433-47df-48bc-87c0-903660560055\" (UID: \"31849433-47df-48bc-87c0-903660560055\") "
Oct 30 23:57:57.207141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.204269    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/31849433-47df-48bc-87c0-903660560055-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31849433-47df-48bc-87c0-903660560055-istiod-ca-cert\") pod \"31849433-47df-48bc-87c0-903660560055\" (UID: \"31849433-47df-48bc-87c0-903660560055\") "
Oct 30 23:57:57.207141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.204404    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-istio-data\") pod \"31849433-47df-48bc-87c0-903660560055\" (UID: \"31849433-47df-48bc-87c0-903660560055\") "
Oct 30 23:57:57.207141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.204535    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/31849433-47df-48bc-87c0-903660560055-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31849433-47df-48bc-87c0-903660560055-istio-podinfo\") pod \"31849433-47df-48bc-87c0-903660560055\" (UID: \"31849433-47df-48bc-87c0-903660560055\") "
Oct 30 23:57:57.207141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.204560    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-workload-certs\") pod \"31849433-47df-48bc-87c0-903660560055\" (UID: \"31849433-47df-48bc-87c0-903660560055\") "
Oct 30 23:57:57.207141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.204663    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31849433-47df-48bc-87c0-903660560055-kube-api-access-nk9pv\" (UniqueName: \"kubernetes.io/projected/31849433-47df-48bc-87c0-903660560055-kube-api-access-nk9pv\") pod \"31849433-47df-48bc-87c0-903660560055\" (UID: \"31849433-47df-48bc-87c0-903660560055\") "
Oct 30 23:57:57.207141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.204736    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31849433-47df-48bc-87c0-903660560055-istio-token\" (UniqueName: \"kubernetes.io/projected/31849433-47df-48bc-87c0-903660560055-istio-token\") pod \"31849433-47df-48bc-87c0-903660560055\" (UID: \"31849433-47df-48bc-87c0-903660560055\") "
Oct 30 23:57:57.207141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.205861    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.207141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.205888    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.207141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.205903    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.207141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.205919    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.207141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.205934    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.207141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.205950    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sfh7\" (UniqueName: \"kubernetes.io/projected/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-kube-api-access-9sfh7\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.207141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.205964    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.207141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.205977    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.207141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.205991    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6923aee3-e3d4-4aac-8b12-7815ea7e2afc-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.207141 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.206764    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31849433-47df-48bc-87c0-903660560055-istiod-ca-cert" pod "31849433-47df-48bc-87c0-903660560055" (UID: "31849433-47df-48bc-87c0-903660560055"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:57:57.233641 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.220579    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-istio-data" pod "31849433-47df-48bc-87c0-903660560055" (UID: "31849433-47df-48bc-87c0-903660560055"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:57.233641 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.220835    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-credential-socket" pod "31849433-47df-48bc-87c0-903660560055" (UID: "31849433-47df-48bc-87c0-903660560055"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:57.233641 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.221005    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-workload-socket" pod "31849433-47df-48bc-87c0-903660560055" (UID: "31849433-47df-48bc-87c0-903660560055"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:57.233641 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.233559    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-workload-certs" pod "31849433-47df-48bc-87c0-903660560055" (UID: "31849433-47df-48bc-87c0-903660560055"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:57.302161 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.298267    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31849433-47df-48bc-87c0-903660560055-kube-api-access-nk9pv" pod "31849433-47df-48bc-87c0-903660560055" (UID: "31849433-47df-48bc-87c0-903660560055"). InnerVolumeSpecName "kube-api-access-nk9pv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:57.310657 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.308837    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-istio-envoy" pod "31849433-47df-48bc-87c0-903660560055" (UID: "31849433-47df-48bc-87c0-903660560055"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:57:57.310657 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.310519    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.310657 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.310551    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk9pv\" (UniqueName: \"kubernetes.io/projected/31849433-47df-48bc-87c0-903660560055-kube-api-access-nk9pv\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.310657 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.310567    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.310657 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.310581    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.311549 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.311102    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.311549 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.311131    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31849433-47df-48bc-87c0-903660560055-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.311549 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.311145    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31849433-47df-48bc-87c0-903660560055-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.313699 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.313654    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31849433-47df-48bc-87c0-903660560055-istio-token" pod "31849433-47df-48bc-87c0-903660560055" (UID: "31849433-47df-48bc-87c0-903660560055"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:57:57.344489 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.322721    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31849433-47df-48bc-87c0-903660560055-istio-podinfo" pod "31849433-47df-48bc-87c0-903660560055" (UID: "31849433-47df-48bc-87c0-903660560055"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:57:57.408826 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.408782    4921 generic.go:356] "Generic (PLEG): container finished" podID="dedc712d-832a-4a02-bbd6-83a7d728835c" containerID="a60500426d00451bc572110c0531e063d5002eee389b112992b7a9a7fdbd8560" exitCode=0
Oct 30 23:57:57.409069 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.409048    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"
Oct 30 23:57:57.409242 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.408965    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn" event={"ID":"dedc712d-832a-4a02-bbd6-83a7d728835c","Type":"ContainerDied","Data":"a60500426d00451bc572110c0531e063d5002eee389b112992b7a9a7fdbd8560"}
Oct 30 23:57:57.409394 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.409368    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn" event={"ID":"dedc712d-832a-4a02-bbd6-83a7d728835c","Type":"ContainerDied","Data":"8abe0e83afc5946b51c80efb29158d0da298c4f5db331d641c6e4cb3a9e3575e"}
Oct 30 23:57:57.409643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.409495    4921 scope.go:122] "RemoveContainer" containerID="a60500426d00451bc572110c0531e063d5002eee389b112992b7a9a7fdbd8560"
Oct 30 23:57:57.418348 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.418326    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31849433-47df-48bc-87c0-903660560055-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.418969 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.418946    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31849433-47df-48bc-87c0-903660560055-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:57:57.423662 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.423563    4921 generic.go:356] "Generic (PLEG): container finished" podID="31849433-47df-48bc-87c0-903660560055" containerID="a32a2a13e914be4b03a146c58733e49e61cb7a2c854ae6fdc797318d640a6232" exitCode=0
Oct 30 23:57:57.424824 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.423989    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq" event={"ID":"31849433-47df-48bc-87c0-903660560055","Type":"ContainerDied","Data":"a32a2a13e914be4b03a146c58733e49e61cb7a2c854ae6fdc797318d640a6232"}
Oct 30 23:57:57.424914 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.424885    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq" event={"ID":"31849433-47df-48bc-87c0-903660560055","Type":"ContainerDied","Data":"bab3c6d002351de24f30654f56c6d50df7c3c70d94a0dac1b09f69dc7c320499"}
Oct 30 23:57:57.424914 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.424824    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"
Oct 30 23:57:57.428443 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.427709    4921 generic.go:356] "Generic (PLEG): container finished" podID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerID="bf9196c0c339cb385b852e11e2e7be7a2187f68e0e79cf376a84fac3d9e68ae4" exitCode=0
Oct 30 23:57:57.428443 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.427797    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" event={"ID":"6923aee3-e3d4-4aac-8b12-7815ea7e2afc","Type":"ContainerDied","Data":"bf9196c0c339cb385b852e11e2e7be7a2187f68e0e79cf376a84fac3d9e68ae4"}
Oct 30 23:57:57.428443 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.427838    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9" event={"ID":"6923aee3-e3d4-4aac-8b12-7815ea7e2afc","Type":"ContainerDied","Data":"25deeeeed05e590b56b1d9fe58d955344a47450224f336ce55cad2f155527b5a"}
Oct 30 23:57:57.428443 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.427917    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"
Oct 30 23:57:57.435956 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.435925    4921 generic.go:356] "Generic (PLEG): container finished" podID="67756018-6320-4b57-9c9d-5087aae29907" containerID="c71954f68fb773e46fbb1ab2215b5db67b9f0c2a99193d6e5965ff1f21acf460" exitCode=0
Oct 30 23:57:57.436072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.436023    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt" event={"ID":"67756018-6320-4b57-9c9d-5087aae29907","Type":"ContainerDied","Data":"c71954f68fb773e46fbb1ab2215b5db67b9f0c2a99193d6e5965ff1f21acf460"}
Oct 30 23:57:57.436072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.436060    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt" event={"ID":"67756018-6320-4b57-9c9d-5087aae29907","Type":"ContainerDied","Data":"dc49cfd256cc90aa60c828d2229e90643a7b2f4c759805fa648a0a5d96deb38c"}
Oct 30 23:57:57.436196 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.436168    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"
Oct 30 23:57:57.462849 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.462824    4921 scope.go:122] "RemoveContainer" containerID="a60500426d00451bc572110c0531e063d5002eee389b112992b7a9a7fdbd8560"
Oct 30 23:57:57.463228 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:57:57.463192    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a60500426d00451bc572110c0531e063d5002eee389b112992b7a9a7fdbd8560\": container with ID starting with a60500426d00451bc572110c0531e063d5002eee389b112992b7a9a7fdbd8560 not found: ID does not exist" containerID="a60500426d00451bc572110c0531e063d5002eee389b112992b7a9a7fdbd8560"
Oct 30 23:57:57.463383 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.463239    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a60500426d00451bc572110c0531e063d5002eee389b112992b7a9a7fdbd8560"} err="failed to get container status \"a60500426d00451bc572110c0531e063d5002eee389b112992b7a9a7fdbd8560\": rpc error: code = NotFound desc = could not find container \"a60500426d00451bc572110c0531e063d5002eee389b112992b7a9a7fdbd8560\": container with ID starting with a60500426d00451bc572110c0531e063d5002eee389b112992b7a9a7fdbd8560 not found: ID does not exist"
Oct 30 23:57:57.463383 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.463261    4921 scope.go:122] "RemoveContainer" containerID="a32a2a13e914be4b03a146c58733e49e61cb7a2c854ae6fdc797318d640a6232"
Oct 30 23:57:57.479527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.479503    4921 scope.go:122] "RemoveContainer" containerID="a32a2a13e914be4b03a146c58733e49e61cb7a2c854ae6fdc797318d640a6232"
Oct 30 23:57:57.479955 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:57:57.479926    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a32a2a13e914be4b03a146c58733e49e61cb7a2c854ae6fdc797318d640a6232\": container with ID starting with a32a2a13e914be4b03a146c58733e49e61cb7a2c854ae6fdc797318d640a6232 not found: ID does not exist" containerID="a32a2a13e914be4b03a146c58733e49e61cb7a2c854ae6fdc797318d640a6232"
Oct 30 23:57:57.480074 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.479969    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a32a2a13e914be4b03a146c58733e49e61cb7a2c854ae6fdc797318d640a6232"} err="failed to get container status \"a32a2a13e914be4b03a146c58733e49e61cb7a2c854ae6fdc797318d640a6232\": rpc error: code = NotFound desc = could not find container \"a32a2a13e914be4b03a146c58733e49e61cb7a2c854ae6fdc797318d640a6232\": container with ID starting with a32a2a13e914be4b03a146c58733e49e61cb7a2c854ae6fdc797318d640a6232 not found: ID does not exist"
Oct 30 23:57:57.480074 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.479993    4921 scope.go:122] "RemoveContainer" containerID="bf9196c0c339cb385b852e11e2e7be7a2187f68e0e79cf376a84fac3d9e68ae4"
Oct 30 23:57:57.491387 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.491362    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"]
Oct 30 23:57:57.497109 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.497079    4921 scope.go:122] "RemoveContainer" containerID="bf9196c0c339cb385b852e11e2e7be7a2187f68e0e79cf376a84fac3d9e68ae4"
Oct 30 23:57:57.497788 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:57:57.497587    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf9196c0c339cb385b852e11e2e7be7a2187f68e0e79cf376a84fac3d9e68ae4\": container with ID starting with bf9196c0c339cb385b852e11e2e7be7a2187f68e0e79cf376a84fac3d9e68ae4 not found: ID does not exist" containerID="bf9196c0c339cb385b852e11e2e7be7a2187f68e0e79cf376a84fac3d9e68ae4"
Oct 30 23:57:57.497788 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.497669    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf9196c0c339cb385b852e11e2e7be7a2187f68e0e79cf376a84fac3d9e68ae4"} err="failed to get container status \"bf9196c0c339cb385b852e11e2e7be7a2187f68e0e79cf376a84fac3d9e68ae4\": rpc error: code = NotFound desc = could not find container \"bf9196c0c339cb385b852e11e2e7be7a2187f68e0e79cf376a84fac3d9e68ae4\": container with ID starting with bf9196c0c339cb385b852e11e2e7be7a2187f68e0e79cf376a84fac3d9e68ae4 not found: ID does not exist"
Oct 30 23:57:57.497788 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.497692    4921 scope.go:122] "RemoveContainer" containerID="c71954f68fb773e46fbb1ab2215b5db67b9f0c2a99193d6e5965ff1f21acf460"
Oct 30 23:57:57.498870 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.498843    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-j2znn"]
Oct 30 23:57:57.512434 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.512392    4921 scope.go:122] "RemoveContainer" containerID="c71954f68fb773e46fbb1ab2215b5db67b9f0c2a99193d6e5965ff1f21acf460"
Oct 30 23:57:57.512868 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:57:57.512840    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c71954f68fb773e46fbb1ab2215b5db67b9f0c2a99193d6e5965ff1f21acf460\": container with ID starting with c71954f68fb773e46fbb1ab2215b5db67b9f0c2a99193d6e5965ff1f21acf460 not found: ID does not exist" containerID="c71954f68fb773e46fbb1ab2215b5db67b9f0c2a99193d6e5965ff1f21acf460"
Oct 30 23:57:57.512991 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.512877    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c71954f68fb773e46fbb1ab2215b5db67b9f0c2a99193d6e5965ff1f21acf460"} err="failed to get container status \"c71954f68fb773e46fbb1ab2215b5db67b9f0c2a99193d6e5965ff1f21acf460\": rpc error: code = NotFound desc = could not find container \"c71954f68fb773e46fbb1ab2215b5db67b9f0c2a99193d6e5965ff1f21acf460\": container with ID starting with c71954f68fb773e46fbb1ab2215b5db67b9f0c2a99193d6e5965ff1f21acf460 not found: ID does not exist"
Oct 30 23:57:57.514044 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.514023    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"]
Oct 30 23:57:57.521580 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.521553    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-klvmq"]
Oct 30 23:57:57.534817 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.534755    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"]
Oct 30 23:57:57.551324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.551295    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-xfvh9"]
Oct 30 23:57:57.564039 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.563950    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"]
Oct 30 23:57:57.568606 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.568567    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-86kbt"]
Oct 30 23:57:57.830092 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:57.830001    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-df3b5f-56f66cc4cf-hrldr" podUID="2c6a2835-2c28-4db4-8e3d-8934f5478952" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.156:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:57:58.226645 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:58.226587    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:57:58.768342 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:58.768316    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6"
Oct 30 23:57:58.889284 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:58.889249    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="31849433-47df-48bc-87c0-903660560055" path="/var/lib/kubelet/pods/31849433-47df-48bc-87c0-903660560055/volumes"
Oct 30 23:57:58.889999 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:58.889972    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="67756018-6320-4b57-9c9d-5087aae29907" path="/var/lib/kubelet/pods/67756018-6320-4b57-9c9d-5087aae29907/volumes"
Oct 30 23:57:58.890679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:58.890644    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" path="/var/lib/kubelet/pods/6923aee3-e3d4-4aac-8b12-7815ea7e2afc/volumes"
Oct 30 23:57:58.891800 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:58.891782    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dedc712d-832a-4a02-bbd6-83a7d728835c" path="/var/lib/kubelet/pods/dedc712d-832a-4a02-bbd6-83a7d728835c/volumes"
Oct 30 23:57:59.769654 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:57:59.758963    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:00.804900 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:00.804869    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5"
Oct 30 23:58:01.079327 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:01.079250    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:01.691423 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:01.691376    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:01.820782 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:01.820751    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:01.961726 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:01.960101    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:02.201634 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:02.184462    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:02.932460 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:02.932421    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:03.827071 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:03.827035    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:04.863818 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:04.857270    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:05.811002 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:05.810973    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:06.642016 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:06.641984    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:06.768996 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:06.768945    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:07.609712 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:07.607231    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:08.433465 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:08.432162    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:09.271086 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:09.271046    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:09.445616 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:09.439251    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:10.488384 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:10.481529    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:11.230913 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:11.230865    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:11.578676 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:58:11.562681    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:58:11.850675 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:11.848445    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:11.997908 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:11.997869    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:12.198034 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:12.197981    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:13.092468 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:13.084316    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:14.258091 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:14.258040    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:15.350015 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:15.349976    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:16.337631 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:16.335198    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:16.540305 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:16.540277    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:16.707339 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:16.707304    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:17.230288 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:17.230254    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:17.368175 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:17.368136    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:18.329398 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:18.329361    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:19.133695 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:19.133662    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:19.825438 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:19.825407    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:20.678347 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:20.678291    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:21.606614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:21.606189    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:22.699383 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:22.699348    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:23.524386 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:23.524350    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:23.747719 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:23.747686    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:23.912625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:23.912118    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:24.988421 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:24.988386    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:25.158146 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:25.158119    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:25.385035 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:25.384984    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:25.984450 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:25.984395    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:26.822875 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:26.822839    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"]
Oct 30 23:58:26.823490 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:26.823093    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms" podUID="7321904d-e556-46a4-86cb-a412438cdb71" containerName="maas-api" containerID="cri-o://03c81deee397b38cf4f085261b18ad0face5b1725eb1dcb2e789e9cf2e5bae9a" gracePeriod=30
Oct 30 23:58:26.925771 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:26.925737    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:27.249960 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:27.229085    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:27.463663 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:27.461913    4921 generic.go:356] "Generic (PLEG): container finished" podID="7321904d-e556-46a4-86cb-a412438cdb71" containerID="03c81deee397b38cf4f085261b18ad0face5b1725eb1dcb2e789e9cf2e5bae9a" exitCode=0
Oct 30 23:58:27.463663 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:27.461958    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms" event={"ID":"7321904d-e556-46a4-86cb-a412438cdb71","Type":"ContainerDied","Data":"03c81deee397b38cf4f085261b18ad0face5b1725eb1dcb2e789e9cf2e5bae9a"}
Oct 30 23:58:27.508860 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:27.508797    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"
Oct 30 23:58:27.588810 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:27.587218    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:27.589001 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:27.588925    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7321904d-e556-46a4-86cb-a412438cdb71-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7321904d-e556-46a4-86cb-a412438cdb71-maas-api-tls\") pod \"7321904d-e556-46a4-86cb-a412438cdb71\" (UID: \"7321904d-e556-46a4-86cb-a412438cdb71\") "
Oct 30 23:58:27.594630 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:27.589185    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7321904d-e556-46a4-86cb-a412438cdb71-kube-api-access-dtbxs\" (UniqueName: \"kubernetes.io/projected/7321904d-e556-46a4-86cb-a412438cdb71-kube-api-access-dtbxs\") pod \"7321904d-e556-46a4-86cb-a412438cdb71\" (UID: \"7321904d-e556-46a4-86cb-a412438cdb71\") "
Oct 30 23:58:27.594630 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:27.589313    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7321904d-e556-46a4-86cb-a412438cdb71-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7321904d-e556-46a4-86cb-a412438cdb71-metrics-certs\") pod \"7321904d-e556-46a4-86cb-a412438cdb71\" (UID: \"7321904d-e556-46a4-86cb-a412438cdb71\") "
Oct 30 23:58:27.594630 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:27.589406    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7321904d-e556-46a4-86cb-a412438cdb71-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7321904d-e556-46a4-86cb-a412438cdb71-openshift-service-ca\") pod \"7321904d-e556-46a4-86cb-a412438cdb71\" (UID: \"7321904d-e556-46a4-86cb-a412438cdb71\") "
Oct 30 23:58:27.624678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:27.615823    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7321904d-e556-46a4-86cb-a412438cdb71-openshift-service-ca" pod "7321904d-e556-46a4-86cb-a412438cdb71" (UID: "7321904d-e556-46a4-86cb-a412438cdb71"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:58:27.624678 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:27.616451    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7321904d-e556-46a4-86cb-a412438cdb71-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:58:27.634676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:27.630572    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7321904d-e556-46a4-86cb-a412438cdb71-metrics-certs" pod "7321904d-e556-46a4-86cb-a412438cdb71" (UID: "7321904d-e556-46a4-86cb-a412438cdb71"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:58:27.634676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:27.630625    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7321904d-e556-46a4-86cb-a412438cdb71-maas-api-tls" pod "7321904d-e556-46a4-86cb-a412438cdb71" (UID: "7321904d-e556-46a4-86cb-a412438cdb71"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:58:27.634676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:27.631816    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7321904d-e556-46a4-86cb-a412438cdb71-kube-api-access-dtbxs" pod "7321904d-e556-46a4-86cb-a412438cdb71" (UID: "7321904d-e556-46a4-86cb-a412438cdb71"). InnerVolumeSpecName "kube-api-access-dtbxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:58:27.776676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:27.724926    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtbxs\" (UniqueName: \"kubernetes.io/projected/7321904d-e556-46a4-86cb-a412438cdb71-kube-api-access-dtbxs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:58:27.776676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:27.770318    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7321904d-e556-46a4-86cb-a412438cdb71-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:58:27.776676 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:27.770340    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7321904d-e556-46a4-86cb-a412438cdb71-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:58:27.799002 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:27.798972    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:28.136249 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:28.136213    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:28.471810 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:28.471724    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms" event={"ID":"7321904d-e556-46a4-86cb-a412438cdb71","Type":"ContainerDied","Data":"c4bfe844df9aee01ac0ec1a169a4a92445b11605cb3d574f4bfb194ae0076614"}
Oct 30 23:58:28.471810 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:28.471778    4921 scope.go:122] "RemoveContainer" containerID="03c81deee397b38cf4f085261b18ad0face5b1725eb1dcb2e789e9cf2e5bae9a"
Oct 30 23:58:28.472027 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:28.471735    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"
Oct 30 23:58:28.524807 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:28.524778    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"]
Oct 30 23:58:28.536292 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:28.536268    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7b0299-6dcd88c54-mxvms"]
Oct 30 23:58:29.005619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:28.999842    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:29.015707 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:29.015670    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7321904d-e556-46a4-86cb-a412438cdb71" path="/var/lib/kubelet/pods/7321904d-e556-46a4-86cb-a412438cdb71/volumes"
Oct 30 23:58:29.954691 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:29.954658    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:30.152191 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:30.152160    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:30.338904 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:30.338762    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:31.422499 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:31.422462    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:32.816659 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:32.816619    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:33.260940 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:33.260910    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:34.368395 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:34.368362    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:34.805872 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:34.805834    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:35.008872 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:35.008841    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:35.915180 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:35.915130    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:36.102751 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:36.102713    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:36.285977 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:36.285869    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:36.543995 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:36.543913    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:36.846085 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:36.845991    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:37.070431 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:37.070391    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:37.545008 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:37.544973    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:38.695529 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:38.695494    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:38.887614 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:38.886184    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:39.089701 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:39.089612    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:40.079432 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:40.079386    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:41.407675 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:58:41.407587    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:58:41.478769 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:41.478727    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:42.480327 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:42.480277    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:43.320247 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:43.320212    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:44.535093 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:44.535063    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:45.849654 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:45.849583    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:47.854634 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:47.853301    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:49.013622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:48.999554    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:49.779986 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:49.779931    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:50.224284 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:50.224250    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:50.503860 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:50.503774    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:51.637619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:51.629067    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:51.877188 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:51.877152    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:52.107045 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:52.106965    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:52.593251 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:52.593220    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:52.787971 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:52.787922    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:53.769802 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:53.769738    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:53.967975 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:53.967917    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:54.574495 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:54.574457    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:54.768723 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:54.768688    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:55.327200 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:55.327126    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:55.882931 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:55.882893    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:56.424298 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:56.424259    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:57.264741 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:57.264697    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:58.466745 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:58.466686    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:58.665322 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:58.665289    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:59.247126 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:59.247093    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:59.464119 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:59.464085    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:58:59.655205 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:58:59.655153    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:00.455628 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:00.455529    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:00.768076 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:00.767841    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:01.136872 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:01.136836    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:01.358168 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:01.358127    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:01.664175 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:01.664136    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:02.004111 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:02.004026    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:02.235165 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:02.235135    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 30 23:59:02.248975 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:02.248947    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 30 23:59:02.870351 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:02.868268    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:03.862171 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:03.862132    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:04.053867 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:04.053804    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:04.191053 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:04.191021    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:04.686625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:04.686573    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:05.019916 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:05.019840    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:05.169420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:05.169384    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:05.328728 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:05.328634    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"]
Oct 30 23:59:05.328944 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:05.328916    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9" podUID="db14c4d8-1735-4c65-8565-e80c251983b7" containerName="istio-proxy" containerID="cri-o://092f570d56d33d12ce6ea25ed3a1d19dae0f0efb3a51df82f604645c9d9c4751" gracePeriod=30
Oct 30 23:59:05.331116 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:05.331081    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"]
Oct 30 23:59:05.331351 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:05.331326    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m" podUID="ed22a052-789a-4e01-a852-b17c921b386a" containerName="istio-proxy" containerID="cri-o://d1059167897ff954479bfa0cfd67a3018dd68f6e08e97f4b1ff8b6f00304a7a3" gracePeriod=30
Oct 30 23:59:05.370864 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:05.370832    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:05.969277 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:05.965451    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:06.107806 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:06.107768    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:07.410077 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:07.409112    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:08.268953 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:08.264818    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:08.914196 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:08.914134    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:09.113618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:09.109429    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:09.351256 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:09.351116    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:09.544295 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:09.544263    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:09.826168 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:09.826128    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:10.021524 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.021492    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:10.477309 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.477275    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"]
Oct 30 23:59:10.478223 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.478198    4921 cpu_manager.go:414] "containerMap: removing container" podUID="dedc712d-832a-4a02-bbd6-83a7d728835c" containerName="istio-proxy"
Oct 30 23:59:10.478223 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.478223    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dedc712d-832a-4a02-bbd6-83a7d728835c" containerName="istio-proxy"
Oct 30 23:59:10.478420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.478247    4921 cpu_manager.go:414] "containerMap: removing container" podUID="31849433-47df-48bc-87c0-903660560055" containerName="istio-proxy"
Oct 30 23:59:10.478420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.478254    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="31849433-47df-48bc-87c0-903660560055" containerName="istio-proxy"
Oct 30 23:59:10.478420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.478263    4921 cpu_manager.go:414] "containerMap: removing container" podUID="7321904d-e556-46a4-86cb-a412438cdb71" containerName="maas-api"
Oct 30 23:59:10.478420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.478269    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7321904d-e556-46a4-86cb-a412438cdb71" containerName="maas-api"
Oct 30 23:59:10.478420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.478313    4921 cpu_manager.go:414] "containerMap: removing container" podUID="67756018-6320-4b57-9c9d-5087aae29907" containerName="istio-proxy"
Oct 30 23:59:10.478420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.478320    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="67756018-6320-4b57-9c9d-5087aae29907" containerName="istio-proxy"
Oct 30 23:59:10.478420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.478341    4921 cpu_manager.go:414] "containerMap: removing container" podUID="2c6a2835-2c28-4db4-8e3d-8934f5478952" containerName="maas-api"
Oct 30 23:59:10.478420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.478348    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2c6a2835-2c28-4db4-8e3d-8934f5478952" containerName="maas-api"
Oct 30 23:59:10.478420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.478392    4921 cpu_manager.go:414] "containerMap: removing container" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy"
Oct 30 23:59:10.478420 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.478401    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy"
Oct 30 23:59:10.478983 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.478606    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="2c6a2835-2c28-4db4-8e3d-8934f5478952" containerName="maas-api"
Oct 30 23:59:10.478983 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.478633    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="6923aee3-e3d4-4aac-8b12-7815ea7e2afc" containerName="istio-proxy"
Oct 30 23:59:10.478983 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.478648    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="dedc712d-832a-4a02-bbd6-83a7d728835c" containerName="istio-proxy"
Oct 30 23:59:10.478983 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.478662    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="31849433-47df-48bc-87c0-903660560055" containerName="istio-proxy"
Oct 30 23:59:10.478983 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.478671    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="7321904d-e556-46a4-86cb-a412438cdb71" containerName="maas-api"
Oct 30 23:59:10.478983 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.478686    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="67756018-6320-4b57-9c9d-5087aae29907" containerName="istio-proxy"
Oct 30 23:59:10.485153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.485130    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.505195 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.505151    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a63288-openshift-default-dockercfg-tdk54\""
Oct 30 23:59:10.509681 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.506954    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"]
Oct 30 23:59:10.540430 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.540126    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-data\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.540430 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.540203    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-envoy\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.541545 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.540435    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8rn8\" (UniqueName: \"kubernetes.io/projected/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-kube-api-access-l8rn8\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.541545 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.540621    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-token\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.541545 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.540780    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-credential-socket\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.541545 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.540893    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istiod-ca-cert\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.541545 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.541082    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-podinfo\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.541545 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.541164    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-workload-certs\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.541545 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.541196    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-workload-socket\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.642924 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.642885    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8rn8\" (UniqueName: \"kubernetes.io/projected/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-kube-api-access-l8rn8\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.643080 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.643030    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-token\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.643132 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.643122    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-credential-socket\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.643210 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.643195    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istiod-ca-cert\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.643324 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.643307    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-podinfo\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.643369 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.643356    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-workload-certs\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.643425 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.643387    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-workload-socket\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.643486 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.643470    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-data\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.643544 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.643530    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-envoy\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.645063 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.644703    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-credential-socket\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.645063 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.644774    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-workload-certs\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.645063 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.645022    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-workload-socket\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.645063 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.645051    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-data\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.645304 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.645151    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istiod-ca-cert\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.647373 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.647294    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-envoy\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.647853 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.647827    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-podinfo\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.657084 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.657053    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8rn8\" (UniqueName: \"kubernetes.io/projected/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-kube-api-access-l8rn8\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.657855 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.657813    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-token\") pod \"e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") " pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.708894 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.708867    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:59:10.737097 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.737071    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:59:10.744472 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.744444    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ed22a052-789a-4e01-a852-b17c921b386a-istio-token\" (UniqueName: \"kubernetes.io/projected/ed22a052-789a-4e01-a852-b17c921b386a-istio-token\") pod \"ed22a052-789a-4e01-a852-b17c921b386a\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") "
Oct 30 23:59:10.744633 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.744501    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-credential-socket\") pod \"ed22a052-789a-4e01-a852-b17c921b386a\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") "
Oct 30 23:59:10.744633 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.744609    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-istio-data\") pod \"ed22a052-789a-4e01-a852-b17c921b386a\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") "
Oct 30 23:59:10.744736 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.744692    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-workload-certs\") pod \"ed22a052-789a-4e01-a852-b17c921b386a\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") "
Oct 30 23:59:10.744793 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.744745    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ed22a052-789a-4e01-a852-b17c921b386a-kube-api-access-w2pz9\" (UniqueName: \"kubernetes.io/projected/ed22a052-789a-4e01-a852-b17c921b386a-kube-api-access-w2pz9\") pod \"ed22a052-789a-4e01-a852-b17c921b386a\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") "
Oct 30 23:59:10.744882 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.744868    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-workload-socket\") pod \"ed22a052-789a-4e01-a852-b17c921b386a\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") "
Oct 30 23:59:10.744882 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.744869    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-credential-socket" pod "ed22a052-789a-4e01-a852-b17c921b386a" (UID: "ed22a052-789a-4e01-a852-b17c921b386a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:10.745001 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.744940    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ed22a052-789a-4e01-a852-b17c921b386a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed22a052-789a-4e01-a852-b17c921b386a-istiod-ca-cert\") pod \"ed22a052-789a-4e01-a852-b17c921b386a\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") "
Oct 30 23:59:10.745063 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.745006    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ed22a052-789a-4e01-a852-b17c921b386a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed22a052-789a-4e01-a852-b17c921b386a-istio-podinfo\") pod \"ed22a052-789a-4e01-a852-b17c921b386a\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") "
Oct 30 23:59:10.745121 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.745102    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-istio-envoy\") pod \"ed22a052-789a-4e01-a852-b17c921b386a\" (UID: \"ed22a052-789a-4e01-a852-b17c921b386a\") "
Oct 30 23:59:10.745246 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.745222    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-workload-socket" pod "ed22a052-789a-4e01-a852-b17c921b386a" (UID: "ed22a052-789a-4e01-a852-b17c921b386a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:10.745318 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.745248    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-workload-certs" pod "ed22a052-789a-4e01-a852-b17c921b386a" (UID: "ed22a052-789a-4e01-a852-b17c921b386a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:10.745318 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.745250    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-istio-data" pod "ed22a052-789a-4e01-a852-b17c921b386a" (UID: "ed22a052-789a-4e01-a852-b17c921b386a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:10.745726 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.745545    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed22a052-789a-4e01-a852-b17c921b386a-istiod-ca-cert" pod "ed22a052-789a-4e01-a852-b17c921b386a" (UID: "ed22a052-789a-4e01-a852-b17c921b386a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:59:10.746634 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.746570    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:10.746744 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.746732    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:10.746808 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.746751    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:10.746871 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.746834    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:10.746871 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.746850    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed22a052-789a-4e01-a852-b17c921b386a-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:10.749689 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.749496    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ed22a052-789a-4e01-a852-b17c921b386a-istio-podinfo" pod "ed22a052-789a-4e01-a852-b17c921b386a" (UID: "ed22a052-789a-4e01-a852-b17c921b386a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:59:10.749689 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.749659    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed22a052-789a-4e01-a852-b17c921b386a-kube-api-access-w2pz9" pod "ed22a052-789a-4e01-a852-b17c921b386a" (UID: "ed22a052-789a-4e01-a852-b17c921b386a"). InnerVolumeSpecName "kube-api-access-w2pz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:10.750030 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.750006    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed22a052-789a-4e01-a852-b17c921b386a-istio-token" pod "ed22a052-789a-4e01-a852-b17c921b386a" (UID: "ed22a052-789a-4e01-a852-b17c921b386a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:10.752155 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.752130    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-istio-envoy" pod "ed22a052-789a-4e01-a852-b17c921b386a" (UID: "ed22a052-789a-4e01-a852-b17c921b386a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:10.848025 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.847974    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-workload-certs\") pod \"db14c4d8-1735-4c65-8565-e80c251983b7\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") "
Oct 30 23:59:10.848245 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.848051    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-credential-socket\") pod \"db14c4d8-1735-4c65-8565-e80c251983b7\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") "
Oct 30 23:59:10.848245 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.848176    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-istio-envoy\") pod \"db14c4d8-1735-4c65-8565-e80c251983b7\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") "
Oct 30 23:59:10.848245 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.848227    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-istio-data\") pod \"db14c4d8-1735-4c65-8565-e80c251983b7\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") "
Oct 30 23:59:10.848444 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.848261    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-workload-socket\") pod \"db14c4d8-1735-4c65-8565-e80c251983b7\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") "
Oct 30 23:59:10.848444 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.848321    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db14c4d8-1735-4c65-8565-e80c251983b7-kube-api-access-f74xg\" (UniqueName: \"kubernetes.io/projected/db14c4d8-1735-4c65-8565-e80c251983b7-kube-api-access-f74xg\") pod \"db14c4d8-1735-4c65-8565-e80c251983b7\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") "
Oct 30 23:59:10.848444 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.848389    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/db14c4d8-1735-4c65-8565-e80c251983b7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db14c4d8-1735-4c65-8565-e80c251983b7-istiod-ca-cert\") pod \"db14c4d8-1735-4c65-8565-e80c251983b7\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") "
Oct 30 23:59:10.848444 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.848434    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/db14c4d8-1735-4c65-8565-e80c251983b7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db14c4d8-1735-4c65-8565-e80c251983b7-istio-podinfo\") pod \"db14c4d8-1735-4c65-8565-e80c251983b7\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") "
Oct 30 23:59:10.848695 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.848528    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db14c4d8-1735-4c65-8565-e80c251983b7-istio-token\" (UniqueName: \"kubernetes.io/projected/db14c4d8-1735-4c65-8565-e80c251983b7-istio-token\") pod \"db14c4d8-1735-4c65-8565-e80c251983b7\" (UID: \"db14c4d8-1735-4c65-8565-e80c251983b7\") "
Oct 30 23:59:10.848879 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.848854    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-istio-data" pod "db14c4d8-1735-4c65-8565-e80c251983b7" (UID: "db14c4d8-1735-4c65-8565-e80c251983b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:10.849261 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.849207    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-credential-socket" pod "db14c4d8-1735-4c65-8565-e80c251983b7" (UID: "db14c4d8-1735-4c65-8565-e80c251983b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:10.849447 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.849298    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-workload-socket" pod "db14c4d8-1735-4c65-8565-e80c251983b7" (UID: "db14c4d8-1735-4c65-8565-e80c251983b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:10.849559 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.849305    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db14c4d8-1735-4c65-8565-e80c251983b7-istiod-ca-cert" pod "db14c4d8-1735-4c65-8565-e80c251983b7" (UID: "db14c4d8-1735-4c65-8565-e80c251983b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:59:10.850314 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.850246    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:10.850492 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.850470    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-workload-certs" pod "db14c4d8-1735-4c65-8565-e80c251983b7" (UID: "db14c4d8-1735-4c65-8565-e80c251983b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:10.851169 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.851143    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed22a052-789a-4e01-a852-b17c921b386a-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:10.851279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.851177    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:10.851279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.851193    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:10.851279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.851211    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed22a052-789a-4e01-a852-b17c921b386a-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:10.851279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.851226    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db14c4d8-1735-4c65-8565-e80c251983b7-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:10.851279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.851240    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed22a052-789a-4e01-a852-b17c921b386a-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:10.851279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.851256    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2pz9\" (UniqueName: \"kubernetes.io/projected/ed22a052-789a-4e01-a852-b17c921b386a-kube-api-access-w2pz9\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:10.851279 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.851269    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:10.851802 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.851282    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:10.852034 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.852012    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:10.854089 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.854066    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-istio-envoy" pod "db14c4d8-1735-4c65-8565-e80c251983b7" (UID: "db14c4d8-1735-4c65-8565-e80c251983b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:10.857210 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.857173    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db14c4d8-1735-4c65-8565-e80c251983b7-kube-api-access-f74xg" pod "db14c4d8-1735-4c65-8565-e80c251983b7" (UID: "db14c4d8-1735-4c65-8565-e80c251983b7"). InnerVolumeSpecName "kube-api-access-f74xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:10.857762 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.857732    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/db14c4d8-1735-4c65-8565-e80c251983b7-istio-podinfo" pod "db14c4d8-1735-4c65-8565-e80c251983b7" (UID: "db14c4d8-1735-4c65-8565-e80c251983b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:59:10.864316 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.864278    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db14c4d8-1735-4c65-8565-e80c251983b7-istio-token" pod "db14c4d8-1735-4c65-8565-e80c251983b7" (UID: "db14c4d8-1735-4c65-8565-e80c251983b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:10.962422 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.962073    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f74xg\" (UniqueName: \"kubernetes.io/projected/db14c4d8-1735-4c65-8565-e80c251983b7-kube-api-access-f74xg\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:10.962422 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.962108    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db14c4d8-1735-4c65-8565-e80c251983b7-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:10.962422 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.962122    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db14c4d8-1735-4c65-8565-e80c251983b7-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:10.962422 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.962135    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db14c4d8-1735-4c65-8565-e80c251983b7-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:10.968693 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.968657    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"]
Oct 30 23:59:10.980897 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:10.980861    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"]
Oct 30 23:59:11.061770 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.059739    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:11.231655 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.224305    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"]
Oct 30 23:59:11.233037 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.232807    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:11.299627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.291116    4921 generic.go:356] "Generic (PLEG): container finished" podID="ed22a052-789a-4e01-a852-b17c921b386a" containerID="d1059167897ff954479bfa0cfd67a3018dd68f6e08e97f4b1ff8b6f00304a7a3" exitCode=0
Oct 30 23:59:11.299627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.291247    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m" event={"ID":"ed22a052-789a-4e01-a852-b17c921b386a","Type":"ContainerDied","Data":"d1059167897ff954479bfa0cfd67a3018dd68f6e08e97f4b1ff8b6f00304a7a3"}
Oct 30 23:59:11.299627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.291380    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m" event={"ID":"ed22a052-789a-4e01-a852-b17c921b386a","Type":"ContainerDied","Data":"360058a8ef24b9c03b3a65f4c398e27c7afc78f4b71d4978757b76c3de429877"}
Oct 30 23:59:11.299627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.291408    4921 scope.go:122] "RemoveContainer" containerID="d1059167897ff954479bfa0cfd67a3018dd68f6e08e97f4b1ff8b6f00304a7a3"
Oct 30 23:59:11.299627 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.291569    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"
Oct 30 23:59:11.316093 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.316059    4921 generic.go:356] "Generic (PLEG): container finished" podID="db14c4d8-1735-4c65-8565-e80c251983b7" containerID="092f570d56d33d12ce6ea25ed3a1d19dae0f0efb3a51df82f604645c9d9c4751" exitCode=0
Oct 30 23:59:11.316652 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.316618    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9" event={"ID":"db14c4d8-1735-4c65-8565-e80c251983b7","Type":"ContainerDied","Data":"092f570d56d33d12ce6ea25ed3a1d19dae0f0efb3a51df82f604645c9d9c4751"}
Oct 30 23:59:11.316880 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.316850    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9" event={"ID":"db14c4d8-1735-4c65-8565-e80c251983b7","Type":"ContainerDied","Data":"3a05ebdd27aae55dc2e6ad1d7e693fd27f0c0a5c3da07a37c1af1a8413bd53f0"}
Oct 30 23:59:11.317145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.317092    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"
Oct 30 23:59:11.333570 ip-10-0-142-208 kubenswrapper[4921]: W1030 23:59:11.328491    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd03ea95f_d19c_4bad_bc60_2a4eb9ba2b13.slice/crio-c2a6f9f57b425ea8866403eeabb040f498fa8bdc67cd18999bf0121188d50011 WatchSource:0}: Error finding container c2a6f9f57b425ea8866403eeabb040f498fa8bdc67cd18999bf0121188d50011: Status 404 returned error can't find the container with id c2a6f9f57b425ea8866403eeabb040f498fa8bdc67cd18999bf0121188d50011
Oct 30 23:59:11.333570 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.332668    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:59:11.333570 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.332756    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:59:11.333570 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.332795    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 30 23:59:11.392645 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.388867    4921 scope.go:122] "RemoveContainer" containerID="d1059167897ff954479bfa0cfd67a3018dd68f6e08e97f4b1ff8b6f00304a7a3"
Oct 30 23:59:11.392645 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:59:11.389236    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1059167897ff954479bfa0cfd67a3018dd68f6e08e97f4b1ff8b6f00304a7a3\": container with ID starting with d1059167897ff954479bfa0cfd67a3018dd68f6e08e97f4b1ff8b6f00304a7a3 not found: ID does not exist" containerID="d1059167897ff954479bfa0cfd67a3018dd68f6e08e97f4b1ff8b6f00304a7a3"
Oct 30 23:59:11.392645 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.389271    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1059167897ff954479bfa0cfd67a3018dd68f6e08e97f4b1ff8b6f00304a7a3"} err="failed to get container status \"d1059167897ff954479bfa0cfd67a3018dd68f6e08e97f4b1ff8b6f00304a7a3\": rpc error: code = NotFound desc = could not find container \"d1059167897ff954479bfa0cfd67a3018dd68f6e08e97f4b1ff8b6f00304a7a3\": container with ID starting with d1059167897ff954479bfa0cfd67a3018dd68f6e08e97f4b1ff8b6f00304a7a3 not found: ID does not exist"
Oct 30 23:59:11.392645 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.389294    4921 scope.go:122] "RemoveContainer" containerID="092f570d56d33d12ce6ea25ed3a1d19dae0f0efb3a51df82f604645c9d9c4751"
Oct 30 23:59:11.392645 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.390784    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"]
Oct 30 23:59:11.427833 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.420944    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-lsj6m"]
Oct 30 23:59:11.427833 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:59:11.425449    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:59:11.428821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.428791    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"]
Oct 30 23:59:11.433640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.433622    4921 scope.go:122] "RemoveContainer" containerID="092f570d56d33d12ce6ea25ed3a1d19dae0f0efb3a51df82f604645c9d9c4751"
Oct 30 23:59:11.433974 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:59:11.433953    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"092f570d56d33d12ce6ea25ed3a1d19dae0f0efb3a51df82f604645c9d9c4751\": container with ID starting with 092f570d56d33d12ce6ea25ed3a1d19dae0f0efb3a51df82f604645c9d9c4751 not found: ID does not exist" containerID="092f570d56d33d12ce6ea25ed3a1d19dae0f0efb3a51df82f604645c9d9c4751"
Oct 30 23:59:11.434047 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.433986    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"092f570d56d33d12ce6ea25ed3a1d19dae0f0efb3a51df82f604645c9d9c4751"} err="failed to get container status \"092f570d56d33d12ce6ea25ed3a1d19dae0f0efb3a51df82f604645c9d9c4751\": rpc error: code = NotFound desc = could not find container \"092f570d56d33d12ce6ea25ed3a1d19dae0f0efb3a51df82f604645c9d9c4751\": container with ID starting with 092f570d56d33d12ce6ea25ed3a1d19dae0f0efb3a51df82f604645c9d9c4751 not found: ID does not exist"
Oct 30 23:59:11.434872 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.434855    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-23f75e-openshift-default-79bf5db5cc-smkr9"]
Oct 30 23:59:11.935856 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:11.935817    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:12.332910 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:12.332810    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w" event={"ID":"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13","Type":"ContainerStarted","Data":"6c5080699bba2b52dfe1aead592ea185090909eb9ad91cd8bb1cedfcd46e56b6"}
Oct 30 23:59:12.332910 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:12.332882    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w" event={"ID":"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13","Type":"ContainerStarted","Data":"c2a6f9f57b425ea8866403eeabb040f498fa8bdc67cd18999bf0121188d50011"}
Oct 30 23:59:12.367532 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:12.367448    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w" podStartSLOduration=2.367430998 podStartE2EDuration="2.367430998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:59:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:59:12.366412877 +0000 UTC m=+2411.611268647" watchObservedRunningTime="2026-10-30 23:59:12.367430998 +0000 UTC m=+2411.612286766"
Oct 30 23:59:12.415455 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:12.415409    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:12.592821 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:12.592630    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:12.864674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:12.856194    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:12.864674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:12.856321    4921 patch_prober.go:29] interesting pod/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.160:15021/healthz/ready\": dial tcp 10.132.0.160:15021: connect: connection refused" start-of-body=
Oct 30 23:59:12.864674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:12.856380    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w" podUID="d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.160:15021/healthz/ready\": dial tcp 10.132.0.160:15021: connect: connection refused"
Oct 30 23:59:13.007620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:13.007481    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="db14c4d8-1735-4c65-8565-e80c251983b7" path="/var/lib/kubelet/pods/db14c4d8-1735-4c65-8565-e80c251983b7/volumes"
Oct 30 23:59:13.018617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:13.008417    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ed22a052-789a-4e01-a852-b17c921b386a" path="/var/lib/kubelet/pods/ed22a052-789a-4e01-a852-b17c921b386a/volumes"
Oct 30 23:59:13.123873 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:13.123745    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:13.336622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:13.321241    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:13.463519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:13.463456    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"]
Oct 30 23:59:13.463820 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:13.463722    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7" podUID="b4f6ed81-049f-42b9-8b90-244d5598728b" containerName="istio-proxy" containerID="cri-o://2b2770832170a0f8179584aa16024d601bd1c90e3c61e80bc582600fa12e2e76" gracePeriod=30
Oct 30 23:59:13.626543 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:13.621904    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:13.879675 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:13.878748    4921 patch_prober.go:29] interesting pod/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.160:15021/healthz/ready\": dial tcp 10.132.0.160:15021: connect: connection refused" start-of-body=
Oct 30 23:59:13.879675 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:13.878817    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w" podUID="d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.160:15021/healthz/ready\": dial tcp 10.132.0.160:15021: connect: connection refused"
Oct 30 23:59:14.051245 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:14.051213    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:14.252373 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:14.252335    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"]
Oct 30 23:59:14.252581 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:14.252557    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb" podUID="6bc80c1d-4e70-4ece-a26c-42c76131a6af" containerName="maas-api" containerID="cri-o://95191e897ba831396876037f59ea068c3d0c021735bb982157e0356ebd8a3e74" gracePeriod=30
Oct 30 23:59:14.450105 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:14.450071    4921 generic.go:356] "Generic (PLEG): container finished" podID="6bc80c1d-4e70-4ece-a26c-42c76131a6af" containerID="95191e897ba831396876037f59ea068c3d0c021735bb982157e0356ebd8a3e74" exitCode=0
Oct 30 23:59:14.451034 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:14.451010    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb" event={"ID":"6bc80c1d-4e70-4ece-a26c-42c76131a6af","Type":"ContainerDied","Data":"95191e897ba831396876037f59ea068c3d0c021735bb982157e0356ebd8a3e74"}
Oct 30 23:59:14.456532 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:14.456508    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:14.770809 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:14.770776    4921 patch_prober.go:29] interesting pod/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:59:14.771101 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:14.771076    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7" podUID="b4f6ed81-049f-42b9-8b90-244d5598728b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:59:14.802513 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:14.802479    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"
Oct 30 23:59:14.875670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:14.874975    4921 patch_prober.go:29] interesting pod/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.160:15021/healthz/ready\": dial tcp 10.132.0.160:15021: connect: connection refused" start-of-body=
Oct 30 23:59:14.875670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:14.875036    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w" podUID="d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.160:15021/healthz/ready\": dial tcp 10.132.0.160:15021: connect: connection refused"
Oct 30 23:59:14.892997 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:14.892962    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6bc80c1d-4e70-4ece-a26c-42c76131a6af-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bc80c1d-4e70-4ece-a26c-42c76131a6af-maas-api-tls\") pod \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\" (UID: \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\") "
Oct 30 23:59:14.920071 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:14.919979    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6bc80c1d-4e70-4ece-a26c-42c76131a6af-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bc80c1d-4e70-4ece-a26c-42c76131a6af-metrics-certs\") pod \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\" (UID: \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\") "
Oct 30 23:59:14.920545 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:14.920520    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6bc80c1d-4e70-4ece-a26c-42c76131a6af-kube-api-access-c5rqq\" (UniqueName: \"kubernetes.io/projected/6bc80c1d-4e70-4ece-a26c-42c76131a6af-kube-api-access-c5rqq\") pod \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\" (UID: \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\") "
Oct 30 23:59:14.921126 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:14.921106    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6bc80c1d-4e70-4ece-a26c-42c76131a6af-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bc80c1d-4e70-4ece-a26c-42c76131a6af-openshift-service-ca\") pod \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\" (UID: \"6bc80c1d-4e70-4ece-a26c-42c76131a6af\") "
Oct 30 23:59:14.923326 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:14.921582    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bc80c1d-4e70-4ece-a26c-42c76131a6af-openshift-service-ca" pod "6bc80c1d-4e70-4ece-a26c-42c76131a6af" (UID: "6bc80c1d-4e70-4ece-a26c-42c76131a6af"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:59:14.929931 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:14.929907    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bc80c1d-4e70-4ece-a26c-42c76131a6af-metrics-certs" pod "6bc80c1d-4e70-4ece-a26c-42c76131a6af" (UID: "6bc80c1d-4e70-4ece-a26c-42c76131a6af"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:59:14.949823 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:14.947805    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bc80c1d-4e70-4ece-a26c-42c76131a6af-maas-api-tls" pod "6bc80c1d-4e70-4ece-a26c-42c76131a6af" (UID: "6bc80c1d-4e70-4ece-a26c-42c76131a6af"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:59:14.976623 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:14.971559    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bc80c1d-4e70-4ece-a26c-42c76131a6af-kube-api-access-c5rqq" pod "6bc80c1d-4e70-4ece-a26c-42c76131a6af" (UID: "6bc80c1d-4e70-4ece-a26c-42c76131a6af"). InnerVolumeSpecName "kube-api-access-c5rqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:15.035642 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:15.035545    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bc80c1d-4e70-4ece-a26c-42c76131a6af-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:15.035642 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:15.035642    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bc80c1d-4e70-4ece-a26c-42c76131a6af-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:15.035907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:15.035666    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5rqq\" (UniqueName: \"kubernetes.io/projected/6bc80c1d-4e70-4ece-a26c-42c76131a6af-kube-api-access-c5rqq\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:15.035907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:15.035680    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bc80c1d-4e70-4ece-a26c-42c76131a6af-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:15.260877 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:15.260834    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:15.450879 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:15.450839    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:15.516669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:15.512403    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"
Oct 30 23:59:15.520618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:15.517505    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb" event={"ID":"6bc80c1d-4e70-4ece-a26c-42c76131a6af","Type":"ContainerDied","Data":"47f4e02f927e213ad7b6ca4125c5d7c2a06bba9acad1fb6d4beb69e3a2d533c7"}
Oct 30 23:59:15.520618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:15.517581    4921 scope.go:122] "RemoveContainer" containerID="95191e897ba831396876037f59ea068c3d0c021735bb982157e0356ebd8a3e74"
Oct 30 23:59:15.635630 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:15.631041    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:15.654638 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:15.654287    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"]
Oct 30 23:59:15.671952 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:15.671912    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2ccd42-54bc6f77d6-xfrrb"]
Oct 30 23:59:15.854402 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:15.854320    4921 patch_prober.go:29] interesting pod/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.160:15021/healthz/ready\": dial tcp 10.132.0.160:15021: connect: connection refused" start-of-body=
Oct 30 23:59:15.854686 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:15.854655    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w" podUID="d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.160:15021/healthz/ready\": dial tcp 10.132.0.160:15021: connect: connection refused"
Oct 30 23:59:15.987169 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:15.987053    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:16.321574 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:16.321535    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz"]
Oct 30 23:59:16.522102 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:16.522053    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:16.697900 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:16.696486    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:16.864621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:16.856053    4921 patch_prober.go:29] interesting pod/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.160:15021/healthz/ready\": dial tcp 10.132.0.160:15021: connect: connection refused" start-of-body=
Oct 30 23:59:16.864621 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:16.856135    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w" podUID="d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.160:15021/healthz/ready\": dial tcp 10.132.0.160:15021: connect: connection refused"
Oct 30 23:59:16.925218 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:16.925184    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6bc80c1d-4e70-4ece-a26c-42c76131a6af" path="/var/lib/kubelet/pods/6bc80c1d-4e70-4ece-a26c-42c76131a6af/volumes"
Oct 30 23:59:17.238617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:17.237722    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:17.693620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:17.691665    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:17.850481 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:17.850432    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:17.852703 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:17.852675    4921 patch_prober.go:29] interesting pod/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.160:15021/healthz/ready\": dial tcp 10.132.0.160:15021: connect: connection refused" start-of-body=
Oct 30 23:59:17.852788 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:17.852746    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w" podUID="d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.160:15021/healthz/ready\": dial tcp 10.132.0.160:15021: connect: connection refused"
Oct 30 23:59:18.012530 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:18.012454    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"]
Oct 30 23:59:18.012776 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:18.012745    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v" podUID="60266ba7-f106-4558-a4c2-adb24675cf0b" containerName="istio-proxy" containerID="cri-o://b926282ae127cb6e980ce0cd4fa2fb179128d7cf5e8faeaaf451dbd0b4cd22b1" gracePeriod=30
Oct 30 23:59:18.235157 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:18.235120    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:18.884620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:18.861031    4921 patch_prober.go:29] interesting pod/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.160:15021/healthz/ready\": dial tcp 10.132.0.160:15021: connect: connection refused" start-of-body=
Oct 30 23:59:18.884620 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:18.861100    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w" podUID="d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.160:15021/healthz/ready\": dial tcp 10.132.0.160:15021: connect: connection refused"
Oct 30 23:59:18.932658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:18.921971    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:18.944916 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:18.944849    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:59:18.997654 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:18.997274    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"]
Oct 30 23:59:19.096116 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.096029    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-credential-socket\") pod \"b4f6ed81-049f-42b9-8b90-244d5598728b\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") "
Oct 30 23:59:19.096116 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.096097    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-workload-socket\") pod \"b4f6ed81-049f-42b9-8b90-244d5598728b\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") "
Oct 30 23:59:19.096310 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.096162    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-token\" (UniqueName: \"kubernetes.io/projected/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-token\") pod \"b4f6ed81-049f-42b9-8b90-244d5598728b\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") "
Oct 30 23:59:19.096310 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.096199    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-data\") pod \"b4f6ed81-049f-42b9-8b90-244d5598728b\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") "
Oct 30 23:59:19.096310 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.096229    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-envoy\") pod \"b4f6ed81-049f-42b9-8b90-244d5598728b\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") "
Oct 30 23:59:19.096310 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.096247    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b4f6ed81-049f-42b9-8b90-244d5598728b-kube-api-access-zmkb9\" (UniqueName: \"kubernetes.io/projected/b4f6ed81-049f-42b9-8b90-244d5598728b-kube-api-access-zmkb9\") pod \"b4f6ed81-049f-42b9-8b90-244d5598728b\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") "
Oct 30 23:59:19.096527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.096331    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b4f6ed81-049f-42b9-8b90-244d5598728b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4f6ed81-049f-42b9-8b90-244d5598728b-istiod-ca-cert\") pod \"b4f6ed81-049f-42b9-8b90-244d5598728b\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") "
Oct 30 23:59:19.096527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.096389    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-podinfo\") pod \"b4f6ed81-049f-42b9-8b90-244d5598728b\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") "
Oct 30 23:59:19.096527 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.096482    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-workload-certs\") pod \"b4f6ed81-049f-42b9-8b90-244d5598728b\" (UID: \"b4f6ed81-049f-42b9-8b90-244d5598728b\") "
Oct 30 23:59:19.096764 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.096519    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-data" pod "b4f6ed81-049f-42b9-8b90-244d5598728b" (UID: "b4f6ed81-049f-42b9-8b90-244d5598728b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:19.096764 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.096719    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-credential-socket" pod "b4f6ed81-049f-42b9-8b90-244d5598728b" (UID: "b4f6ed81-049f-42b9-8b90-244d5598728b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:19.096964 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.096925    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4f6ed81-049f-42b9-8b90-244d5598728b-istiod-ca-cert" pod "b4f6ed81-049f-42b9-8b90-244d5598728b" (UID: "b4f6ed81-049f-42b9-8b90-244d5598728b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:59:19.097263 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.097069    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-workload-certs" pod "b4f6ed81-049f-42b9-8b90-244d5598728b" (UID: "b4f6ed81-049f-42b9-8b90-244d5598728b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:19.097566 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.097487    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:19.097566 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.097515    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:19.097566 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.097531    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:19.097566 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.097545    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4f6ed81-049f-42b9-8b90-244d5598728b-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:19.098094 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.097684    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-workload-socket" pod "b4f6ed81-049f-42b9-8b90-244d5598728b" (UID: "b4f6ed81-049f-42b9-8b90-244d5598728b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:19.099860 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.099829    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-envoy" pod "b4f6ed81-049f-42b9-8b90-244d5598728b" (UID: "b4f6ed81-049f-42b9-8b90-244d5598728b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:19.100095 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.100070    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-token" pod "b4f6ed81-049f-42b9-8b90-244d5598728b" (UID: "b4f6ed81-049f-42b9-8b90-244d5598728b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:19.100365 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.100343    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-podinfo" pod "b4f6ed81-049f-42b9-8b90-244d5598728b" (UID: "b4f6ed81-049f-42b9-8b90-244d5598728b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:59:19.100640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.100611    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4f6ed81-049f-42b9-8b90-244d5598728b-kube-api-access-zmkb9" pod "b4f6ed81-049f-42b9-8b90-244d5598728b" (UID: "b4f6ed81-049f-42b9-8b90-244d5598728b"). InnerVolumeSpecName "kube-api-access-zmkb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:19.199301 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.199258    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:19.199301 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.199305    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:19.199546 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.199322    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:19.199546 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.199355    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmkb9\" (UniqueName: \"kubernetes.io/projected/b4f6ed81-049f-42b9-8b90-244d5598728b-kube-api-access-zmkb9\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:19.199546 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.199371    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4f6ed81-049f-42b9-8b90-244d5598728b-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:19.213785 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.213690    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:19.555882 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.555844    4921 generic.go:356] "Generic (PLEG): container finished" podID="b4f6ed81-049f-42b9-8b90-244d5598728b" containerID="2b2770832170a0f8179584aa16024d601bd1c90e3c61e80bc582600fa12e2e76" exitCode=0
Oct 30 23:59:19.556114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.555902    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"
Oct 30 23:59:19.556114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.555901    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7" event={"ID":"b4f6ed81-049f-42b9-8b90-244d5598728b","Type":"ContainerDied","Data":"2b2770832170a0f8179584aa16024d601bd1c90e3c61e80bc582600fa12e2e76"}
Oct 30 23:59:19.556114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.555983    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7" event={"ID":"b4f6ed81-049f-42b9-8b90-244d5598728b","Type":"ContainerDied","Data":"4ebaf8192d513ca1ea9e3321a8c89f9f72d4bcfcd6871e7b1c829d1c3f3341f1"}
Oct 30 23:59:19.556114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.556017    4921 scope.go:122] "RemoveContainer" containerID="2b2770832170a0f8179584aa16024d601bd1c90e3c61e80bc582600fa12e2e76"
Oct 30 23:59:19.571912 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.570778    4921 scope.go:122] "RemoveContainer" containerID="2b2770832170a0f8179584aa16024d601bd1c90e3c61e80bc582600fa12e2e76"
Oct 30 23:59:19.571912 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:59:19.571142    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b2770832170a0f8179584aa16024d601bd1c90e3c61e80bc582600fa12e2e76\": container with ID starting with 2b2770832170a0f8179584aa16024d601bd1c90e3c61e80bc582600fa12e2e76 not found: ID does not exist" containerID="2b2770832170a0f8179584aa16024d601bd1c90e3c61e80bc582600fa12e2e76"
Oct 30 23:59:19.571912 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.571180    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b2770832170a0f8179584aa16024d601bd1c90e3c61e80bc582600fa12e2e76"} err="failed to get container status \"2b2770832170a0f8179584aa16024d601bd1c90e3c61e80bc582600fa12e2e76\": rpc error: code = NotFound desc = could not find container \"2b2770832170a0f8179584aa16024d601bd1c90e3c61e80bc582600fa12e2e76\": container with ID starting with 2b2770832170a0f8179584aa16024d601bd1c90e3c61e80bc582600fa12e2e76 not found: ID does not exist"
Oct 30 23:59:19.586575 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.586535    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"]
Oct 30 23:59:19.600473 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.600448    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-7b0299-openshift-default-5f568545c9-94rc7"]
Oct 30 23:59:19.632411 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.632383    4921 patch_prober.go:29] interesting pod/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:59:19.632549 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.632446    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v" podUID="60266ba7-f106-4558-a4c2-adb24675cf0b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:59:19.860179 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.860105    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:19.860657 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.860634    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:19.861305 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.861282    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:19.972283 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:19.972240    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:20.510400 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:20.510369    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:20.658193 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:20.654040    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:20.885244 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:20.885216    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b4f6ed81-049f-42b9-8b90-244d5598728b" path="/var/lib/kubelet/pods/b4f6ed81-049f-42b9-8b90-244d5598728b/volumes"
Oct 30 23:59:21.097156 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:21.097111    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:21.322858 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:21.322776    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz" podUID="33d808b5-315e-4d68-a3f8-c5a3fb98531a" containerName="payload-processing" containerID="cri-o://79f557d890516eca96fd039ddec50562f44dd84c2cfb57651b6b5047d9646ad0" gracePeriod=25
Oct 30 23:59:21.881101 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:21.881066    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:22.096308 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:22.096273    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:22.301187 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:22.286448    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:22.759610 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:22.759538    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:23.026669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:23.019200    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:23.618355 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:23.579653    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:23.922256 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:23.922212    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz" podUID="33d808b5-315e-4d68-a3f8-c5a3fb98531a" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 23:59:23.941511 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:23.941477    4921 generic.go:356] "Generic (PLEG): container finished" podID="60266ba7-f106-4558-a4c2-adb24675cf0b" containerID="b926282ae127cb6e980ce0cd4fa2fb179128d7cf5e8faeaaf451dbd0b4cd22b1" exitCode=0
Oct 30 23:59:23.941734 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:23.941572    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v" event={"ID":"60266ba7-f106-4558-a4c2-adb24675cf0b","Type":"ContainerDied","Data":"b926282ae127cb6e980ce0cd4fa2fb179128d7cf5e8faeaaf451dbd0b4cd22b1"}
Oct 30 23:59:23.941734 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:23.941650    4921 scope.go:122] "RemoveContainer" containerID="15d286c56d0ba51bc870c7d657962bcf3022631784c85ead6d9f0285152466e0"
Oct 30 23:59:24.100880 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.100834    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:59:24.196104 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.195999    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-envoy\") pod \"60266ba7-f106-4558-a4c2-adb24675cf0b\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") "
Oct 30 23:59:24.196104 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.196067    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-credential-socket\") pod \"60266ba7-f106-4558-a4c2-adb24675cf0b\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") "
Oct 30 23:59:24.196351 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.196224    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/60266ba7-f106-4558-a4c2-adb24675cf0b-kube-api-access-pkpql\" (UniqueName: \"kubernetes.io/projected/60266ba7-f106-4558-a4c2-adb24675cf0b-kube-api-access-pkpql\") pod \"60266ba7-f106-4558-a4c2-adb24675cf0b\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") "
Oct 30 23:59:24.196351 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.196279    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/60266ba7-f106-4558-a4c2-adb24675cf0b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60266ba7-f106-4558-a4c2-adb24675cf0b-istiod-ca-cert\") pod \"60266ba7-f106-4558-a4c2-adb24675cf0b\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") "
Oct 30 23:59:24.196351 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.196317    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-token\" (UniqueName: \"kubernetes.io/projected/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-token\") pod \"60266ba7-f106-4558-a4c2-adb24675cf0b\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") "
Oct 30 23:59:24.196545 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.196383    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-workload-certs\") pod \"60266ba7-f106-4558-a4c2-adb24675cf0b\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") "
Oct 30 23:59:24.196545 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.196484    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-workload-socket\") pod \"60266ba7-f106-4558-a4c2-adb24675cf0b\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") "
Oct 30 23:59:24.196699 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.196636    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-data\") pod \"60266ba7-f106-4558-a4c2-adb24675cf0b\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") "
Oct 30 23:59:24.196769 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.196719    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-podinfo\") pod \"60266ba7-f106-4558-a4c2-adb24675cf0b\" (UID: \"60266ba7-f106-4558-a4c2-adb24675cf0b\") "
Oct 30 23:59:24.197619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.197575    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-workload-certs" pod "60266ba7-f106-4558-a4c2-adb24675cf0b" (UID: "60266ba7-f106-4558-a4c2-adb24675cf0b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:24.198123 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.197938    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-credential-socket" pod "60266ba7-f106-4558-a4c2-adb24675cf0b" (UID: "60266ba7-f106-4558-a4c2-adb24675cf0b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:24.198849 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.198825    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-data" pod "60266ba7-f106-4558-a4c2-adb24675cf0b" (UID: "60266ba7-f106-4558-a4c2-adb24675cf0b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:24.199223 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.199187    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-workload-socket" pod "60266ba7-f106-4558-a4c2-adb24675cf0b" (UID: "60266ba7-f106-4558-a4c2-adb24675cf0b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:24.199679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.197194    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60266ba7-f106-4558-a4c2-adb24675cf0b-istiod-ca-cert" pod "60266ba7-f106-4558-a4c2-adb24675cf0b" (UID: "60266ba7-f106-4558-a4c2-adb24675cf0b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:59:24.209632 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.209578    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60266ba7-f106-4558-a4c2-adb24675cf0b-kube-api-access-pkpql" pod "60266ba7-f106-4558-a4c2-adb24675cf0b" (UID: "60266ba7-f106-4558-a4c2-adb24675cf0b"). InnerVolumeSpecName "kube-api-access-pkpql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:24.209632 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.209584    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-podinfo" pod "60266ba7-f106-4558-a4c2-adb24675cf0b" (UID: "60266ba7-f106-4558-a4c2-adb24675cf0b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:59:24.209917 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.209885    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-envoy" pod "60266ba7-f106-4558-a4c2-adb24675cf0b" (UID: "60266ba7-f106-4558-a4c2-adb24675cf0b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:24.210470 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.210445    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-token" pod "60266ba7-f106-4558-a4c2-adb24675cf0b" (UID: "60266ba7-f106-4558-a4c2-adb24675cf0b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:24.298418 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.298387    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:24.298418 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.298418    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:24.298668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.298428    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:24.298668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.298439    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:24.298668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.298450    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkpql\" (UniqueName: \"kubernetes.io/projected/60266ba7-f106-4558-a4c2-adb24675cf0b-kube-api-access-pkpql\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:24.298668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.298461    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60266ba7-f106-4558-a4c2-adb24675cf0b-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:24.298668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.298469    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60266ba7-f106-4558-a4c2-adb24675cf0b-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:24.298668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.298477    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:24.298668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.298487    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60266ba7-f106-4558-a4c2-adb24675cf0b-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:24.693503 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.693470    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:24.948674 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.944218    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:24.997619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.987062    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v" event={"ID":"60266ba7-f106-4558-a4c2-adb24675cf0b","Type":"ContainerDied","Data":"9abfe30250cc4bd63ddd08c2e5721ff7aee47d3de6b9b5a479edc0ae8cf5262e"}
Oct 30 23:59:24.997619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.987135    4921 scope.go:122] "RemoveContainer" containerID="b926282ae127cb6e980ce0cd4fa2fb179128d7cf5e8faeaaf451dbd0b4cd22b1"
Oct 30 23:59:24.997619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:24.987268    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"
Oct 30 23:59:25.212794 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:25.212699    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"]
Oct 30 23:59:25.222006 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:25.221933    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-7fc6e9-openshift-default-774677c6dc-nn26v"]
Oct 30 23:59:25.891231 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:25.891194    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:26.019103 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.019053    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main" containerID="cri-o://9efa0d67f7efd6e378109c93dca0f928b61b139a59194eaa6d6cdee815853c50" gracePeriod=45
Oct 30 23:59:26.020092 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.020060    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main" containerID="cri-o://0e8ebd4fbc01afad69dcf9067073f76eaf66d4af84bf7e6e5e70d1afa24419d5" gracePeriod=45
Oct 30 23:59:26.378483 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.378456    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:59:26.382973 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.382949    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:59:26.459103 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.458998    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-tmp-dir\") pod \"cf659c67-7154-40fe-b07a-423e271d8d7b\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") "
Oct 30 23:59:26.459103 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.459062    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-home\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-home\") pod \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") "
Oct 30 23:59:26.459425 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.459131    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-dshm\") pod \"cf659c67-7154-40fe-b07a-423e271d8d7b\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") "
Oct 30 23:59:26.459425 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.459170    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf659c67-7154-40fe-b07a-423e271d8d7b-kube-api-access-442kj\" (UniqueName: \"kubernetes.io/projected/cf659c67-7154-40fe-b07a-423e271d8d7b-kube-api-access-442kj\") pod \"cf659c67-7154-40fe-b07a-423e271d8d7b\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") "
Oct 30 23:59:26.459425 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.459217    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-model-cache\") pod \"cf659c67-7154-40fe-b07a-423e271d8d7b\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") "
Oct 30 23:59:26.459425 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.459333    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cf659c67-7154-40fe-b07a-423e271d8d7b-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf659c67-7154-40fe-b07a-423e271d8d7b-tls-certs\") pod \"cf659c67-7154-40fe-b07a-423e271d8d7b\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") "
Oct 30 23:59:26.459425 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.459362    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-tls-certs\" (UniqueName: \"kubernetes.io/secret/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-tls-certs\") pod \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") "
Oct 30 23:59:26.459425 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.459421    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-home\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-home\") pod \"cf659c67-7154-40fe-b07a-423e271d8d7b\" (UID: \"cf659c67-7154-40fe-b07a-423e271d8d7b\") "
Oct 30 23:59:26.460011 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.459473    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-model-cache\") pod \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") "
Oct 30 23:59:26.460011 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.459582    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-kube-api-access-cvqgk\" (UniqueName: \"kubernetes.io/projected/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-kube-api-access-cvqgk\") pod \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") "
Oct 30 23:59:26.460011 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.459689    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-tmp-dir\") pod \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") "
Oct 30 23:59:26.460011 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.459801    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-dshm\") pod \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\" (UID: \"16e9c6c7-2b6c-47f0-83bf-259de0754c3c\") "
Oct 30 23:59:26.461213 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.461184    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-model-cache" pod "16e9c6c7-2b6c-47f0-83bf-259de0754c3c" (UID: "16e9c6c7-2b6c-47f0-83bf-259de0754c3c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:26.461708 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.461680    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-home" pod "cf659c67-7154-40fe-b07a-423e271d8d7b" (UID: "cf659c67-7154-40fe-b07a-423e271d8d7b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:26.467072 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.466871    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-tmp-dir" pod "cf659c67-7154-40fe-b07a-423e271d8d7b" (UID: "cf659c67-7154-40fe-b07a-423e271d8d7b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:26.467424 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.467230    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-model-cache" pod "cf659c67-7154-40fe-b07a-423e271d8d7b" (UID: "cf659c67-7154-40fe-b07a-423e271d8d7b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:26.468636 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.467557    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-home" pod "16e9c6c7-2b6c-47f0-83bf-259de0754c3c" (UID: "16e9c6c7-2b6c-47f0-83bf-259de0754c3c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:26.468976 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.468950    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-tmp-dir" pod "16e9c6c7-2b6c-47f0-83bf-259de0754c3c" (UID: "16e9c6c7-2b6c-47f0-83bf-259de0754c3c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:26.470901 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.470290    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-dshm" pod "16e9c6c7-2b6c-47f0-83bf-259de0754c3c" (UID: "16e9c6c7-2b6c-47f0-83bf-259de0754c3c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:26.471244 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.471219    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf659c67-7154-40fe-b07a-423e271d8d7b-tls-certs" pod "cf659c67-7154-40fe-b07a-423e271d8d7b" (UID: "cf659c67-7154-40fe-b07a-423e271d8d7b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:59:26.471479 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.471444    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-dshm" pod "cf659c67-7154-40fe-b07a-423e271d8d7b" (UID: "cf659c67-7154-40fe-b07a-423e271d8d7b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:26.472020 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.471893    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-tls-certs" pod "16e9c6c7-2b6c-47f0-83bf-259de0754c3c" (UID: "16e9c6c7-2b6c-47f0-83bf-259de0754c3c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:59:26.472020 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.471919    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf659c67-7154-40fe-b07a-423e271d8d7b-kube-api-access-442kj" pod "cf659c67-7154-40fe-b07a-423e271d8d7b" (UID: "cf659c67-7154-40fe-b07a-423e271d8d7b"). InnerVolumeSpecName "kube-api-access-442kj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:26.472145 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.472023    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-kube-api-access-cvqgk" pod "16e9c6c7-2b6c-47f0-83bf-259de0754c3c" (UID: "16e9c6c7-2b6c-47f0-83bf-259de0754c3c"). InnerVolumeSpecName "kube-api-access-cvqgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:26.577658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.564744    4921 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-tmp-dir\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:26.577658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.564883    4921 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-dshm\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:26.577658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.564903    4921 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-tmp-dir\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:26.577658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.564916    4921 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-home\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:26.577658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.564928    4921 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-dshm\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:26.577658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.564940    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-442kj\" (UniqueName: \"kubernetes.io/projected/cf659c67-7154-40fe-b07a-423e271d8d7b-kube-api-access-442kj\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:26.577658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.564954    4921 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-model-cache\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:26.577658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.564967    4921 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf659c67-7154-40fe-b07a-423e271d8d7b-tls-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:26.577658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.564979    4921 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-tls-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:26.577658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.564993    4921 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf659c67-7154-40fe-b07a-423e271d8d7b-home\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:26.577658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.565004    4921 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-model-cache\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:26.577658 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.565015    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvqgk\" (UniqueName: \"kubernetes.io/projected/16e9c6c7-2b6c-47f0-83bf-259de0754c3c-kube-api-access-cvqgk\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:26.711331 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.711116    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:26.887706 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:26.887669    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="60266ba7-f106-4558-a4c2-adb24675cf0b" path="/var/lib/kubelet/pods/60266ba7-f106-4558-a4c2-adb24675cf0b/volumes"
Oct 30 23:59:27.005329 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.005244    4921 generic.go:356] "Generic (PLEG): container finished" podID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerID="0e8ebd4fbc01afad69dcf9067073f76eaf66d4af84bf7e6e5e70d1afa24419d5" exitCode=0
Oct 30 23:59:27.005329 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.005294    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"
Oct 30 23:59:27.005887 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.005344    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" event={"ID":"cf659c67-7154-40fe-b07a-423e271d8d7b","Type":"ContainerDied","Data":"0e8ebd4fbc01afad69dcf9067073f76eaf66d4af84bf7e6e5e70d1afa24419d5"}
Oct 30 23:59:27.005887 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.005390    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr" event={"ID":"cf659c67-7154-40fe-b07a-423e271d8d7b","Type":"ContainerDied","Data":"afba1ae32d2de570069103dbcca90320c3619e3a203daf284a1550c51ddc4067"}
Oct 30 23:59:27.005887 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.005414    4921 scope.go:122] "RemoveContainer" containerID="0e8ebd4fbc01afad69dcf9067073f76eaf66d4af84bf7e6e5e70d1afa24419d5"
Oct 30 23:59:27.008025 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.007984    4921 generic.go:356] "Generic (PLEG): container finished" podID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerID="9efa0d67f7efd6e378109c93dca0f928b61b139a59194eaa6d6cdee815853c50" exitCode=0
Oct 30 23:59:27.008153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.008080    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" event={"ID":"16e9c6c7-2b6c-47f0-83bf-259de0754c3c","Type":"ContainerDied","Data":"9efa0d67f7efd6e378109c93dca0f928b61b139a59194eaa6d6cdee815853c50"}
Oct 30 23:59:27.008153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.008112    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz" event={"ID":"16e9c6c7-2b6c-47f0-83bf-259de0754c3c","Type":"ContainerDied","Data":"a6eb479ab18bd3fb6605921d96a691044c0f32599f1bfae9256bb00deac2bdb4"}
Oct 30 23:59:27.008274 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.008173    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"
Oct 30 23:59:27.020653 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.020585    4921 scope.go:122] "RemoveContainer" containerID="0e8ebd4fbc01afad69dcf9067073f76eaf66d4af84bf7e6e5e70d1afa24419d5"
Oct 30 23:59:27.021103 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:59:27.021065    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e8ebd4fbc01afad69dcf9067073f76eaf66d4af84bf7e6e5e70d1afa24419d5\": container with ID starting with 0e8ebd4fbc01afad69dcf9067073f76eaf66d4af84bf7e6e5e70d1afa24419d5 not found: ID does not exist" containerID="0e8ebd4fbc01afad69dcf9067073f76eaf66d4af84bf7e6e5e70d1afa24419d5"
Oct 30 23:59:27.021240 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.021216    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e8ebd4fbc01afad69dcf9067073f76eaf66d4af84bf7e6e5e70d1afa24419d5"} err="failed to get container status \"0e8ebd4fbc01afad69dcf9067073f76eaf66d4af84bf7e6e5e70d1afa24419d5\": rpc error: code = NotFound desc = could not find container \"0e8ebd4fbc01afad69dcf9067073f76eaf66d4af84bf7e6e5e70d1afa24419d5\": container with ID starting with 0e8ebd4fbc01afad69dcf9067073f76eaf66d4af84bf7e6e5e70d1afa24419d5 not found: ID does not exist"
Oct 30 23:59:27.021377 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.021244    4921 scope.go:122] "RemoveContainer" containerID="9efa0d67f7efd6e378109c93dca0f928b61b139a59194eaa6d6cdee815853c50"
Oct 30 23:59:27.061819 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.061789    4921 scope.go:122] "RemoveContainer" containerID="9efa0d67f7efd6e378109c93dca0f928b61b139a59194eaa6d6cdee815853c50"
Oct 30 23:59:27.063176 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:59:27.063145    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9efa0d67f7efd6e378109c93dca0f928b61b139a59194eaa6d6cdee815853c50\": container with ID starting with 9efa0d67f7efd6e378109c93dca0f928b61b139a59194eaa6d6cdee815853c50 not found: ID does not exist" containerID="9efa0d67f7efd6e378109c93dca0f928b61b139a59194eaa6d6cdee815853c50"
Oct 30 23:59:27.063308 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.063188    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9efa0d67f7efd6e378109c93dca0f928b61b139a59194eaa6d6cdee815853c50"} err="failed to get container status \"9efa0d67f7efd6e378109c93dca0f928b61b139a59194eaa6d6cdee815853c50\": rpc error: code = NotFound desc = could not find container \"9efa0d67f7efd6e378109c93dca0f928b61b139a59194eaa6d6cdee815853c50\": container with ID starting with 9efa0d67f7efd6e378109c93dca0f928b61b139a59194eaa6d6cdee815853c50 not found: ID does not exist"
Oct 30 23:59:27.069201 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.069143    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"]
Oct 30 23:59:27.075085 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.075015    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-e15304/premium-w6-e15304-kserve-677d889694-h2rwr"]
Oct 30 23:59:27.090997 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.090974    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:27.112220 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.112198    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"]
Oct 30 23:59:27.115773 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.115751    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"]
Oct 30 23:59:27.115945 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.115928    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977" podUID="76cc079f-13e3-4159-b6f5-ca36d2b3a56a" containerName="istio-proxy" containerID="cri-o://54fa122548c1971aa101ecbe593f3a31a646766bf35119199d6cd0baba5b794d" gracePeriod=30
Oct 30 23:59:27.142183 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.142160    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-e15304/distinct-w6-e15304-kserve-57874f8b5c-ct2xz"]
Oct 30 23:59:27.295207 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:27.295115    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:28.478273 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:28.478239    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:28.899852 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:28.899797    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" path="/var/lib/kubelet/pods/16e9c6c7-2b6c-47f0-83bf-259de0754c3c/volumes"
Oct 30 23:59:28.900571 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:28.900529    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" path="/var/lib/kubelet/pods/cf659c67-7154-40fe-b07a-423e271d8d7b/volumes"
Oct 30 23:59:28.976819 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:28.976786    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:29.138124 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:29.138091    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:29.669617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:29.661779    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:30.282466 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:30.282437    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:30.429892 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:30.429854    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:30.593266 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:30.593181    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:30.800886 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:30.800850    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:31.941249 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:31.941219    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:32.089836 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.089802    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"]
Oct 30 23:59:32.090040 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.090020    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w" podUID="d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" containerName="istio-proxy" containerID="cri-o://6c5080699bba2b52dfe1aead592ea185090909eb9ad91cd8bb1cedfcd46e56b6" gracePeriod=30
Oct 30 23:59:32.247657 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.247534    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:32.679895 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.679863    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:59:32.817303 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.817218    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-podinfo\") pod \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") "
Oct 30 23:59:32.817303 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.817272    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istiod-ca-cert\") pod \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") "
Oct 30 23:59:32.817526 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.817308    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-workload-certs\") pod \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") "
Oct 30 23:59:32.817526 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.817463    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-envoy\") pod \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") "
Oct 30 23:59:32.817670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.817575    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-workload-certs" pod "76cc079f-13e3-4159-b6f5-ca36d2b3a56a" (UID: "76cc079f-13e3-4159-b6f5-ca36d2b3a56a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:32.817670 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.817630    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-credential-socket\") pod \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") "
Oct 30 23:59:32.817792 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.817748    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-workload-socket\") pod \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") "
Oct 30 23:59:32.817792 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.817748    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istiod-ca-cert" pod "76cc079f-13e3-4159-b6f5-ca36d2b3a56a" (UID: "76cc079f-13e3-4159-b6f5-ca36d2b3a56a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:59:32.817792 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.817781    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-kube-api-access-cj4ms\" (UniqueName: \"kubernetes.io/projected/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-kube-api-access-cj4ms\") pod \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") "
Oct 30 23:59:32.817966 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.817819    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-data\") pod \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") "
Oct 30 23:59:32.817966 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.817901    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-credential-socket" pod "76cc079f-13e3-4159-b6f5-ca36d2b3a56a" (UID: "76cc079f-13e3-4159-b6f5-ca36d2b3a56a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:32.817966 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.817933    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-token\" (UniqueName: \"kubernetes.io/projected/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-token\") pod \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\" (UID: \"76cc079f-13e3-4159-b6f5-ca36d2b3a56a\") "
Oct 30 23:59:32.818375 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.818204    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-data" pod "76cc079f-13e3-4159-b6f5-ca36d2b3a56a" (UID: "76cc079f-13e3-4159-b6f5-ca36d2b3a56a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:32.818375 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.818295    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-workload-socket" pod "76cc079f-13e3-4159-b6f5-ca36d2b3a56a" (UID: "76cc079f-13e3-4159-b6f5-ca36d2b3a56a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:32.819366 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.819339    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:32.819366 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.819369    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:32.819563 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.819385    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:32.819563 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.819400    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:32.819563 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.819414    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:32.820106 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.820084    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-podinfo" pod "76cc079f-13e3-4159-b6f5-ca36d2b3a56a" (UID: "76cc079f-13e3-4159-b6f5-ca36d2b3a56a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:59:32.820192 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.820132    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-envoy" pod "76cc079f-13e3-4159-b6f5-ca36d2b3a56a" (UID: "76cc079f-13e3-4159-b6f5-ca36d2b3a56a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:32.820355 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.820326    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-kube-api-access-cj4ms" pod "76cc079f-13e3-4159-b6f5-ca36d2b3a56a" (UID: "76cc079f-13e3-4159-b6f5-ca36d2b3a56a"). InnerVolumeSpecName "kube-api-access-cj4ms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:32.820484 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.820397    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-token" pod "76cc079f-13e3-4159-b6f5-ca36d2b3a56a" (UID: "76cc079f-13e3-4159-b6f5-ca36d2b3a56a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:32.920711 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.920683    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:32.920711 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.920708    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:32.920882 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.920717    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:32.920882 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:32.920727    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj4ms\" (UniqueName: \"kubernetes.io/projected/76cc079f-13e3-4159-b6f5-ca36d2b3a56a-kube-api-access-cj4ms\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:33.059404 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:33.059373    4921 generic.go:356] "Generic (PLEG): container finished" podID="76cc079f-13e3-4159-b6f5-ca36d2b3a56a" containerID="54fa122548c1971aa101ecbe593f3a31a646766bf35119199d6cd0baba5b794d" exitCode=0
Oct 30 23:59:33.059891 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:33.059423    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"
Oct 30 23:59:33.059891 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:33.059460    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977" event={"ID":"76cc079f-13e3-4159-b6f5-ca36d2b3a56a","Type":"ContainerDied","Data":"54fa122548c1971aa101ecbe593f3a31a646766bf35119199d6cd0baba5b794d"}
Oct 30 23:59:33.059891 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:33.059511    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977" event={"ID":"76cc079f-13e3-4159-b6f5-ca36d2b3a56a","Type":"ContainerDied","Data":"0f48afe610f6da2f514febc25727ea3d2f55287dc4ba67b72727ca529f6f34d6"}
Oct 30 23:59:33.059891 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:33.059532    4921 scope.go:122] "RemoveContainer" containerID="54fa122548c1971aa101ecbe593f3a31a646766bf35119199d6cd0baba5b794d"
Oct 30 23:59:33.072216 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:33.072198    4921 scope.go:122] "RemoveContainer" containerID="2cb64be2c9e0c6f67320cd0a71347c103a1b6c66acfe3ffc415d1a3be0fbab5f"
Oct 30 23:59:33.083103 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:33.083077    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"]
Oct 30 23:59:33.086251 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:33.086231    4921 scope.go:122] "RemoveContainer" containerID="54fa122548c1971aa101ecbe593f3a31a646766bf35119199d6cd0baba5b794d"
Oct 30 23:59:33.086586 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:59:33.086559    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54fa122548c1971aa101ecbe593f3a31a646766bf35119199d6cd0baba5b794d\": container with ID starting with 54fa122548c1971aa101ecbe593f3a31a646766bf35119199d6cd0baba5b794d not found: ID does not exist" containerID="54fa122548c1971aa101ecbe593f3a31a646766bf35119199d6cd0baba5b794d"
Oct 30 23:59:33.086687 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:33.086630    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54fa122548c1971aa101ecbe593f3a31a646766bf35119199d6cd0baba5b794d"} err="failed to get container status \"54fa122548c1971aa101ecbe593f3a31a646766bf35119199d6cd0baba5b794d\": rpc error: code = NotFound desc = could not find container \"54fa122548c1971aa101ecbe593f3a31a646766bf35119199d6cd0baba5b794d\": container with ID starting with 54fa122548c1971aa101ecbe593f3a31a646766bf35119199d6cd0baba5b794d not found: ID does not exist"
Oct 30 23:59:33.086687 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:33.086650    4921 scope.go:122] "RemoveContainer" containerID="2cb64be2c9e0c6f67320cd0a71347c103a1b6c66acfe3ffc415d1a3be0fbab5f"
Oct 30 23:59:33.086954 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:59:33.086928    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cb64be2c9e0c6f67320cd0a71347c103a1b6c66acfe3ffc415d1a3be0fbab5f\": container with ID starting with 2cb64be2c9e0c6f67320cd0a71347c103a1b6c66acfe3ffc415d1a3be0fbab5f not found: ID does not exist" containerID="2cb64be2c9e0c6f67320cd0a71347c103a1b6c66acfe3ffc415d1a3be0fbab5f"
Oct 30 23:59:33.087007 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:33.086965    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cb64be2c9e0c6f67320cd0a71347c103a1b6c66acfe3ffc415d1a3be0fbab5f"} err="failed to get container status \"2cb64be2c9e0c6f67320cd0a71347c103a1b6c66acfe3ffc415d1a3be0fbab5f\": rpc error: code = NotFound desc = could not find container \"2cb64be2c9e0c6f67320cd0a71347c103a1b6c66acfe3ffc415d1a3be0fbab5f\": container with ID starting with 2cb64be2c9e0c6f67320cd0a71347c103a1b6c66acfe3ffc415d1a3be0fbab5f not found: ID does not exist"
Oct 30 23:59:33.095213 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:33.095187    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-2ccd42-openshift-default-7bf78d58cf-ss977"]
Oct 30 23:59:33.439641 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:33.438189    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:33.836754 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:33.836658    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz" podUID="33d808b5-315e-4d68-a3f8-c5a3fb98531a" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 23:59:34.031352 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.031311    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main" containerID="cri-o://e0aafa04f19fbf286c649c36f95e94dafb9af60aea540375291587ec575f4ad4" gracePeriod=45
Oct 30 23:59:34.333811 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.333788    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:59:34.448261 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.448166    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-tmp-dir\") pod \"41a8c528-85de-4dd2-986d-3e4e26fa0985\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") "
Oct 30 23:59:34.448464 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.448444    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/41a8c528-85de-4dd2-986d-3e4e26fa0985-kube-api-access-zcjw8\" (UniqueName: \"kubernetes.io/projected/41a8c528-85de-4dd2-986d-3e4e26fa0985-kube-api-access-zcjw8\") pod \"41a8c528-85de-4dd2-986d-3e4e26fa0985\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") "
Oct 30 23:59:34.448569 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.448501    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-dshm\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-dshm\") pod \"41a8c528-85de-4dd2-986d-3e4e26fa0985\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") "
Oct 30 23:59:34.448672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.448559    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-tmp-dir" pod "41a8c528-85de-4dd2-986d-3e4e26fa0985" (UID: "41a8c528-85de-4dd2-986d-3e4e26fa0985"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:34.448672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.448650    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-model-cache\") pod \"41a8c528-85de-4dd2-986d-3e4e26fa0985\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") "
Oct 30 23:59:34.448814 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.448722    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/41a8c528-85de-4dd2-986d-3e4e26fa0985-tls-certs\" (UniqueName: \"kubernetes.io/secret/41a8c528-85de-4dd2-986d-3e4e26fa0985-tls-certs\") pod \"41a8c528-85de-4dd2-986d-3e4e26fa0985\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") "
Oct 30 23:59:34.448814 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.448782    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-home\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-home\") pod \"41a8c528-85de-4dd2-986d-3e4e26fa0985\" (UID: \"41a8c528-85de-4dd2-986d-3e4e26fa0985\") "
Oct 30 23:59:34.449136 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.449111    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-home" pod "41a8c528-85de-4dd2-986d-3e4e26fa0985" (UID: "41a8c528-85de-4dd2-986d-3e4e26fa0985"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:34.449492 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.449463    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-model-cache" pod "41a8c528-85de-4dd2-986d-3e4e26fa0985" (UID: "41a8c528-85de-4dd2-986d-3e4e26fa0985"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:34.452541 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.452512    4921 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-model-cache\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:34.452673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.452546    4921 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-home\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:34.452673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.452562    4921 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-tmp-dir\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:34.452798 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.452781    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-dshm" pod "41a8c528-85de-4dd2-986d-3e4e26fa0985" (UID: "41a8c528-85de-4dd2-986d-3e4e26fa0985"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:34.453431 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.453389    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41a8c528-85de-4dd2-986d-3e4e26fa0985-kube-api-access-zcjw8" pod "41a8c528-85de-4dd2-986d-3e4e26fa0985" (UID: "41a8c528-85de-4dd2-986d-3e4e26fa0985"). InnerVolumeSpecName "kube-api-access-zcjw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:34.459924 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.459895    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41a8c528-85de-4dd2-986d-3e4e26fa0985-tls-certs" pod "41a8c528-85de-4dd2-986d-3e4e26fa0985" (UID: "41a8c528-85de-4dd2-986d-3e4e26fa0985"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:59:34.554444 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.554406    4921 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41a8c528-85de-4dd2-986d-3e4e26fa0985-dshm\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:34.554444 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.554443    4921 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41a8c528-85de-4dd2-986d-3e4e26fa0985-tls-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:34.554672 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.554459    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcjw8\" (UniqueName: \"kubernetes.io/projected/41a8c528-85de-4dd2-986d-3e4e26fa0985-kube-api-access-zcjw8\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:34.609254 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.609200    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:34.863243 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.863158    4921 patch_prober.go:29] interesting pod/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 23:59:34.863243 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.863231    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w" podUID="d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 23:59:34.885203 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:34.885168    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="76cc079f-13e3-4159-b6f5-ca36d2b3a56a" path="/var/lib/kubelet/pods/76cc079f-13e3-4159-b6f5-ca36d2b3a56a/volumes"
Oct 30 23:59:35.077307 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:35.077278    4921 generic.go:356] "Generic (PLEG): container finished" podID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerID="e0aafa04f19fbf286c649c36f95e94dafb9af60aea540375291587ec575f4ad4" exitCode=0
Oct 30 23:59:35.077487 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:35.077321    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"
Oct 30 23:59:35.077487 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:35.077366    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" event={"ID":"41a8c528-85de-4dd2-986d-3e4e26fa0985","Type":"ContainerDied","Data":"e0aafa04f19fbf286c649c36f95e94dafb9af60aea540375291587ec575f4ad4"}
Oct 30 23:59:35.077487 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:35.077408    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th" event={"ID":"41a8c528-85de-4dd2-986d-3e4e26fa0985","Type":"ContainerDied","Data":"2ab992d21a2e03c92c215ea6c45257528485a03731e1adde5049306953aae0c8"}
Oct 30 23:59:35.077487 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:35.077425    4921 scope.go:122] "RemoveContainer" containerID="e0aafa04f19fbf286c649c36f95e94dafb9af60aea540375291587ec575f4ad4"
Oct 30 23:59:35.088128 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:35.088110    4921 scope.go:122] "RemoveContainer" containerID="e0aafa04f19fbf286c649c36f95e94dafb9af60aea540375291587ec575f4ad4"
Oct 30 23:59:35.088399 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:59:35.088382    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0aafa04f19fbf286c649c36f95e94dafb9af60aea540375291587ec575f4ad4\": container with ID starting with e0aafa04f19fbf286c649c36f95e94dafb9af60aea540375291587ec575f4ad4 not found: ID does not exist" containerID="e0aafa04f19fbf286c649c36f95e94dafb9af60aea540375291587ec575f4ad4"
Oct 30 23:59:35.088450 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:35.088407    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0aafa04f19fbf286c649c36f95e94dafb9af60aea540375291587ec575f4ad4"} err="failed to get container status \"e0aafa04f19fbf286c649c36f95e94dafb9af60aea540375291587ec575f4ad4\": rpc error: code = NotFound desc = could not find container \"e0aafa04f19fbf286c649c36f95e94dafb9af60aea540375291587ec575f4ad4\": container with ID starting with e0aafa04f19fbf286c649c36f95e94dafb9af60aea540375291587ec575f4ad4 not found: ID does not exist"
Oct 30 23:59:35.106546 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:35.106521    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"]
Oct 30 23:59:35.110293 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:35.110273    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-611ef3/distinct-2-w1-611ef3-kserve-7ccc95f99f-sd2th"]
Oct 30 23:59:35.595625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:35.584549    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:36.463269 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:36.463222    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:36.885333 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:36.885304    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" path="/var/lib/kubelet/pods/41a8c528-85de-4dd2-986d-3e4e26fa0985/volumes"
Oct 30 23:59:37.370210 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.365125    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:37.457100 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.457072    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:37.555496 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.555403    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istiod-ca-cert\") pod \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") "
Oct 30 23:59:37.555496 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.555458    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-podinfo\") pod \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") "
Oct 30 23:59:37.555496 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.555487    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-workload-certs\") pod \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") "
Oct 30 23:59:37.555877 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.555695    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-credential-socket\") pod \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") "
Oct 30 23:59:37.555877 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.555817    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-envoy\") pod \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") "
Oct 30 23:59:37.555877 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.555846    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-workload-certs" pod "d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" (UID: "d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:37.555877 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.555863    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istiod-ca-cert" pod "d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" (UID: "d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:59:37.556102 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.555939    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-token\" (UniqueName: \"kubernetes.io/projected/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-token\") pod \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") "
Oct 30 23:59:37.556102 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.555991    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-credential-socket" pod "d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" (UID: "d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:37.556102 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.556029    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-workload-socket\") pod \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") "
Oct 30 23:59:37.556102 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.556055    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-data\") pod \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") "
Oct 30 23:59:37.556318 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.556131    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-kube-api-access-l8rn8\" (UniqueName: \"kubernetes.io/projected/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-kube-api-access-l8rn8\") pod \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\" (UID: \"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13\") "
Oct 30 23:59:37.556318 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.556281    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-workload-socket" pod "d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" (UID: "d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:37.556438 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.556369    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-data" pod "d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" (UID: "d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:37.557116 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.557090    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:37.557256 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.557121    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:37.557256 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.557136    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:37.557256 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.557150    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:37.557256 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.557163    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:37.558200 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.558177    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-podinfo" pod "d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" (UID: "d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:59:37.558334 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.558306    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-envoy" pod "d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" (UID: "d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:37.558505 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.558474    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-token" pod "d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" (UID: "d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:37.559041 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.559017    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-kube-api-access-l8rn8" pod "d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" (UID: "d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13"). InnerVolumeSpecName "kube-api-access-l8rn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:37.658891 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.658860    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:37.658891 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.658888    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:37.658891 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.658898    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8rn8\" (UniqueName: \"kubernetes.io/projected/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-kube-api-access-l8rn8\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:37.659144 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.658909    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:37.747746 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.747708    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn"]
Oct 30 23:59:37.868469 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:37.868373    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:38.049871 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:38.049834    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:38.161625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:38.158348    4921 generic.go:356] "Generic (PLEG): container finished" podID="d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" containerID="6c5080699bba2b52dfe1aead592ea185090909eb9ad91cd8bb1cedfcd46e56b6" exitCode=0
Oct 30 23:59:38.161625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:38.158512    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w" event={"ID":"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13","Type":"ContainerDied","Data":"6c5080699bba2b52dfe1aead592ea185090909eb9ad91cd8bb1cedfcd46e56b6"}
Oct 30 23:59:38.161625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:38.158563    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w" event={"ID":"d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13","Type":"ContainerDied","Data":"c2a6f9f57b425ea8866403eeabb040f498fa8bdc67cd18999bf0121188d50011"}
Oct 30 23:59:38.161625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:38.158640    4921 scope.go:122] "RemoveContainer" containerID="6c5080699bba2b52dfe1aead592ea185090909eb9ad91cd8bb1cedfcd46e56b6"
Oct 30 23:59:38.161625 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:38.158946    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"
Oct 30 23:59:38.255320 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:38.255141    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:38.281611 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:38.274460    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"]
Oct 30 23:59:38.302727 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:38.291905    4921 scope.go:122] "RemoveContainer" containerID="6c5080699bba2b52dfe1aead592ea185090909eb9ad91cd8bb1cedfcd46e56b6"
Oct 30 23:59:38.309194 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:59:38.303198    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c5080699bba2b52dfe1aead592ea185090909eb9ad91cd8bb1cedfcd46e56b6\": container with ID starting with 6c5080699bba2b52dfe1aead592ea185090909eb9ad91cd8bb1cedfcd46e56b6 not found: ID does not exist" containerID="6c5080699bba2b52dfe1aead592ea185090909eb9ad91cd8bb1cedfcd46e56b6"
Oct 30 23:59:38.309194 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:38.303244    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c5080699bba2b52dfe1aead592ea185090909eb9ad91cd8bb1cedfcd46e56b6"} err="failed to get container status \"6c5080699bba2b52dfe1aead592ea185090909eb9ad91cd8bb1cedfcd46e56b6\": rpc error: code = NotFound desc = could not find container \"6c5080699bba2b52dfe1aead592ea185090909eb9ad91cd8bb1cedfcd46e56b6\": container with ID starting with 6c5080699bba2b52dfe1aead592ea185090909eb9ad91cd8bb1cedfcd46e56b6 not found: ID does not exist"
Oct 30 23:59:38.311608 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:38.309563    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a63288-openshift-default-74bf986bf9-z2h4w"]
Oct 30 23:59:38.884868 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:38.884841    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" path="/var/lib/kubelet/pods/d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13/volumes"
Oct 30 23:59:38.934754 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:38.934093    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"]
Oct 30 23:59:38.939206 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:38.935192    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929" podUID="96e378dd-b7e6-4a84-a4f2-65abb0d0c96b" containerName="maas-api" containerID="cri-o://45b33bbadfa24e2a9e34bffbf3985edb3a42a756cf464856042a7762dc40a317" gracePeriod=30
Oct 30 23:59:39.027451 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:39.027421    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:39.169640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:39.169509    4921 generic.go:356] "Generic (PLEG): container finished" podID="96e378dd-b7e6-4a84-a4f2-65abb0d0c96b" containerID="45b33bbadfa24e2a9e34bffbf3985edb3a42a756cf464856042a7762dc40a317" exitCode=0
Oct 30 23:59:39.169640 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:39.169584    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929" event={"ID":"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b","Type":"ContainerDied","Data":"45b33bbadfa24e2a9e34bffbf3985edb3a42a756cf464856042a7762dc40a317"}
Oct 30 23:59:39.377519 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:39.377478    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:39.453713 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:39.452862    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"
Oct 30 23:59:39.491583 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:39.491544    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-kube-api-access-sbpg2\" (UniqueName: \"kubernetes.io/projected/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-kube-api-access-sbpg2\") pod \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\" (UID: \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\") "
Oct 30 23:59:39.491795 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:39.491724    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-metrics-certs\") pod \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\" (UID: \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\") "
Oct 30 23:59:39.491795 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:39.491762    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-maas-api-tls\") pod \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\" (UID: \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\") "
Oct 30 23:59:39.491942 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:39.491837    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-openshift-service-ca\") pod \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\" (UID: \"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b\") "
Oct 30 23:59:39.492266 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:39.492238    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-openshift-service-ca" pod "96e378dd-b7e6-4a84-a4f2-65abb0d0c96b" (UID: "96e378dd-b7e6-4a84-a4f2-65abb0d0c96b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:59:39.492578 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:39.492557    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:39.494014 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:39.493988    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-metrics-certs" pod "96e378dd-b7e6-4a84-a4f2-65abb0d0c96b" (UID: "96e378dd-b7e6-4a84-a4f2-65abb0d0c96b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:59:39.494120 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:39.494097    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-kube-api-access-sbpg2" pod "96e378dd-b7e6-4a84-a4f2-65abb0d0c96b" (UID: "96e378dd-b7e6-4a84-a4f2-65abb0d0c96b"). InnerVolumeSpecName "kube-api-access-sbpg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:39.494895 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:39.494874    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-maas-api-tls" pod "96e378dd-b7e6-4a84-a4f2-65abb0d0c96b" (UID: "96e378dd-b7e6-4a84-a4f2-65abb0d0c96b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:59:39.594213 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:39.594179    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:39.594213 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:39.594211    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:39.594423 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:39.594224    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbpg2\" (UniqueName: \"kubernetes.io/projected/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b-kube-api-access-sbpg2\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:39.640697 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:39.640666    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:39.894818 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:39.894758    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:40.156379 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:40.156294    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:40.180879 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:40.180841    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929" event={"ID":"96e378dd-b7e6-4a84-a4f2-65abb0d0c96b","Type":"ContainerDied","Data":"d1ac65f68464c7f6822430106269d3068edff1b47e0b9885c59ae9ed4f59a310"}
Oct 30 23:59:40.180879 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:40.180860    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"
Oct 30 23:59:40.181374 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:40.180910    4921 scope.go:122] "RemoveContainer" containerID="45b33bbadfa24e2a9e34bffbf3985edb3a42a756cf464856042a7762dc40a317"
Oct 30 23:59:40.213189 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:40.213158    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"]
Oct 30 23:59:40.220476 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:40.220441    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f0817c-6dfdb45bc6-8v929"]
Oct 30 23:59:40.900684 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:40.888857    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:40.949910 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:40.946959    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="96e378dd-b7e6-4a84-a4f2-65abb0d0c96b" path="/var/lib/kubelet/pods/96e378dd-b7e6-4a84-a4f2-65abb0d0c96b/volumes"
Oct 30 23:59:41.304130 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:41.304043    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7"]
Oct 30 23:59:41.409704 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:59:41.409666    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 30 23:59:41.417733 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:41.417702    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:41.565346 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:41.565254    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:41.812622 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:41.808074    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz"
Oct 30 23:59:41.873669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:41.869255    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/33d808b5-315e-4d68-a3f8-c5a3fb98531a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33d808b5-315e-4d68-a3f8-c5a3fb98531a-plugins-config-volume\") pod \"33d808b5-315e-4d68-a3f8-c5a3fb98531a\" (UID: \"33d808b5-315e-4d68-a3f8-c5a3fb98531a\") "
Oct 30 23:59:41.873669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:41.869357    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33d808b5-315e-4d68-a3f8-c5a3fb98531a-kube-api-access-hlzwz\" (UniqueName: \"kubernetes.io/projected/33d808b5-315e-4d68-a3f8-c5a3fb98531a-kube-api-access-hlzwz\") pod \"33d808b5-315e-4d68-a3f8-c5a3fb98531a\" (UID: \"33d808b5-315e-4d68-a3f8-c5a3fb98531a\") "
Oct 30 23:59:41.873669 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:41.870968    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33d808b5-315e-4d68-a3f8-c5a3fb98531a-plugins-config-volume" pod "33d808b5-315e-4d68-a3f8-c5a3fb98531a" (UID: "33d808b5-315e-4d68-a3f8-c5a3fb98531a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:59:41.896458 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:41.896414    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33d808b5-315e-4d68-a3f8-c5a3fb98531a-kube-api-access-hlzwz" pod "33d808b5-315e-4d68-a3f8-c5a3fb98531a" (UID: "33d808b5-315e-4d68-a3f8-c5a3fb98531a"). InnerVolumeSpecName "kube-api-access-hlzwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:41.971775 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:41.971739    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33d808b5-315e-4d68-a3f8-c5a3fb98531a-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:41.971775 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:41.971768    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlzwz\" (UniqueName: \"kubernetes.io/projected/33d808b5-315e-4d68-a3f8-c5a3fb98531a-kube-api-access-hlzwz\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:42.115646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:42.106314    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:42.199113 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:42.199075    4921 generic.go:356] "Generic (PLEG): container finished" podID="33d808b5-315e-4d68-a3f8-c5a3fb98531a" containerID="79f557d890516eca96fd039ddec50562f44dd84c2cfb57651b6b5047d9646ad0" exitCode=0
Oct 30 23:59:42.199307 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:42.199122    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz"
Oct 30 23:59:42.199307 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:42.199157    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz" event={"ID":"33d808b5-315e-4d68-a3f8-c5a3fb98531a","Type":"ContainerDied","Data":"79f557d890516eca96fd039ddec50562f44dd84c2cfb57651b6b5047d9646ad0"}
Oct 30 23:59:42.199307 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:42.199212    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz" event={"ID":"33d808b5-315e-4d68-a3f8-c5a3fb98531a","Type":"ContainerDied","Data":"3204372fbdf09a66c5893227209a6f88979f75b8751e84c3abcf75d4c4e167c4"}
Oct 30 23:59:42.199307 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:42.199238    4921 scope.go:122] "RemoveContainer" containerID="79f557d890516eca96fd039ddec50562f44dd84c2cfb57651b6b5047d9646ad0"
Oct 30 23:59:42.211008 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:42.210992    4921 scope.go:122] "RemoveContainer" containerID="79f557d890516eca96fd039ddec50562f44dd84c2cfb57651b6b5047d9646ad0"
Oct 30 23:59:42.211285 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:59:42.211268    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79f557d890516eca96fd039ddec50562f44dd84c2cfb57651b6b5047d9646ad0\": container with ID starting with 79f557d890516eca96fd039ddec50562f44dd84c2cfb57651b6b5047d9646ad0 not found: ID does not exist" containerID="79f557d890516eca96fd039ddec50562f44dd84c2cfb57651b6b5047d9646ad0"
Oct 30 23:59:42.211358 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:42.211294    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f557d890516eca96fd039ddec50562f44dd84c2cfb57651b6b5047d9646ad0"} err="failed to get container status \"79f557d890516eca96fd039ddec50562f44dd84c2cfb57651b6b5047d9646ad0\": rpc error: code = NotFound desc = could not find container \"79f557d890516eca96fd039ddec50562f44dd84c2cfb57651b6b5047d9646ad0\": container with ID starting with 79f557d890516eca96fd039ddec50562f44dd84c2cfb57651b6b5047d9646ad0 not found: ID does not exist"
Oct 30 23:59:42.224819 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:42.224792    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz"]
Oct 30 23:59:42.231210 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:42.231188    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-e15304-588cdcfbc9-p8dvz"]
Oct 30 23:59:42.748305 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:42.748260    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn" podUID="5975b24e-2fa3-4875-92f9-b4316177ddca" containerName="payload-processing" containerID="cri-o://02a25a3997a55df776ca9f170a4d52c80856b96cd503a0d0a9fcf880ba389d78" gracePeriod=25
Oct 30 23:59:42.795524 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:42.795492    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd"]
Oct 30 23:59:42.842993 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:42.842966    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:42.889580 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:42.889537    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="33d808b5-315e-4d68-a3f8-c5a3fb98531a" path="/var/lib/kubelet/pods/33d808b5-315e-4d68-a3f8-c5a3fb98531a/volumes"
Oct 30 23:59:42.983034 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:42.982995    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:43.118626 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:43.117913    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:43.175679 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:43.168435    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn"
Oct 30 23:59:43.282673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:43.278772    4921 generic.go:356] "Generic (PLEG): container finished" podID="5975b24e-2fa3-4875-92f9-b4316177ddca" containerID="02a25a3997a55df776ca9f170a4d52c80856b96cd503a0d0a9fcf880ba389d78" exitCode=0
Oct 30 23:59:43.282673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:43.278954    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn" event={"ID":"5975b24e-2fa3-4875-92f9-b4316177ddca","Type":"ContainerDied","Data":"02a25a3997a55df776ca9f170a4d52c80856b96cd503a0d0a9fcf880ba389d78"}
Oct 30 23:59:43.282673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:43.279023    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn" event={"ID":"5975b24e-2fa3-4875-92f9-b4316177ddca","Type":"ContainerDied","Data":"2ba7730b9dc1de08501d6be8d806609dfc9330758c99dbd757d37634ca8ab17f"}
Oct 30 23:59:43.282673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:43.279054    4921 scope.go:122] "RemoveContainer" containerID="02a25a3997a55df776ca9f170a4d52c80856b96cd503a0d0a9fcf880ba389d78"
Oct 30 23:59:43.282673 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:43.279258    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn"
Oct 30 23:59:43.317148 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:43.316089    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5975b24e-2fa3-4875-92f9-b4316177ddca-kube-api-access-t9k5b\" (UniqueName: \"kubernetes.io/projected/5975b24e-2fa3-4875-92f9-b4316177ddca-kube-api-access-t9k5b\") pod \"5975b24e-2fa3-4875-92f9-b4316177ddca\" (UID: \"5975b24e-2fa3-4875-92f9-b4316177ddca\") "
Oct 30 23:59:43.317148 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:43.316209    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5975b24e-2fa3-4875-92f9-b4316177ddca-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5975b24e-2fa3-4875-92f9-b4316177ddca-plugins-config-volume\") pod \"5975b24e-2fa3-4875-92f9-b4316177ddca\" (UID: \"5975b24e-2fa3-4875-92f9-b4316177ddca\") "
Oct 30 23:59:43.317955 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:43.317613    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5975b24e-2fa3-4875-92f9-b4316177ddca-plugins-config-volume" pod "5975b24e-2fa3-4875-92f9-b4316177ddca" (UID: "5975b24e-2fa3-4875-92f9-b4316177ddca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:59:43.326634 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:43.326586    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5975b24e-2fa3-4875-92f9-b4316177ddca-kube-api-access-t9k5b" pod "5975b24e-2fa3-4875-92f9-b4316177ddca" (UID: "5975b24e-2fa3-4875-92f9-b4316177ddca"). InnerVolumeSpecName "kube-api-access-t9k5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:43.352033 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:43.352010    4921 scope.go:122] "RemoveContainer" containerID="02a25a3997a55df776ca9f170a4d52c80856b96cd503a0d0a9fcf880ba389d78"
Oct 30 23:59:43.352445 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:59:43.352372    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02a25a3997a55df776ca9f170a4d52c80856b96cd503a0d0a9fcf880ba389d78\": container with ID starting with 02a25a3997a55df776ca9f170a4d52c80856b96cd503a0d0a9fcf880ba389d78 not found: ID does not exist" containerID="02a25a3997a55df776ca9f170a4d52c80856b96cd503a0d0a9fcf880ba389d78"
Oct 30 23:59:43.352556 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:43.352457    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02a25a3997a55df776ca9f170a4d52c80856b96cd503a0d0a9fcf880ba389d78"} err="failed to get container status \"02a25a3997a55df776ca9f170a4d52c80856b96cd503a0d0a9fcf880ba389d78\": rpc error: code = NotFound desc = could not find container \"02a25a3997a55df776ca9f170a4d52c80856b96cd503a0d0a9fcf880ba389d78\": container with ID starting with 02a25a3997a55df776ca9f170a4d52c80856b96cd503a0d0a9fcf880ba389d78 not found: ID does not exist"
Oct 30 23:59:43.419409 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:43.419374    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9k5b\" (UniqueName: \"kubernetes.io/projected/5975b24e-2fa3-4875-92f9-b4316177ddca-kube-api-access-t9k5b\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:43.419409 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:43.419410    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5975b24e-2fa3-4875-92f9-b4316177ddca-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:43.606393 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:43.606362    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn"]
Oct 30 23:59:43.609829 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:43.609806    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1bc837-6545f7f5f5-gkwjn"]
Oct 30 23:59:43.790883 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:43.790842    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:43.948849 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:43.948811    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:44.100771 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:44.100735    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:44.321343 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:44.321250    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:44.502024 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:44.501985    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:44.646123 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:44.646094    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:44.884993 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:44.884963    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5975b24e-2fa3-4875-92f9-b4316177ddca" path="/var/lib/kubelet/pods/5975b24e-2fa3-4875-92f9-b4316177ddca/volumes"
Oct 30 23:59:44.998850 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:44.998773    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:45.534156 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:45.534117    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:46.305278 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:46.305238    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7" podUID="1ff8b90e-ea76-4c42-808a-a60e9b81d376" containerName="payload-processing" containerID="cri-o://190b85c7c92d0efa82e4e002002ee847527423a609362f563ad1b961b2ba7b50" gracePeriod=25
Oct 30 23:59:46.459124 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:46.456813    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:46.679829 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:46.679799    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7"
Oct 30 23:59:46.698231 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:46.698202    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ff8b90e-ea76-4c42-808a-a60e9b81d376-kube-api-access-dg89k\" (UniqueName: \"kubernetes.io/projected/1ff8b90e-ea76-4c42-808a-a60e9b81d376-kube-api-access-dg89k\") pod \"1ff8b90e-ea76-4c42-808a-a60e9b81d376\" (UID: \"1ff8b90e-ea76-4c42-808a-a60e9b81d376\") "
Oct 30 23:59:46.698382 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:46.698244    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ff8b90e-ea76-4c42-808a-a60e9b81d376-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ff8b90e-ea76-4c42-808a-a60e9b81d376-plugins-config-volume\") pod \"1ff8b90e-ea76-4c42-808a-a60e9b81d376\" (UID: \"1ff8b90e-ea76-4c42-808a-a60e9b81d376\") "
Oct 30 23:59:46.698646 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:46.698617    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ff8b90e-ea76-4c42-808a-a60e9b81d376-plugins-config-volume" pod "1ff8b90e-ea76-4c42-808a-a60e9b81d376" (UID: "1ff8b90e-ea76-4c42-808a-a60e9b81d376"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:59:46.698842 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:46.698829    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ff8b90e-ea76-4c42-808a-a60e9b81d376-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:46.700473 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:46.700452    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ff8b90e-ea76-4c42-808a-a60e9b81d376-kube-api-access-dg89k" pod "1ff8b90e-ea76-4c42-808a-a60e9b81d376" (UID: "1ff8b90e-ea76-4c42-808a-a60e9b81d376"). InnerVolumeSpecName "kube-api-access-dg89k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:46.801583 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:46.801545    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dg89k\" (UniqueName: \"kubernetes.io/projected/1ff8b90e-ea76-4c42-808a-a60e9b81d376-kube-api-access-dg89k\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:46.989272 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:46.989237    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"]
Oct 30 23:59:46.989524 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:46.989498    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq" podUID="1084bd3f-7b61-492d-b308-34c2fa15986a" containerName="maas-api" containerID="cri-o://99a2d79ec025bc253de17d41c50315d7231b7d3959872961f07a4ac7df4f92c1" gracePeriod=30
Oct 30 23:59:47.285745 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.278666    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:47.523920 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.523841    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"
Oct 30 23:59:47.530977 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.525714    4921 generic.go:356] "Generic (PLEG): container finished" podID="1084bd3f-7b61-492d-b308-34c2fa15986a" containerID="99a2d79ec025bc253de17d41c50315d7231b7d3959872961f07a4ac7df4f92c1" exitCode=0
Oct 30 23:59:47.543830 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.525742    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq" event={"ID":"1084bd3f-7b61-492d-b308-34c2fa15986a","Type":"ContainerDied","Data":"99a2d79ec025bc253de17d41c50315d7231b7d3959872961f07a4ac7df4f92c1"}
Oct 30 23:59:47.544114 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.544088    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq" event={"ID":"1084bd3f-7b61-492d-b308-34c2fa15986a","Type":"ContainerDied","Data":"4ac83942e873942fdd97551a92f376b86d04bb68da493faa273f5a8eff40dbf6"}
Oct 30 23:59:47.544259 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.544246    4921 scope.go:122] "RemoveContainer" containerID="99a2d79ec025bc253de17d41c50315d7231b7d3959872961f07a4ac7df4f92c1"
Oct 30 23:59:47.545500 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.545467    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1084bd3f-7b61-492d-b308-34c2fa15986a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1084bd3f-7b61-492d-b308-34c2fa15986a-openshift-service-ca\") pod \"1084bd3f-7b61-492d-b308-34c2fa15986a\" (UID: \"1084bd3f-7b61-492d-b308-34c2fa15986a\") "
Oct 30 23:59:47.545653 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.545572    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1084bd3f-7b61-492d-b308-34c2fa15986a-kube-api-access-cf2zj\" (UniqueName: \"kubernetes.io/projected/1084bd3f-7b61-492d-b308-34c2fa15986a-kube-api-access-cf2zj\") pod \"1084bd3f-7b61-492d-b308-34c2fa15986a\" (UID: \"1084bd3f-7b61-492d-b308-34c2fa15986a\") "
Oct 30 23:59:47.545722 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.545678    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1084bd3f-7b61-492d-b308-34c2fa15986a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1084bd3f-7b61-492d-b308-34c2fa15986a-maas-api-tls\") pod \"1084bd3f-7b61-492d-b308-34c2fa15986a\" (UID: \"1084bd3f-7b61-492d-b308-34c2fa15986a\") "
Oct 30 23:59:47.551624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.546878    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1084bd3f-7b61-492d-b308-34c2fa15986a-openshift-service-ca" pod "1084bd3f-7b61-492d-b308-34c2fa15986a" (UID: "1084bd3f-7b61-492d-b308-34c2fa15986a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:59:47.551624 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.547650    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1084bd3f-7b61-492d-b308-34c2fa15986a-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:47.572035 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.568829    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1084bd3f-7b61-492d-b308-34c2fa15986a-kube-api-access-cf2zj" pod "1084bd3f-7b61-492d-b308-34c2fa15986a" (UID: "1084bd3f-7b61-492d-b308-34c2fa15986a"). InnerVolumeSpecName "kube-api-access-cf2zj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:47.592706 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.591202    4921 generic.go:356] "Generic (PLEG): container finished" podID="1ff8b90e-ea76-4c42-808a-a60e9b81d376" containerID="190b85c7c92d0efa82e4e002002ee847527423a609362f563ad1b961b2ba7b50" exitCode=0
Oct 30 23:59:47.592706 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.591299    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7" event={"ID":"1ff8b90e-ea76-4c42-808a-a60e9b81d376","Type":"ContainerDied","Data":"190b85c7c92d0efa82e4e002002ee847527423a609362f563ad1b961b2ba7b50"}
Oct 30 23:59:47.592706 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.591356    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7" event={"ID":"1ff8b90e-ea76-4c42-808a-a60e9b81d376","Type":"ContainerDied","Data":"494d371a4a01617a5d8f39016eedd6e4bd1cf12e22649731966b526e0c3b8fd7"}
Oct 30 23:59:47.592706 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.591465    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7"
Oct 30 23:59:47.615173 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.613035    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1084bd3f-7b61-492d-b308-34c2fa15986a-maas-api-tls" pod "1084bd3f-7b61-492d-b308-34c2fa15986a" (UID: "1084bd3f-7b61-492d-b308-34c2fa15986a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:59:47.644147 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.644120    4921 scope.go:122] "RemoveContainer" containerID="99a2d79ec025bc253de17d41c50315d7231b7d3959872961f07a4ac7df4f92c1"
Oct 30 23:59:47.644886 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:59:47.644859    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99a2d79ec025bc253de17d41c50315d7231b7d3959872961f07a4ac7df4f92c1\": container with ID starting with 99a2d79ec025bc253de17d41c50315d7231b7d3959872961f07a4ac7df4f92c1 not found: ID does not exist" containerID="99a2d79ec025bc253de17d41c50315d7231b7d3959872961f07a4ac7df4f92c1"
Oct 30 23:59:47.645095 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.645068    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99a2d79ec025bc253de17d41c50315d7231b7d3959872961f07a4ac7df4f92c1"} err="failed to get container status \"99a2d79ec025bc253de17d41c50315d7231b7d3959872961f07a4ac7df4f92c1\": rpc error: code = NotFound desc = could not find container \"99a2d79ec025bc253de17d41c50315d7231b7d3959872961f07a4ac7df4f92c1\": container with ID starting with 99a2d79ec025bc253de17d41c50315d7231b7d3959872961f07a4ac7df4f92c1 not found: ID does not exist"
Oct 30 23:59:47.645198 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.645186    4921 scope.go:122] "RemoveContainer" containerID="190b85c7c92d0efa82e4e002002ee847527423a609362f563ad1b961b2ba7b50"
Oct 30 23:59:47.649432 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.649407    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1084bd3f-7b61-492d-b308-34c2fa15986a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/1084bd3f-7b61-492d-b308-34c2fa15986a-metrics-certs\") pod \"1084bd3f-7b61-492d-b308-34c2fa15986a\" (UID: \"1084bd3f-7b61-492d-b308-34c2fa15986a\") "
Oct 30 23:59:47.651443 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.651422    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cf2zj\" (UniqueName: \"kubernetes.io/projected/1084bd3f-7b61-492d-b308-34c2fa15986a-kube-api-access-cf2zj\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:47.651587 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.651565    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1084bd3f-7b61-492d-b308-34c2fa15986a-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:47.661996 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.661404    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1084bd3f-7b61-492d-b308-34c2fa15986a-metrics-certs" pod "1084bd3f-7b61-492d-b308-34c2fa15986a" (UID: "1084bd3f-7b61-492d-b308-34c2fa15986a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:59:47.673083 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.673050    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7"]
Oct 30 23:59:47.690989 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.690640    4921 scope.go:122] "RemoveContainer" containerID="190b85c7c92d0efa82e4e002002ee847527423a609362f563ad1b961b2ba7b50"
Oct 30 23:59:47.691364 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:59:47.691248    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"190b85c7c92d0efa82e4e002002ee847527423a609362f563ad1b961b2ba7b50\": container with ID starting with 190b85c7c92d0efa82e4e002002ee847527423a609362f563ad1b961b2ba7b50 not found: ID does not exist" containerID="190b85c7c92d0efa82e4e002002ee847527423a609362f563ad1b961b2ba7b50"
Oct 30 23:59:47.691364 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.691291    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"190b85c7c92d0efa82e4e002002ee847527423a609362f563ad1b961b2ba7b50"} err="failed to get container status \"190b85c7c92d0efa82e4e002002ee847527423a609362f563ad1b961b2ba7b50\": rpc error: code = NotFound desc = could not find container \"190b85c7c92d0efa82e4e002002ee847527423a609362f563ad1b961b2ba7b50\": container with ID starting with 190b85c7c92d0efa82e4e002002ee847527423a609362f563ad1b961b2ba7b50 not found: ID does not exist"
Oct 30 23:59:47.696121 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.695711    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-a3e876-c7d575f9c-wmmk7"]
Oct 30 23:59:47.738453 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.738411    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:47.753358 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.753329    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1084bd3f-7b61-492d-b308-34c2fa15986a-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:47.796761 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.796642    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd" podUID="7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b" containerName="payload-pre-processing" containerID="cri-o://198b9d816847f22e5f87f6213eda38066b2d5ab36661266757c0ac07263667d4" gracePeriod=25
Oct 30 23:59:47.939682 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:47.939047    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:48.094643 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.094503    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:48.141136 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.141108    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd"
Oct 30 23:59:48.167152 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.167110    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b-kube-api-access-hstk5\" (UniqueName: \"kubernetes.io/projected/7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b-kube-api-access-hstk5\") pod \"7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b\" (UID: \"7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b\") "
Oct 30 23:59:48.167331 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.167229    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b-plugins-config-volume\") pod \"7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b\" (UID: \"7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b\") "
Oct 30 23:59:48.168457 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.168426    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b-plugins-config-volume" pod "7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b" (UID: "7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:59:48.171179 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.171150    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b-kube-api-access-hstk5" pod "7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b" (UID: "7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b"). InnerVolumeSpecName "kube-api-access-hstk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:48.269171 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.269137    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hstk5\" (UniqueName: \"kubernetes.io/projected/7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b-kube-api-access-hstk5\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:48.269171 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.269165    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:48.331953 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.331923    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:48.477904 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.477874    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:48.600086 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.600056    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"
Oct 30 23:59:48.601849 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.601804    4921 generic.go:356] "Generic (PLEG): container finished" podID="7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b" containerID="198b9d816847f22e5f87f6213eda38066b2d5ab36661266757c0ac07263667d4" exitCode=0
Oct 30 23:59:48.602017 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.601852    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd"
Oct 30 23:59:48.602017 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.601852    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd" event={"ID":"7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b","Type":"ContainerDied","Data":"198b9d816847f22e5f87f6213eda38066b2d5ab36661266757c0ac07263667d4"}
Oct 30 23:59:48.602017 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.601970    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd" event={"ID":"7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b","Type":"ContainerDied","Data":"db63303803e5f449e8e3caa7acf773c952c6192ad0c1a716a5be5ccf44c79ea4"}
Oct 30 23:59:48.602017 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.602000    4921 scope.go:122] "RemoveContainer" containerID="198b9d816847f22e5f87f6213eda38066b2d5ab36661266757c0ac07263667d4"
Oct 30 23:59:48.614782 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.614757    4921 scope.go:122] "RemoveContainer" containerID="198b9d816847f22e5f87f6213eda38066b2d5ab36661266757c0ac07263667d4"
Oct 30 23:59:48.615058 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:59:48.615029    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"198b9d816847f22e5f87f6213eda38066b2d5ab36661266757c0ac07263667d4\": container with ID starting with 198b9d816847f22e5f87f6213eda38066b2d5ab36661266757c0ac07263667d4 not found: ID does not exist" containerID="198b9d816847f22e5f87f6213eda38066b2d5ab36661266757c0ac07263667d4"
Oct 30 23:59:48.615139 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.615069    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"198b9d816847f22e5f87f6213eda38066b2d5ab36661266757c0ac07263667d4"} err="failed to get container status \"198b9d816847f22e5f87f6213eda38066b2d5ab36661266757c0ac07263667d4\": rpc error: code = NotFound desc = could not find container \"198b9d816847f22e5f87f6213eda38066b2d5ab36661266757c0ac07263667d4\": container with ID starting with 198b9d816847f22e5f87f6213eda38066b2d5ab36661266757c0ac07263667d4 not found: ID does not exist"
Oct 30 23:59:48.635158 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.635130    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"]
Oct 30 23:59:48.638743 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.638721    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32732d-6b8747c8bb-7b7fq"]
Oct 30 23:59:48.664288 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.664263    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd"]
Oct 30 23:59:48.672853 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.672820    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-32732d-787d79dfd7-t88kd"]
Oct 30 23:59:48.729735 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.729651    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"]
Oct 30 23:59:48.729965 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.729937    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd" podUID="b87a3c1a-c9af-494e-bdf2-b81ee451f79c" containerName="istio-proxy" containerID="cri-o://3809325d0ac11657b39a819ee963fce839ac792bbdf6fa926babcaf3b865e1a8" gracePeriod=30
Oct 30 23:59:48.805907 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.805869    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:48.884982 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.884949    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1084bd3f-7b61-492d-b308-34c2fa15986a" path="/var/lib/kubelet/pods/1084bd3f-7b61-492d-b308-34c2fa15986a/volumes"
Oct 30 23:59:48.885417 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.885400    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1ff8b90e-ea76-4c42-808a-a60e9b81d376" path="/var/lib/kubelet/pods/1ff8b90e-ea76-4c42-808a-a60e9b81d376/volumes"
Oct 30 23:59:48.885868 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.885853    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b" path="/var/lib/kubelet/pods/7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b/volumes"
Oct 30 23:59:48.989691 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:48.986796    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:50.028274 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:50.028242    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:50.942202 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:50.942160    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:51.518862 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:51.518829    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"]
Oct 30 23:59:51.519344 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:51.519070    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd" podUID="7fdf298d-3b1f-49d9-9893-2a145ededcbe" containerName="maas-api" containerID="cri-o://a78c098395ee6e74c153958397f541464b966d52c21bb042d2fcd6c1d926d953" gracePeriod=30
Oct 30 23:59:51.579291 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:51.579256    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:51.779682 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:51.779549    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:51.854727 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:51.854692    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"
Oct 30 23:59:51.979182 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:51.979150    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7fdf298d-3b1f-49d9-9893-2a145ededcbe-kube-api-access-d4snx\" (UniqueName: \"kubernetes.io/projected/7fdf298d-3b1f-49d9-9893-2a145ededcbe-kube-api-access-d4snx\") pod \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\" (UID: \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\") "
Oct 30 23:59:51.979182 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:51.979184    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7fdf298d-3b1f-49d9-9893-2a145ededcbe-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdf298d-3b1f-49d9-9893-2a145ededcbe-metrics-certs\") pod \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\" (UID: \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\") "
Oct 30 23:59:51.979368 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:51.979236    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7fdf298d-3b1f-49d9-9893-2a145ededcbe-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fdf298d-3b1f-49d9-9893-2a145ededcbe-openshift-service-ca\") pod \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\" (UID: \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\") "
Oct 30 23:59:51.979368 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:51.979308    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7fdf298d-3b1f-49d9-9893-2a145ededcbe-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fdf298d-3b1f-49d9-9893-2a145ededcbe-maas-api-tls\") pod \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\" (UID: \"7fdf298d-3b1f-49d9-9893-2a145ededcbe\") "
Oct 30 23:59:51.979757 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:51.979724    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fdf298d-3b1f-49d9-9893-2a145ededcbe-openshift-service-ca" pod "7fdf298d-3b1f-49d9-9893-2a145ededcbe" (UID: "7fdf298d-3b1f-49d9-9893-2a145ededcbe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:59:51.980934 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:51.980896    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fdf298d-3b1f-49d9-9893-2a145ededcbe-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:51.981728 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:51.981698    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fdf298d-3b1f-49d9-9893-2a145ededcbe-kube-api-access-d4snx" pod "7fdf298d-3b1f-49d9-9893-2a145ededcbe" (UID: "7fdf298d-3b1f-49d9-9893-2a145ededcbe"). InnerVolumeSpecName "kube-api-access-d4snx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:51.981857 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:51.981785    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fdf298d-3b1f-49d9-9893-2a145ededcbe-metrics-certs" pod "7fdf298d-3b1f-49d9-9893-2a145ededcbe" (UID: "7fdf298d-3b1f-49d9-9893-2a145ededcbe"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:59:51.981925 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:51.981906    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fdf298d-3b1f-49d9-9893-2a145ededcbe-maas-api-tls" pod "7fdf298d-3b1f-49d9-9893-2a145ededcbe" (UID: "7fdf298d-3b1f-49d9-9893-2a145ededcbe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:59:52.121689 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:52.079169    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:52.161617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:52.160560    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fdf298d-3b1f-49d9-9893-2a145ededcbe-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:52.161617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:52.160623    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4snx\" (UniqueName: \"kubernetes.io/projected/7fdf298d-3b1f-49d9-9893-2a145ededcbe-kube-api-access-d4snx\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:52.161617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:52.160642    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdf298d-3b1f-49d9-9893-2a145ededcbe-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:52.389382 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:52.389354    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:52.551663 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:52.551606    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:52.635361 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:52.635327    4921 generic.go:356] "Generic (PLEG): container finished" podID="7fdf298d-3b1f-49d9-9893-2a145ededcbe" containerID="a78c098395ee6e74c153958397f541464b966d52c21bb042d2fcd6c1d926d953" exitCode=0
Oct 30 23:59:52.635551 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:52.635384    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"
Oct 30 23:59:52.635551 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:52.635417    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd" event={"ID":"7fdf298d-3b1f-49d9-9893-2a145ededcbe","Type":"ContainerDied","Data":"a78c098395ee6e74c153958397f541464b966d52c21bb042d2fcd6c1d926d953"}
Oct 30 23:59:52.635551 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:52.635473    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd" event={"ID":"7fdf298d-3b1f-49d9-9893-2a145ededcbe","Type":"ContainerDied","Data":"0182bf44ffd2a727d1ea6e5b94fb71efe2e260fbbb4c6b3c20ca3611b54485df"}
Oct 30 23:59:52.635551 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:52.635502    4921 scope.go:122] "RemoveContainer" containerID="a78c098395ee6e74c153958397f541464b966d52c21bb042d2fcd6c1d926d953"
Oct 30 23:59:52.651136 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:52.651117    4921 scope.go:122] "RemoveContainer" containerID="a78c098395ee6e74c153958397f541464b966d52c21bb042d2fcd6c1d926d953"
Oct 30 23:59:52.651465 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:59:52.651444    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a78c098395ee6e74c153958397f541464b966d52c21bb042d2fcd6c1d926d953\": container with ID starting with a78c098395ee6e74c153958397f541464b966d52c21bb042d2fcd6c1d926d953 not found: ID does not exist" containerID="a78c098395ee6e74c153958397f541464b966d52c21bb042d2fcd6c1d926d953"
Oct 30 23:59:52.651558 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:52.651475    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a78c098395ee6e74c153958397f541464b966d52c21bb042d2fcd6c1d926d953"} err="failed to get container status \"a78c098395ee6e74c153958397f541464b966d52c21bb042d2fcd6c1d926d953\": rpc error: code = NotFound desc = could not find container \"a78c098395ee6e74c153958397f541464b966d52c21bb042d2fcd6c1d926d953\": container with ID starting with a78c098395ee6e74c153958397f541464b966d52c21bb042d2fcd6c1d926d953 not found: ID does not exist"
Oct 30 23:59:52.665437 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:52.665414    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"]
Oct 30 23:59:52.677533 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:52.677507    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-e15304-5fcc499cd5-76fdd"]
Oct 30 23:59:52.887172 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:52.887137    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7fdf298d-3b1f-49d9-9893-2a145ededcbe" path="/var/lib/kubelet/pods/7fdf298d-3b1f-49d9-9893-2a145ededcbe/volumes"
Oct 30 23:59:52.952379 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:52.952303    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:53.123619 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:53.122003    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:53.491810 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:53.491771    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:53.654617 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:53.653918    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:54.029905 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.029876    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:54.034760 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.034740    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:59:54.136286 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.135363    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-workload-socket\") pod \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") "
Oct 30 23:59:54.136286 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.135430    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istiod-ca-cert\") pod \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") "
Oct 30 23:59:54.136286 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.135471    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-data\") pod \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") "
Oct 30 23:59:54.136286 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.135520    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-token\" (UniqueName: \"kubernetes.io/projected/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-token\") pod \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") "
Oct 30 23:59:54.136286 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.135656    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-workload-certs\") pod \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") "
Oct 30 23:59:54.136286 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.135710    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-kube-api-access-6n6lq\" (UniqueName: \"kubernetes.io/projected/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-kube-api-access-6n6lq\") pod \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") "
Oct 30 23:59:54.136286 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.135742    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-envoy\") pod \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") "
Oct 30 23:59:54.136286 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.135803    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-podinfo\") pod \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") "
Oct 30 23:59:54.136286 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.135865    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-credential-socket\") pod \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\" (UID: \"b87a3c1a-c9af-494e-bdf2-b81ee451f79c\") "
Oct 30 23:59:54.136286 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.136122    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-workload-certs" pod "b87a3c1a-c9af-494e-bdf2-b81ee451f79c" (UID: "b87a3c1a-c9af-494e-bdf2-b81ee451f79c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:54.136951 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.136693    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:54.136951 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.136929    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-data" pod "b87a3c1a-c9af-494e-bdf2-b81ee451f79c" (UID: "b87a3c1a-c9af-494e-bdf2-b81ee451f79c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:54.137282 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.137110    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-credential-socket" pod "b87a3c1a-c9af-494e-bdf2-b81ee451f79c" (UID: "b87a3c1a-c9af-494e-bdf2-b81ee451f79c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:54.137671 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.137639    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-workload-socket" pod "b87a3c1a-c9af-494e-bdf2-b81ee451f79c" (UID: "b87a3c1a-c9af-494e-bdf2-b81ee451f79c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:54.137882 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.137820    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istiod-ca-cert" pod "b87a3c1a-c9af-494e-bdf2-b81ee451f79c" (UID: "b87a3c1a-c9af-494e-bdf2-b81ee451f79c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:59:54.154545 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.154441    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-podinfo" pod "b87a3c1a-c9af-494e-bdf2-b81ee451f79c" (UID: "b87a3c1a-c9af-494e-bdf2-b81ee451f79c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:59:54.159720 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.158103    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-envoy" pod "b87a3c1a-c9af-494e-bdf2-b81ee451f79c" (UID: "b87a3c1a-c9af-494e-bdf2-b81ee451f79c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:54.159720 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.158352    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-token" pod "b87a3c1a-c9af-494e-bdf2-b81ee451f79c" (UID: "b87a3c1a-c9af-494e-bdf2-b81ee451f79c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:54.161700 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.161660    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-kube-api-access-6n6lq" pod "b87a3c1a-c9af-494e-bdf2-b81ee451f79c" (UID: "b87a3c1a-c9af-494e-bdf2-b81ee451f79c"). InnerVolumeSpecName "kube-api-access-6n6lq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:54.202363 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.202327    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:54.238510 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.238478    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:54.238510 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.238504    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:54.238723 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.238518    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:54.238723 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.238531    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:54.238723 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.238545    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n6lq\" (UniqueName: \"kubernetes.io/projected/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-kube-api-access-6n6lq\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:54.238723 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.238558    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:54.238723 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.238570    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:54.238723 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.238582    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b87a3c1a-c9af-494e-bdf2-b81ee451f79c-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:54.376302 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.376210    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"]
Oct 30 23:59:54.376476 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.376435    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6" podUID="f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" containerName="istio-proxy" containerID="cri-o://6bb3f47cce75396b7f979a3434cacd060e978a9e2564a8a3a53d749f0a3a8a8b" gracePeriod=30
Oct 30 23:59:54.384182 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.382889    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"]
Oct 30 23:59:54.384182 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.383109    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss" podUID="d4143a5c-73c5-4535-89f8-ea32b2c52b60" containerName="istio-proxy" containerID="cri-o://65b9e078858b8aca7d5603ed6bdf45a3a1cdaef320de6061c5b1a4ab5a3738d6" gracePeriod=30
Oct 30 23:59:54.414462 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.414429    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:54.734153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.734096    4921 generic.go:356] "Generic (PLEG): container finished" podID="b87a3c1a-c9af-494e-bdf2-b81ee451f79c" containerID="3809325d0ac11657b39a819ee963fce839ac792bbdf6fa926babcaf3b865e1a8" exitCode=0
Oct 30 23:59:54.734665 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.734243    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"
Oct 30 23:59:54.734665 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.734499    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd" event={"ID":"b87a3c1a-c9af-494e-bdf2-b81ee451f79c","Type":"ContainerDied","Data":"3809325d0ac11657b39a819ee963fce839ac792bbdf6fa926babcaf3b865e1a8"}
Oct 30 23:59:54.734665 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.734652    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd" event={"ID":"b87a3c1a-c9af-494e-bdf2-b81ee451f79c","Type":"ContainerDied","Data":"d3b8f3f181509bc6aeb8c7b9eb633a8e91b28321ada25c6745172d87e034714b"}
Oct 30 23:59:54.734863 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.734692    4921 scope.go:122] "RemoveContainer" containerID="3809325d0ac11657b39a819ee963fce839ac792bbdf6fa926babcaf3b865e1a8"
Oct 30 23:59:54.761995 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.761962    4921 scope.go:122] "RemoveContainer" containerID="05bc7afa49cc4862db7a505fef5cdcb24bc595f7346a504556db12a48775cfb0"
Oct 30 23:59:54.775233 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.775210    4921 scope.go:122] "RemoveContainer" containerID="3809325d0ac11657b39a819ee963fce839ac792bbdf6fa926babcaf3b865e1a8"
Oct 30 23:59:54.775501 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:59:54.775483    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3809325d0ac11657b39a819ee963fce839ac792bbdf6fa926babcaf3b865e1a8\": container with ID starting with 3809325d0ac11657b39a819ee963fce839ac792bbdf6fa926babcaf3b865e1a8 not found: ID does not exist" containerID="3809325d0ac11657b39a819ee963fce839ac792bbdf6fa926babcaf3b865e1a8"
Oct 30 23:59:54.775553 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.775510    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3809325d0ac11657b39a819ee963fce839ac792bbdf6fa926babcaf3b865e1a8"} err="failed to get container status \"3809325d0ac11657b39a819ee963fce839ac792bbdf6fa926babcaf3b865e1a8\": rpc error: code = NotFound desc = could not find container \"3809325d0ac11657b39a819ee963fce839ac792bbdf6fa926babcaf3b865e1a8\": container with ID starting with 3809325d0ac11657b39a819ee963fce839ac792bbdf6fa926babcaf3b865e1a8 not found: ID does not exist"
Oct 30 23:59:54.775553 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.775530    4921 scope.go:122] "RemoveContainer" containerID="05bc7afa49cc4862db7a505fef5cdcb24bc595f7346a504556db12a48775cfb0"
Oct 30 23:59:54.775816 ip-10-0-142-208 kubenswrapper[4921]: E1030 23:59:54.775797    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05bc7afa49cc4862db7a505fef5cdcb24bc595f7346a504556db12a48775cfb0\": container with ID starting with 05bc7afa49cc4862db7a505fef5cdcb24bc595f7346a504556db12a48775cfb0 not found: ID does not exist" containerID="05bc7afa49cc4862db7a505fef5cdcb24bc595f7346a504556db12a48775cfb0"
Oct 30 23:59:54.775882 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.775825    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05bc7afa49cc4862db7a505fef5cdcb24bc595f7346a504556db12a48775cfb0"} err="failed to get container status \"05bc7afa49cc4862db7a505fef5cdcb24bc595f7346a504556db12a48775cfb0\": rpc error: code = NotFound desc = could not find container \"05bc7afa49cc4862db7a505fef5cdcb24bc595f7346a504556db12a48775cfb0\": container with ID starting with 05bc7afa49cc4862db7a505fef5cdcb24bc595f7346a504556db12a48775cfb0 not found: ID does not exist"
Oct 30 23:59:54.779010 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.778985    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:54.802517 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.802495    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"]
Oct 30 23:59:54.813563 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.813540    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f0817c-openshift-default-6d58c7b86c-8c9hd"]
Oct 30 23:59:54.884828 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:54.884801    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b87a3c1a-c9af-494e-bdf2-b81ee451f79c" path="/var/lib/kubelet/pods/b87a3c1a-c9af-494e-bdf2-b81ee451f79c/volumes"
Oct 30 23:59:55.004008 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:55.003921    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:55.917618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:55.914094    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:56.080984 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:56.080956    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:56.292121 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:56.292034    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:56.454267 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:56.454231    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:56.660154 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:56.660109    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:57.275644 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:57.275584    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:58.260579 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:58.260537    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:58.473668 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:58.473640    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:58.767273 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:58.767238    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:59.082583 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.080385    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:59.236334 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.236292    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:59.702511 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.702340    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:59.826759 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.826727    4921 generic.go:356] "Generic (PLEG): container finished" podID="f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" containerID="6bb3f47cce75396b7f979a3434cacd060e978a9e2564a8a3a53d749f0a3a8a8b" exitCode=0
Oct 30 23:59:59.826936 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.826803    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6" event={"ID":"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e","Type":"ContainerDied","Data":"6bb3f47cce75396b7f979a3434cacd060e978a9e2564a8a3a53d749f0a3a8a8b"}
Oct 30 23:59:59.826936 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.826881    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6" event={"ID":"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e","Type":"ContainerDied","Data":"c8895079260e473fae27b495f6cb46877b3358374a96d9afa50d60d18740ae09"}
Oct 30 23:59:59.826936 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.826897    4921 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8895079260e473fae27b495f6cb46877b3358374a96d9afa50d60d18740ae09"
Oct 30 23:59:59.829153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.828809    4921 generic.go:356] "Generic (PLEG): container finished" podID="d4143a5c-73c5-4535-89f8-ea32b2c52b60" containerID="65b9e078858b8aca7d5603ed6bdf45a3a1cdaef320de6061c5b1a4ab5a3738d6" exitCode=0
Oct 30 23:59:59.829153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.828833    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 30 23:59:59.829153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.828941    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss" event={"ID":"d4143a5c-73c5-4535-89f8-ea32b2c52b60","Type":"ContainerDied","Data":"65b9e078858b8aca7d5603ed6bdf45a3a1cdaef320de6061c5b1a4ab5a3738d6"}
Oct 30 23:59:59.829153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.828978    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss" event={"ID":"d4143a5c-73c5-4535-89f8-ea32b2c52b60","Type":"ContainerDied","Data":"94224307ca4e3bdae95088d9ea7c75c6fdd4374ada3bdcd6911b3076bc49e372"}
Oct 30 23:59:59.829153 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.828997    4921 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94224307ca4e3bdae95088d9ea7c75c6fdd4374ada3bdcd6911b3076bc49e372"
Oct 30 23:59:59.831974 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.831954    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 30 23:59:59.890657 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.885681    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr"]
Oct 30 23:59:59.993174 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.993069    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-credential-socket\") pod \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") "
Oct 30 23:59:59.993174 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.993124    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-data\") pod \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") "
Oct 30 23:59:59.993174 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.993174    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-envoy\") pod \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") "
Oct 30 23:59:59.993432 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.993306    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-workload-certs\") pod \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") "
Oct 30 23:59:59.993432 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.993376    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-workload-socket\") pod \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") "
Oct 30 23:59:59.993432 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.993415    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-kube-api-access-v8kd4\" (UniqueName: \"kubernetes.io/projected/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-kube-api-access-v8kd4\") pod \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") "
Oct 30 23:59:59.993550 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.993463    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istiod-ca-cert\") pod \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") "
Oct 30 23:59:59.993550 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.993487    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-credential-socket\") pod \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") "
Oct 30 23:59:59.993550 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.993518    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-data\") pod \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") "
Oct 30 23:59:59.993832 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.993564    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-podinfo\") pod \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") "
Oct 30 23:59:59.993832 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.993643    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-envoy\") pod \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") "
Oct 30 23:59:59.993832 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.993676    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-workload-certs\") pod \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") "
Oct 30 23:59:59.993832 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.993702    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-token\" (UniqueName: \"kubernetes.io/projected/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-token\") pod \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") "
Oct 30 23:59:59.993832 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.993719    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d4143a5c-73c5-4535-89f8-ea32b2c52b60-kube-api-access-n8zgl\" (UniqueName: \"kubernetes.io/projected/d4143a5c-73c5-4535-89f8-ea32b2c52b60-kube-api-access-n8zgl\") pod \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") "
Oct 30 23:59:59.993832 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.993747    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-token\" (UniqueName: \"kubernetes.io/projected/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-token\") pod \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") "
Oct 30 23:59:59.993832 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.993779    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-podinfo\") pod \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") "
Oct 30 23:59:59.993832 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.993812    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-workload-socket\") pod \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\" (UID: \"d4143a5c-73c5-4535-89f8-ea32b2c52b60\") "
Oct 30 23:59:59.994130 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.993891    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istiod-ca-cert\") pod \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\" (UID: \"f45a5b30-d79d-4f87-bd68-9d4b089c0c3e\") "
Oct 30 23:59:59.994130 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.994043    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-credential-socket" pod "f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" (UID: "f45a5b30-d79d-4f87-bd68-9d4b089c0c3e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:59.994273 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.994241    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-credential-socket" pod "d4143a5c-73c5-4535-89f8-ea32b2c52b60" (UID: "d4143a5c-73c5-4535-89f8-ea32b2c52b60"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:59.994713 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.994624    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-data" pod "f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" (UID: "f45a5b30-d79d-4f87-bd68-9d4b089c0c3e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:59.994824 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.994713    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istiod-ca-cert" pod "f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" (UID: "f45a5b30-d79d-4f87-bd68-9d4b089c0c3e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:59:59.997224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.994972    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-workload-socket" pod "d4143a5c-73c5-4535-89f8-ea32b2c52b60" (UID: "d4143a5c-73c5-4535-89f8-ea32b2c52b60"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:59.997224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.994986    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-data" pod "d4143a5c-73c5-4535-89f8-ea32b2c52b60" (UID: "d4143a5c-73c5-4535-89f8-ea32b2c52b60"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:59.997224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.995161    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-workload-certs" pod "d4143a5c-73c5-4535-89f8-ea32b2c52b60" (UID: "d4143a5c-73c5-4535-89f8-ea32b2c52b60"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:59.997224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.995455    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istiod-ca-cert" pod "d4143a5c-73c5-4535-89f8-ea32b2c52b60" (UID: "d4143a5c-73c5-4535-89f8-ea32b2c52b60"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:59:59.997224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.995736    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-workload-certs" pod "f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" (UID: "f45a5b30-d79d-4f87-bd68-9d4b089c0c3e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:59.997224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.995934    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-workload-socket" pod "f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" (UID: "f45a5b30-d79d-4f87-bd68-9d4b089c0c3e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:59.997224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.997054    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:59.997224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.997080    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:59.997224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.997096    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:59.997224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.997109    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:59.997224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.997123    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:59.997224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.997135    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:59.997224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.997147    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:59.997224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.997159    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:59.997224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.997171    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:59.997224 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.997184    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 23:59:59.998411 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.997679    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-podinfo" pod "f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" (UID: "f45a5b30-d79d-4f87-bd68-9d4b089c0c3e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:59:59.998411 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.998249    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-token" pod "d4143a5c-73c5-4535-89f8-ea32b2c52b60" (UID: "d4143a5c-73c5-4535-89f8-ea32b2c52b60"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:59.999348 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.999321    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-envoy" pod "d4143a5c-73c5-4535-89f8-ea32b2c52b60" (UID: "d4143a5c-73c5-4535-89f8-ea32b2c52b60"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 23:59:59.999455 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.999425    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-podinfo" pod "d4143a5c-73c5-4535-89f8-ea32b2c52b60" (UID: "d4143a5c-73c5-4535-89f8-ea32b2c52b60"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 23:59:59.999526 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.999470    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4143a5c-73c5-4535-89f8-ea32b2c52b60-kube-api-access-n8zgl" pod "d4143a5c-73c5-4535-89f8-ea32b2c52b60" (UID: "d4143a5c-73c5-4535-89f8-ea32b2c52b60"). InnerVolumeSpecName "kube-api-access-n8zgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:59.999618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.999515    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-token" pod "f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" (UID: "f45a5b30-d79d-4f87-bd68-9d4b089c0c3e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:59:59.999618 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.999549    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 30 23:59:59.999933 ip-10-0-142-208 kubenswrapper[4921]: I1030 23:59:59.999904    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-envoy" pod "f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" (UID: "f45a5b30-d79d-4f87-bd68-9d4b089c0c3e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:00:00.000033 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.000010    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-kube-api-access-v8kd4" pod "f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" (UID: "f45a5b30-d79d-4f87-bd68-9d4b089c0c3e"). InnerVolumeSpecName "kube-api-access-v8kd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:00:00.098984 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.098950    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:00.098984 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.098983    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:00.098984 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.098993    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:00.099227 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.099002    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8zgl\" (UniqueName: \"kubernetes.io/projected/d4143a5c-73c5-4535-89f8-ea32b2c52b60-kube-api-access-n8zgl\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:00.099227 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.099012    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:00.099227 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.099021    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4143a5c-73c5-4535-89f8-ea32b2c52b60-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:00.099227 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.099032    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:00.099227 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.099046    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8kd4\" (UniqueName: \"kubernetes.io/projected/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e-kube-api-access-v8kd4\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:00.224501 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.224466    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb"]
Oct 31 00:00:00.225151 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225137    4921 cpu_manager.go:414] "containerMap: removing container" podUID="60266ba7-f106-4558-a4c2-adb24675cf0b" containerName="istio-proxy"
Oct 31 00:00:00.225205 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225153    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="60266ba7-f106-4558-a4c2-adb24675cf0b" containerName="istio-proxy"
Oct 31 00:00:00.225205 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225161    4921 cpu_manager.go:414] "containerMap: removing container" podUID="d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" containerName="istio-proxy"
Oct 31 00:00:00.225205 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225167    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" containerName="istio-proxy"
Oct 31 00:00:00.225205 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225186    4921 cpu_manager.go:414] "containerMap: removing container" podUID="db14c4d8-1735-4c65-8565-e80c251983b7" containerName="istio-proxy"
Oct 31 00:00:00.225205 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225191    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="db14c4d8-1735-4c65-8565-e80c251983b7" containerName="istio-proxy"
Oct 31 00:00:00.225205 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225201    4921 cpu_manager.go:414] "containerMap: removing container" podUID="7fdf298d-3b1f-49d9-9893-2a145ededcbe" containerName="maas-api"
Oct 31 00:00:00.225205 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225206    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7fdf298d-3b1f-49d9-9893-2a145ededcbe" containerName="maas-api"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225214    4921 cpu_manager.go:414] "containerMap: removing container" podUID="60266ba7-f106-4558-a4c2-adb24675cf0b" containerName="istio-proxy"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225219    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="60266ba7-f106-4558-a4c2-adb24675cf0b" containerName="istio-proxy"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225225    4921 cpu_manager.go:414] "containerMap: removing container" podUID="1084bd3f-7b61-492d-b308-34c2fa15986a" containerName="maas-api"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225230    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1084bd3f-7b61-492d-b308-34c2fa15986a" containerName="maas-api"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225236    4921 cpu_manager.go:414] "containerMap: removing container" podUID="ed22a052-789a-4e01-a852-b17c921b386a" containerName="istio-proxy"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225240    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ed22a052-789a-4e01-a852-b17c921b386a" containerName="istio-proxy"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225249    4921 cpu_manager.go:414] "containerMap: removing container" podUID="1ff8b90e-ea76-4c42-808a-a60e9b81d376" containerName="payload-processing"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225253    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ff8b90e-ea76-4c42-808a-a60e9b81d376" containerName="payload-processing"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225260    4921 cpu_manager.go:414] "containerMap: removing container" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225263    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225271    4921 cpu_manager.go:414] "containerMap: removing container" podUID="5975b24e-2fa3-4875-92f9-b4316177ddca" containerName="payload-processing"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225275    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5975b24e-2fa3-4875-92f9-b4316177ddca" containerName="payload-processing"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225282    4921 cpu_manager.go:414] "containerMap: removing container" podUID="7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b" containerName="payload-pre-processing"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225287    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b" containerName="payload-pre-processing"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225294    4921 cpu_manager.go:414] "containerMap: removing container" podUID="96e378dd-b7e6-4a84-a4f2-65abb0d0c96b" containerName="maas-api"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225299    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96e378dd-b7e6-4a84-a4f2-65abb0d0c96b" containerName="maas-api"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225310    4921 cpu_manager.go:414] "containerMap: removing container" podUID="b87a3c1a-c9af-494e-bdf2-b81ee451f79c" containerName="istio-proxy"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225314    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b87a3c1a-c9af-494e-bdf2-b81ee451f79c" containerName="istio-proxy"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225325    4921 cpu_manager.go:414] "containerMap: removing container" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225330    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225338    4921 cpu_manager.go:414] "containerMap: removing container" podUID="b87a3c1a-c9af-494e-bdf2-b81ee451f79c" containerName="istio-proxy"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225344    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b87a3c1a-c9af-494e-bdf2-b81ee451f79c" containerName="istio-proxy"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225349    4921 cpu_manager.go:414] "containerMap: removing container" podUID="b4f6ed81-049f-42b9-8b90-244d5598728b" containerName="istio-proxy"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225354    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b4f6ed81-049f-42b9-8b90-244d5598728b" containerName="istio-proxy"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225364    4921 cpu_manager.go:414] "containerMap: removing container" podUID="76cc079f-13e3-4159-b6f5-ca36d2b3a56a" containerName="istio-proxy"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225369    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="76cc079f-13e3-4159-b6f5-ca36d2b3a56a" containerName="istio-proxy"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225376    4921 cpu_manager.go:414] "containerMap: removing container" podUID="6bc80c1d-4e70-4ece-a26c-42c76131a6af" containerName="maas-api"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225381    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6bc80c1d-4e70-4ece-a26c-42c76131a6af" containerName="maas-api"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225388    4921 cpu_manager.go:414] "containerMap: removing container" podUID="33d808b5-315e-4d68-a3f8-c5a3fb98531a" containerName="payload-processing"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225392    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33d808b5-315e-4d68-a3f8-c5a3fb98531a" containerName="payload-processing"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225403    4921 cpu_manager.go:414] "containerMap: removing container" podUID="f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" containerName="istio-proxy"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225407    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" containerName="istio-proxy"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225418    4921 cpu_manager.go:414] "containerMap: removing container" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225422    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225431    4921 cpu_manager.go:414] "containerMap: removing container" podUID="d4143a5c-73c5-4535-89f8-ea32b2c52b60" containerName="istio-proxy"
Oct 31 00:00:00.225429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225436    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d4143a5c-73c5-4535-89f8-ea32b2c52b60" containerName="istio-proxy"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225529    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="b87a3c1a-c9af-494e-bdf2-b81ee451f79c" containerName="istio-proxy"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225538    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="b4f6ed81-049f-42b9-8b90-244d5598728b" containerName="istio-proxy"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225546    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="76cc079f-13e3-4159-b6f5-ca36d2b3a56a" containerName="istio-proxy"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225554    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="6bc80c1d-4e70-4ece-a26c-42c76131a6af" containerName="maas-api"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225559    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="33d808b5-315e-4d68-a3f8-c5a3fb98531a" containerName="payload-processing"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225566    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" containerName="istio-proxy"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225574    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="76cc079f-13e3-4159-b6f5-ca36d2b3a56a" containerName="istio-proxy"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225580    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="16e9c6c7-2b6c-47f0-83bf-259de0754c3c" containerName="main"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225585    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="d4143a5c-73c5-4535-89f8-ea32b2c52b60" containerName="istio-proxy"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225606    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="60266ba7-f106-4558-a4c2-adb24675cf0b" containerName="istio-proxy"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225614    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="d03ea95f-d19c-4bad-bc60-2a4eb9ba2b13" containerName="istio-proxy"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225625    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="db14c4d8-1735-4c65-8565-e80c251983b7" containerName="istio-proxy"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225634    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="7fdf298d-3b1f-49d9-9893-2a145ededcbe" containerName="maas-api"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225639    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="60266ba7-f106-4558-a4c2-adb24675cf0b" containerName="istio-proxy"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225644    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="1084bd3f-7b61-492d-b308-34c2fa15986a" containerName="maas-api"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225649    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="ed22a052-789a-4e01-a852-b17c921b386a" containerName="istio-proxy"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225655    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ff8b90e-ea76-4c42-808a-a60e9b81d376" containerName="payload-processing"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225660    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf659c67-7154-40fe-b07a-423e271d8d7b" containerName="main"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225666    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="5975b24e-2fa3-4875-92f9-b4316177ddca" containerName="payload-processing"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225673    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="7cb2cb0f-3a1f-49d0-8382-cc0c3e65074b" containerName="payload-pre-processing"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225678    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="96e378dd-b7e6-4a84-a4f2-65abb0d0c96b" containerName="maas-api"
Oct 31 00:00:00.226535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.225684    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="41a8c528-85de-4dd2-986d-3e4e26fa0985" containerName="main"
Oct 31 00:00:00.231204 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.231182    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb"
Oct 31 00:00:00.380725 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.331094    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bmrd2\""
Oct 31 00:00:00.380725 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.345125    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:00.519605 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.425508    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mdvd\" (UniqueName: \"kubernetes.io/projected/484903ba-039f-440a-96d4-bbc02fc56f7f-kube-api-access-2mdvd\") pod \"maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb\" (UID: \"484903ba-039f-440a-96d4-bbc02fc56f7f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb"
Oct 31 00:00:00.519605 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.425754    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/484903ba-039f-440a-96d4-bbc02fc56f7f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb\" (UID: \"484903ba-039f-440a-96d4-bbc02fc56f7f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb"
Oct 31 00:00:00.519605 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.473493    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb"]
Oct 31 00:00:00.579573 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.545852    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mdvd\" (UniqueName: \"kubernetes.io/projected/484903ba-039f-440a-96d4-bbc02fc56f7f-kube-api-access-2mdvd\") pod \"maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb\" (UID: \"484903ba-039f-440a-96d4-bbc02fc56f7f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb"
Oct 31 00:00:00.579573 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.546111    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/484903ba-039f-440a-96d4-bbc02fc56f7f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb\" (UID: \"484903ba-039f-440a-96d4-bbc02fc56f7f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb"
Oct 31 00:00:00.579573 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.557282    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:00.579573 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.566092    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/484903ba-039f-440a-96d4-bbc02fc56f7f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb\" (UID: \"484903ba-039f-440a-96d4-bbc02fc56f7f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb"
Oct 31 00:00:00.594042 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.593976    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mdvd\" (UniqueName: \"kubernetes.io/projected/484903ba-039f-440a-96d4-bbc02fc56f7f-kube-api-access-2mdvd\") pod \"maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb\" (UID: \"484903ba-039f-440a-96d4-bbc02fc56f7f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb"
Oct 31 00:00:00.599909 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.596461    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g"]
Oct 31 00:00:00.599909 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.597619    4921 cpu_manager.go:414] "containerMap: removing container" podUID="76cc079f-13e3-4159-b6f5-ca36d2b3a56a" containerName="istio-proxy"
Oct 31 00:00:00.599909 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.597637    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="76cc079f-13e3-4159-b6f5-ca36d2b3a56a" containerName="istio-proxy"
Oct 31 00:00:00.599909 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.597815    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="b87a3c1a-c9af-494e-bdf2-b81ee451f79c" containerName="istio-proxy"
Oct 31 00:00:00.606830 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.606056    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g"
Oct 31 00:00:00.619221 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.619187    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg"]
Oct 31 00:00:00.627109 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.627079    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g"]
Oct 31 00:00:00.627251 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.627204    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg"
Oct 31 00:00:00.636551 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.636521    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg"]
Oct 31 00:00:00.653132 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.653099    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv25q\" (UniqueName: \"kubernetes.io/projected/1ef59b37-69e3-44db-b44a-474785053368-kube-api-access-sv25q\") pod \"maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g\" (UID: \"1ef59b37-69e3-44db-b44a-474785053368\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g"
Oct 31 00:00:00.653463 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.653435    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef59b37-69e3-44db-b44a-474785053368-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g\" (UID: \"1ef59b37-69e3-44db-b44a-474785053368\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g"
Oct 31 00:00:00.754731 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.754697    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg2fj\" (UniqueName: \"kubernetes.io/projected/3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a-kube-api-access-tg2fj\") pod \"maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg\" (UID: \"3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg"
Oct 31 00:00:00.755156 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.754771    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg\" (UID: \"3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg"
Oct 31 00:00:00.755156 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.754898    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv25q\" (UniqueName: \"kubernetes.io/projected/1ef59b37-69e3-44db-b44a-474785053368-kube-api-access-sv25q\") pod \"maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g\" (UID: \"1ef59b37-69e3-44db-b44a-474785053368\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g"
Oct 31 00:00:00.755394 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.755304    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef59b37-69e3-44db-b44a-474785053368-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g\" (UID: \"1ef59b37-69e3-44db-b44a-474785053368\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g"
Oct 31 00:00:00.756206 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.756180    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef59b37-69e3-44db-b44a-474785053368-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g\" (UID: \"1ef59b37-69e3-44db-b44a-474785053368\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g"
Oct 31 00:00:00.768017 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.767961    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv25q\" (UniqueName: \"kubernetes.io/projected/1ef59b37-69e3-44db-b44a-474785053368-kube-api-access-sv25q\") pod \"maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g\" (UID: \"1ef59b37-69e3-44db-b44a-474785053368\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g"
Oct 31 00:00:00.837658 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.837549    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"
Oct 31 00:00:00.837658 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.837549    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"
Oct 31 00:00:00.856687 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.856657    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg2fj\" (UniqueName: \"kubernetes.io/projected/3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a-kube-api-access-tg2fj\") pod \"maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg\" (UID: \"3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg"
Oct 31 00:00:00.856814 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.856758    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg\" (UID: \"3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg"
Oct 31 00:00:00.857467 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.857449    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg\" (UID: \"3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg"
Oct 31 00:00:00.872069 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.872045    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb"
Oct 31 00:00:00.907926 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.907868    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg2fj\" (UniqueName: \"kubernetes.io/projected/3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a-kube-api-access-tg2fj\") pod \"maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg\" (UID: \"3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg"
Oct 31 00:00:00.927069 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.927035    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"]
Oct 31 00:00:00.943329 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.943065    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g"
Oct 31 00:00:00.971134 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.971045    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg"
Oct 31 00:00:00.981879 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:00.981850    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-458ss"]
Oct 31 00:00:01.018954 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:01.018885    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"]
Oct 31 00:00:01.031146 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:01.030202    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-611ef3-openshift-default-68b9548c67-bxgt6"]
Oct 31 00:00:01.179884 ip-10-0-142-208 kubenswrapper[4921]: W1031 00:00:01.179856    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod484903ba_039f_440a_96d4_bbc02fc56f7f.slice/crio-7ff84a9b64e03e8762e1bcc3c9974bb49c12d6950151a753748670607f286f8a WatchSource:0}: Error finding container 7ff84a9b64e03e8762e1bcc3c9974bb49c12d6950151a753748670607f286f8a: Status 404 returned error can't find the container with id 7ff84a9b64e03e8762e1bcc3c9974bb49c12d6950151a753748670607f286f8a
Oct 31 00:00:01.185388 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:01.185353    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb"]
Oct 31 00:00:01.298756 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:01.298726    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g"]
Oct 31 00:00:01.310794 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:01.310765    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg"]
Oct 31 00:00:01.313958 ip-10-0-142-208 kubenswrapper[4921]: W1031 00:00:01.313930    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b40ccb0_fde6_4c47_b2e7_89f0aa28ea8a.slice/crio-11465effa0527b33f4e6f8cf9608455ae137d0a771033386e9c901a7d804c54b WatchSource:0}: Error finding container 11465effa0527b33f4e6f8cf9608455ae137d0a771033386e9c901a7d804c54b: Status 404 returned error can't find the container with id 11465effa0527b33f4e6f8cf9608455ae137d0a771033386e9c901a7d804c54b
Oct 31 00:00:01.726796 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:01.726755    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:01.848289 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:01.848251    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb" event={"ID":"484903ba-039f-440a-96d4-bbc02fc56f7f","Type":"ContainerStarted","Data":"1cacc61d489b1ecaec32501a4d48783906a9d86955fd51ef03c6866c85853349"}
Oct 31 00:00:01.848734 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:01.848348    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb" event={"ID":"484903ba-039f-440a-96d4-bbc02fc56f7f","Type":"ContainerStarted","Data":"7ff84a9b64e03e8762e1bcc3c9974bb49c12d6950151a753748670607f286f8a"}
Oct 31 00:00:01.850369 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:01.850333    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg" event={"ID":"3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a","Type":"ContainerStarted","Data":"2401dadf447894420a554fc888aef5a2153e734300144669bc98ae36d54548ac"}
Oct 31 00:00:01.850531 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:01.850398    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg" event={"ID":"3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a","Type":"ContainerStarted","Data":"11465effa0527b33f4e6f8cf9608455ae137d0a771033386e9c901a7d804c54b"}
Oct 31 00:00:01.852287 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:01.852256    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g" event={"ID":"1ef59b37-69e3-44db-b44a-474785053368","Type":"ContainerStarted","Data":"b7c016b998c4373208dc236cbceaf9042dbbafa7b4a3b7453c97e0117acf76a3"}
Oct 31 00:00:01.852388 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:01.852309    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g" event={"ID":"1ef59b37-69e3-44db-b44a-474785053368","Type":"ContainerStarted","Data":"79185847d240c10a8c91f47e49aa9b5780142ff547af93c4b1c5beff6a9d14c8"}
Oct 31 00:00:01.880376 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:01.880331    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb" podStartSLOduration=1.880318435 podStartE2EDuration="1.880318435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:00:01.87771922 +0000 UTC m=+2461.122574988" watchObservedRunningTime="2026-10-31 00:00:01.880318435 +0000 UTC m=+2461.125174201"
Oct 31 00:00:01.956457 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:01.956373    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g" podStartSLOduration=1.956354419 podStartE2EDuration="1.956354419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:00:01.954185159 +0000 UTC m=+2461.199040947" watchObservedRunningTime="2026-10-31 00:00:01.956354419 +0000 UTC m=+2461.201210191"
Oct 31 00:00:01.957199 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:01.957167    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg" podStartSLOduration=1.957159715 podStartE2EDuration="1.957159715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:00:01.90563201 +0000 UTC m=+2461.150487779" watchObservedRunningTime="2026-10-31 00:00:01.957159715 +0000 UTC m=+2461.202015526"
Oct 31 00:00:02.054381 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:02.054298    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:02.243426 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:02.243394    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:02.751196 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:02.751165    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:02.869697 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:02.869662    4921 generic.go:356] "Generic (PLEG): container finished" podID="3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a" containerID="2401dadf447894420a554fc888aef5a2153e734300144669bc98ae36d54548ac" exitCode=60
Oct 31 00:00:02.870168 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:02.869758    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg" event={"ID":"3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a","Type":"ContainerDied","Data":"2401dadf447894420a554fc888aef5a2153e734300144669bc98ae36d54548ac"}
Oct 31 00:00:02.870168 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:02.870125    4921 scope.go:122] "RemoveContainer" containerID="2401dadf447894420a554fc888aef5a2153e734300144669bc98ae36d54548ac"
Oct 31 00:00:02.871791 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:02.871768    4921 generic.go:356] "Generic (PLEG): container finished" podID="1ef59b37-69e3-44db-b44a-474785053368" containerID="b7c016b998c4373208dc236cbceaf9042dbbafa7b4a3b7453c97e0117acf76a3" exitCode=60
Oct 31 00:00:02.871956 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:02.871885    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g" event={"ID":"1ef59b37-69e3-44db-b44a-474785053368","Type":"ContainerDied","Data":"b7c016b998c4373208dc236cbceaf9042dbbafa7b4a3b7453c97e0117acf76a3"}
Oct 31 00:00:02.872553 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:02.872534    4921 scope.go:122] "RemoveContainer" containerID="b7c016b998c4373208dc236cbceaf9042dbbafa7b4a3b7453c97e0117acf76a3"
Oct 31 00:00:02.874045 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:02.873974    4921 generic.go:356] "Generic (PLEG): container finished" podID="484903ba-039f-440a-96d4-bbc02fc56f7f" containerID="1cacc61d489b1ecaec32501a4d48783906a9d86955fd51ef03c6866c85853349" exitCode=60
Oct 31 00:00:02.874115 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:02.874058    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb" event={"ID":"484903ba-039f-440a-96d4-bbc02fc56f7f","Type":"ContainerDied","Data":"1cacc61d489b1ecaec32501a4d48783906a9d86955fd51ef03c6866c85853349"}
Oct 31 00:00:02.874309 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:02.874291    4921 scope.go:122] "RemoveContainer" containerID="1cacc61d489b1ecaec32501a4d48783906a9d86955fd51ef03c6866c85853349"
Oct 31 00:00:02.885012 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:02.884988    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d4143a5c-73c5-4535-89f8-ea32b2c52b60" path="/var/lib/kubelet/pods/d4143a5c-73c5-4535-89f8-ea32b2c52b60/volumes"
Oct 31 00:00:02.885480 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:02.885459    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f45a5b30-d79d-4f87-bd68-9d4b089c0c3e" path="/var/lib/kubelet/pods/f45a5b30-d79d-4f87-bd68-9d4b089c0c3e/volumes"
Oct 31 00:00:02.905658 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:02.905630    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:03.865671 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:03.860846    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:03.913403 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:03.912219    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g" event={"ID":"1ef59b37-69e3-44db-b44a-474785053368","Type":"ContainerStarted","Data":"30b1837e1ae1676c6d5865f1fd6bae202fc1bcdaa13f0aa818197a4a8b4eadd8"}
Oct 31 00:00:03.917241 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:03.917202    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb" event={"ID":"484903ba-039f-440a-96d4-bbc02fc56f7f","Type":"ContainerStarted","Data":"9d2cb96ed7f39fd08a1a8db826af63c3a6fb42ff04f4d3fff20a3423fc7c1a91"}
Oct 31 00:00:03.917411 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:03.917391    4921 scope.go:122] "RemoveContainer" containerID="9d2cb96ed7f39fd08a1a8db826af63c3a6fb42ff04f4d3fff20a3423fc7c1a91"
Oct 31 00:00:03.917840 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:00:03.917811    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb_odh-ai-gateway-infra(484903ba-039f-440a-96d4-bbc02fc56f7f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb" podUID="484903ba-039f-440a-96d4-bbc02fc56f7f"
Oct 31 00:00:03.919413 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:03.919388    4921 generic.go:356] "Generic (PLEG): container finished" podID="3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a" containerID="b61585a83694e417c7153639b16f28a31e887d4d603eff73a6ed9adddadd8567" exitCode=60
Oct 31 00:00:03.919510 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:03.919451    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg" event={"ID":"3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a","Type":"ContainerDied","Data":"b61585a83694e417c7153639b16f28a31e887d4d603eff73a6ed9adddadd8567"}
Oct 31 00:00:03.919510 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:03.919495    4921 scope.go:122] "RemoveContainer" containerID="2401dadf447894420a554fc888aef5a2153e734300144669bc98ae36d54548ac"
Oct 31 00:00:03.919852 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:03.919831    4921 scope.go:122] "RemoveContainer" containerID="b61585a83694e417c7153639b16f28a31e887d4d603eff73a6ed9adddadd8567"
Oct 31 00:00:03.920178 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:00:03.920156    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg_odh-ai-gateway-infra(3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg" podUID="3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a"
Oct 31 00:00:04.064032 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.063983    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:04.242325 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.242289    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:04.387234 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.387202    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"]
Oct 31 00:00:04.387483 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.387460    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8" podUID="8adef569-361f-4e2b-82c2-43610bd3a7b8" containerName="istio-proxy" containerID="cri-o://4ad6a1ef59b73fc85309daa39b91ef975a73603641730f3d5f5e6b6116bbd414" gracePeriod=30
Oct 31 00:00:04.393376 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.393347    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"]
Oct 31 00:00:04.393533 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.393515    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f" podUID="9927a847-b4b7-4c22-a3df-3ac672c98c80" containerName="istio-proxy" containerID="cri-o://8ab8f13c021e91f3305c46ece6859d0ea17655f65f36c64fc4ad9c6b79c3c6ca" gracePeriod=30
Oct 31 00:00:04.463251 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.463217    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:04.483685 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.483655    4921 patch_prober.go:29] interesting pod/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:00:04.483856 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.483705    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8" podUID="8adef569-361f-4e2b-82c2-43610bd3a7b8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:00:04.653708 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.653090    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:04.886351 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.886306    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr" podUID="167cafe8-5356-4cec-9841-87d4abdd6e4f" containerName="payload-pre-processing" containerID="cri-o://8bbabd566c41a8713ac0f90b1c9739f867d4f08c2a09544095b90062c937dbb2" gracePeriod=25
Oct 31 00:00:04.930336 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.930309    4921 scope.go:122] "RemoveContainer" containerID="b61585a83694e417c7153639b16f28a31e887d4d603eff73a6ed9adddadd8567"
Oct 31 00:00:04.930759 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:00:04.930687    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg_odh-ai-gateway-infra(3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg" podUID="3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a"
Oct 31 00:00:04.931995 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.931971    4921 generic.go:356] "Generic (PLEG): container finished" podID="1ef59b37-69e3-44db-b44a-474785053368" containerID="30b1837e1ae1676c6d5865f1fd6bae202fc1bcdaa13f0aa818197a4a8b4eadd8" exitCode=60
Oct 31 00:00:04.932105 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.932050    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g" event={"ID":"1ef59b37-69e3-44db-b44a-474785053368","Type":"ContainerDied","Data":"30b1837e1ae1676c6d5865f1fd6bae202fc1bcdaa13f0aa818197a4a8b4eadd8"}
Oct 31 00:00:04.932105 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.932101    4921 scope.go:122] "RemoveContainer" containerID="b7c016b998c4373208dc236cbceaf9042dbbafa7b4a3b7453c97e0117acf76a3"
Oct 31 00:00:04.932298 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.932280    4921 scope.go:122] "RemoveContainer" containerID="30b1837e1ae1676c6d5865f1fd6bae202fc1bcdaa13f0aa818197a4a8b4eadd8"
Oct 31 00:00:04.932648 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:00:04.932584    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g_odh-ai-gateway-infra(1ef59b37-69e3-44db-b44a-474785053368)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g" podUID="1ef59b37-69e3-44db-b44a-474785053368"
Oct 31 00:00:04.933980 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.933961    4921 generic.go:356] "Generic (PLEG): container finished" podID="484903ba-039f-440a-96d4-bbc02fc56f7f" containerID="9d2cb96ed7f39fd08a1a8db826af63c3a6fb42ff04f4d3fff20a3423fc7c1a91" exitCode=60
Oct 31 00:00:04.934058 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.933988    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb" event={"ID":"484903ba-039f-440a-96d4-bbc02fc56f7f","Type":"ContainerDied","Data":"9d2cb96ed7f39fd08a1a8db826af63c3a6fb42ff04f4d3fff20a3423fc7c1a91"}
Oct 31 00:00:04.934263 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.934249    4921 scope.go:122] "RemoveContainer" containerID="9d2cb96ed7f39fd08a1a8db826af63c3a6fb42ff04f4d3fff20a3423fc7c1a91"
Oct 31 00:00:04.934509 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:00:04.934492    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb_odh-ai-gateway-infra(484903ba-039f-440a-96d4-bbc02fc56f7f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb" podUID="484903ba-039f-440a-96d4-bbc02fc56f7f"
Oct 31 00:00:04.954579 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:04.954558    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:05.005745 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:05.005714    4921 scope.go:122] "RemoveContainer" containerID="1cacc61d489b1ecaec32501a4d48783906a9d86955fd51ef03c6866c85853349"
Oct 31 00:00:05.198269 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:05.198232    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:05.232523 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:05.232496    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr"
Oct 31 00:00:05.348008 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:05.347971    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/167cafe8-5356-4cec-9841-87d4abdd6e4f-kube-api-access-j4wfl\" (UniqueName: \"kubernetes.io/projected/167cafe8-5356-4cec-9841-87d4abdd6e4f-kube-api-access-j4wfl\") pod \"167cafe8-5356-4cec-9841-87d4abdd6e4f\" (UID: \"167cafe8-5356-4cec-9841-87d4abdd6e4f\") "
Oct 31 00:00:05.348220 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:05.348203    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/167cafe8-5356-4cec-9841-87d4abdd6e4f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/167cafe8-5356-4cec-9841-87d4abdd6e4f-plugins-config-volume\") pod \"167cafe8-5356-4cec-9841-87d4abdd6e4f\" (UID: \"167cafe8-5356-4cec-9841-87d4abdd6e4f\") "
Oct 31 00:00:05.348585 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:05.348559    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/167cafe8-5356-4cec-9841-87d4abdd6e4f-plugins-config-volume" pod "167cafe8-5356-4cec-9841-87d4abdd6e4f" (UID: "167cafe8-5356-4cec-9841-87d4abdd6e4f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:00:05.348763 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:05.348745    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/167cafe8-5356-4cec-9841-87d4abdd6e4f-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:05.350489 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:05.350466    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/167cafe8-5356-4cec-9841-87d4abdd6e4f-kube-api-access-j4wfl" pod "167cafe8-5356-4cec-9841-87d4abdd6e4f" (UID: "167cafe8-5356-4cec-9841-87d4abdd6e4f"). InnerVolumeSpecName "kube-api-access-j4wfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:00:05.397643 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:05.397613    4921 scope.go:122] "RemoveContainer" containerID="65b9e078858b8aca7d5603ed6bdf45a3a1cdaef320de6061c5b1a4ab5a3738d6"
Oct 31 00:00:05.408515 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:05.408475    4921 scope.go:122] "RemoveContainer" containerID="6bb3f47cce75396b7f979a3434cacd060e978a9e2564a8a3a53d749f0a3a8a8b"
Oct 31 00:00:05.409748 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:05.409702    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:05.419749 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:05.419728    4921 scope.go:122] "RemoveContainer" containerID="8bbabd566c41a8713ac0f90b1c9739f867d4f08c2a09544095b90062c937dbb2"
Oct 31 00:00:05.460313 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:05.460279    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4wfl\" (UniqueName: \"kubernetes.io/projected/167cafe8-5356-4cec-9841-87d4abdd6e4f-kube-api-access-j4wfl\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:05.624436 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:05.624399    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:05.941089 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:05.941003    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr" event={"ID":"167cafe8-5356-4cec-9841-87d4abdd6e4f","Type":"ContainerDied","Data":"8bbabd566c41a8713ac0f90b1c9739f867d4f08c2a09544095b90062c937dbb2"}
Oct 31 00:00:05.941089 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:05.941065    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr" event={"ID":"167cafe8-5356-4cec-9841-87d4abdd6e4f","Type":"ContainerDied","Data":"f0b15a9a58b34043dd93a64cfdad0454ce6005f0ec3916c26294297d5cb1ddda"}
Oct 31 00:00:05.943675 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:05.943653    4921 scope.go:122] "RemoveContainer" containerID="30b1837e1ae1676c6d5865f1fd6bae202fc1bcdaa13f0aa818197a4a8b4eadd8"
Oct 31 00:00:05.943965 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:00:05.943937    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g_odh-ai-gateway-infra(1ef59b37-69e3-44db-b44a-474785053368)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g" podUID="1ef59b37-69e3-44db-b44a-474785053368"
Oct 31 00:00:05.945347 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:05.945326    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr"
Oct 31 00:00:05.945479 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:05.945463    4921 scope.go:122] "RemoveContainer" containerID="9d2cb96ed7f39fd08a1a8db826af63c3a6fb42ff04f4d3fff20a3423fc7c1a91"
Oct 31 00:00:05.945715 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:00:05.945698    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb_odh-ai-gateway-infra(484903ba-039f-440a-96d4-bbc02fc56f7f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb" podUID="484903ba-039f-440a-96d4-bbc02fc56f7f"
Oct 31 00:00:06.012240 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:06.012207    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr"]
Oct 31 00:00:06.016298 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:06.016274    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-200408-746668d97f-g8jfr"]
Oct 31 00:00:06.564619 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:06.562452    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:06.884199 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:06.884166    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="167cafe8-5356-4cec-9841-87d4abdd6e4f" path="/var/lib/kubelet/pods/167cafe8-5356-4cec-9841-87d4abdd6e4f/volumes"
Oct 31 00:00:08.294226 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:08.291392    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:09.309962 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.309923    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9"]
Oct 31 00:00:09.311567 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.311536    4921 cpu_manager.go:414] "containerMap: removing container" podUID="167cafe8-5356-4cec-9841-87d4abdd6e4f" containerName="payload-pre-processing"
Oct 31 00:00:09.311773 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.311755    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="167cafe8-5356-4cec-9841-87d4abdd6e4f" containerName="payload-pre-processing"
Oct 31 00:00:09.312126 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.312107    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="167cafe8-5356-4cec-9841-87d4abdd6e4f" containerName="payload-pre-processing"
Oct 31 00:00:09.318558 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.318533    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9"]
Oct 31 00:00:09.318693 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.318647    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9"
Oct 31 00:00:09.327470 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.327450    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 00:00:09.354029 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.354007    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5e2b3853-7e76-44f3-9536-02f877d8f6b6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8bbc243c-tqvm9\" (UID: \"5e2b3853-7e76-44f3-9536-02f877d8f6b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9"
Oct 31 00:00:09.354130 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.354038    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5e2b3853-7e76-44f3-9536-02f877d8f6b6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8bbc243c-tqvm9\" (UID: \"5e2b3853-7e76-44f3-9536-02f877d8f6b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9"
Oct 31 00:00:09.354215 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.354202    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsf45\" (UniqueName: \"kubernetes.io/projected/5e2b3853-7e76-44f3-9536-02f877d8f6b6-kube-api-access-zsf45\") pod \"maas-api-revoke-sub-8bbc243c-tqvm9\" (UID: \"5e2b3853-7e76-44f3-9536-02f877d8f6b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9"
Oct 31 00:00:09.455566 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.455540    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsf45\" (UniqueName: \"kubernetes.io/projected/5e2b3853-7e76-44f3-9536-02f877d8f6b6-kube-api-access-zsf45\") pod \"maas-api-revoke-sub-8bbc243c-tqvm9\" (UID: \"5e2b3853-7e76-44f3-9536-02f877d8f6b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9"
Oct 31 00:00:09.455743 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.455731    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5e2b3853-7e76-44f3-9536-02f877d8f6b6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8bbc243c-tqvm9\" (UID: \"5e2b3853-7e76-44f3-9536-02f877d8f6b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9"
Oct 31 00:00:09.455792 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.455757    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5e2b3853-7e76-44f3-9536-02f877d8f6b6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8bbc243c-tqvm9\" (UID: \"5e2b3853-7e76-44f3-9536-02f877d8f6b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9"
Oct 31 00:00:09.456497 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.456475    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5e2b3853-7e76-44f3-9536-02f877d8f6b6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8bbc243c-tqvm9\" (UID: \"5e2b3853-7e76-44f3-9536-02f877d8f6b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9"
Oct 31 00:00:09.458372 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.458353    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5e2b3853-7e76-44f3-9536-02f877d8f6b6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8bbc243c-tqvm9\" (UID: \"5e2b3853-7e76-44f3-9536-02f877d8f6b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9"
Oct 31 00:00:09.498948 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.498758    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsf45\" (UniqueName: \"kubernetes.io/projected/5e2b3853-7e76-44f3-9536-02f877d8f6b6-kube-api-access-zsf45\") pod \"maas-api-revoke-sub-8bbc243c-tqvm9\" (UID: \"5e2b3853-7e76-44f3-9536-02f877d8f6b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9"
Oct 31 00:00:09.691619 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.686204    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:09.694402 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.694105    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9"
Oct 31 00:00:09.848315 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.847940    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 31 00:00:09.857725 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.857586    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:09.912025 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.909977    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-data\") pod \"8adef569-361f-4e2b-82c2-43610bd3a7b8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") "
Oct 31 00:00:09.912025 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.910073    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8adef569-361f-4e2b-82c2-43610bd3a7b8-kube-api-access-npdxl\" (UniqueName: \"kubernetes.io/projected/8adef569-361f-4e2b-82c2-43610bd3a7b8-kube-api-access-npdxl\") pod \"8adef569-361f-4e2b-82c2-43610bd3a7b8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") "
Oct 31 00:00:09.912025 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.910135    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-credential-socket\") pod \"8adef569-361f-4e2b-82c2-43610bd3a7b8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") "
Oct 31 00:00:09.912025 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.910166    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8adef569-361f-4e2b-82c2-43610bd3a7b8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8adef569-361f-4e2b-82c2-43610bd3a7b8-istiod-ca-cert\") pod \"8adef569-361f-4e2b-82c2-43610bd3a7b8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") "
Oct 31 00:00:09.912025 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.910297    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-workload-certs\") pod \"8adef569-361f-4e2b-82c2-43610bd3a7b8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") "
Oct 31 00:00:09.912025 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.910357    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-podinfo\") pod \"8adef569-361f-4e2b-82c2-43610bd3a7b8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") "
Oct 31 00:00:09.912025 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.910395    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-envoy\") pod \"8adef569-361f-4e2b-82c2-43610bd3a7b8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") "
Oct 31 00:00:09.912025 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.910426    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-workload-socket\") pod \"8adef569-361f-4e2b-82c2-43610bd3a7b8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") "
Oct 31 00:00:09.912025 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.910504    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-token\" (UniqueName: \"kubernetes.io/projected/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-token\") pod \"8adef569-361f-4e2b-82c2-43610bd3a7b8\" (UID: \"8adef569-361f-4e2b-82c2-43610bd3a7b8\") "
Oct 31 00:00:09.916799 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.916383    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-workload-certs" pod "8adef569-361f-4e2b-82c2-43610bd3a7b8" (UID: "8adef569-361f-4e2b-82c2-43610bd3a7b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:00:09.916799 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.916648    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8adef569-361f-4e2b-82c2-43610bd3a7b8-istiod-ca-cert" pod "8adef569-361f-4e2b-82c2-43610bd3a7b8" (UID: "8adef569-361f-4e2b-82c2-43610bd3a7b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:00:09.917233 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.917069    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-token" pod "8adef569-361f-4e2b-82c2-43610bd3a7b8" (UID: "8adef569-361f-4e2b-82c2-43610bd3a7b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:00:09.917562 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.917344    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-workload-socket" pod "8adef569-361f-4e2b-82c2-43610bd3a7b8" (UID: "8adef569-361f-4e2b-82c2-43610bd3a7b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:00:09.917865 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.917836    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-credential-socket" pod "8adef569-361f-4e2b-82c2-43610bd3a7b8" (UID: "8adef569-361f-4e2b-82c2-43610bd3a7b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:00:09.918179 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.918034    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-data" pod "8adef569-361f-4e2b-82c2-43610bd3a7b8" (UID: "8adef569-361f-4e2b-82c2-43610bd3a7b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:00:09.919270 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.919241    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-envoy" pod "8adef569-361f-4e2b-82c2-43610bd3a7b8" (UID: "8adef569-361f-4e2b-82c2-43610bd3a7b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:00:09.919951 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.919918    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8adef569-361f-4e2b-82c2-43610bd3a7b8-kube-api-access-npdxl" pod "8adef569-361f-4e2b-82c2-43610bd3a7b8" (UID: "8adef569-361f-4e2b-82c2-43610bd3a7b8"). InnerVolumeSpecName "kube-api-access-npdxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:00:09.924999 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.924974    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-podinfo" pod "8adef569-361f-4e2b-82c2-43610bd3a7b8" (UID: "8adef569-361f-4e2b-82c2-43610bd3a7b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:00:09.947827 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:09.947803    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 31 00:00:10.009686 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.009648    4921 generic.go:356] "Generic (PLEG): container finished" podID="9927a847-b4b7-4c22-a3df-3ac672c98c80" containerID="8ab8f13c021e91f3305c46ece6859d0ea17655f65f36c64fc4ad9c6b79c3c6ca" exitCode=0
Oct 31 00:00:10.009924 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.009906    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"
Oct 31 00:00:10.010246 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.010212    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f" event={"ID":"9927a847-b4b7-4c22-a3df-3ac672c98c80","Type":"ContainerDied","Data":"8ab8f13c021e91f3305c46ece6859d0ea17655f65f36c64fc4ad9c6b79c3c6ca"}
Oct 31 00:00:10.010411 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.010287    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f" event={"ID":"9927a847-b4b7-4c22-a3df-3ac672c98c80","Type":"ContainerDied","Data":"f5b81000f58f7e8f3242b8365eee5f3414f21e5cdc7670764f22061cdbc602b6"}
Oct 31 00:00:10.010411 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.010322    4921 scope.go:122] "RemoveContainer" containerID="8ab8f13c021e91f3305c46ece6859d0ea17655f65f36c64fc4ad9c6b79c3c6ca"
Oct 31 00:00:10.013046 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.013018    4921 generic.go:356] "Generic (PLEG): container finished" podID="8adef569-361f-4e2b-82c2-43610bd3a7b8" containerID="4ad6a1ef59b73fc85309daa39b91ef975a73603641730f3d5f5e6b6116bbd414" exitCode=0
Oct 31 00:00:10.013146 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.013131    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8" event={"ID":"8adef569-361f-4e2b-82c2-43610bd3a7b8","Type":"ContainerDied","Data":"4ad6a1ef59b73fc85309daa39b91ef975a73603641730f3d5f5e6b6116bbd414"}
Oct 31 00:00:10.013244 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.013176    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8" event={"ID":"8adef569-361f-4e2b-82c2-43610bd3a7b8","Type":"ContainerDied","Data":"88837abd798da3d51d6fb1d0688c8492672188620d0e34b562f5632fd66df7be"}
Oct 31 00:00:10.013304 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.013250    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"
Oct 31 00:00:10.014077 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.014049    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-workload-certs\") pod \"9927a847-b4b7-4c22-a3df-3ac672c98c80\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") "
Oct 31 00:00:10.014169 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.014127    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-envoy\") pod \"9927a847-b4b7-4c22-a3df-3ac672c98c80\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") "
Oct 31 00:00:10.014169 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.014156    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-token\" (UniqueName: \"kubernetes.io/projected/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-token\") pod \"9927a847-b4b7-4c22-a3df-3ac672c98c80\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") "
Oct 31 00:00:10.014306 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.014223    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-workload-socket\") pod \"9927a847-b4b7-4c22-a3df-3ac672c98c80\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") "
Oct 31 00:00:10.014362 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.014302    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-credential-socket\") pod \"9927a847-b4b7-4c22-a3df-3ac672c98c80\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") "
Oct 31 00:00:10.014362 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.014355    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9927a847-b4b7-4c22-a3df-3ac672c98c80-kube-api-access-mdvcl\" (UniqueName: \"kubernetes.io/projected/9927a847-b4b7-4c22-a3df-3ac672c98c80-kube-api-access-mdvcl\") pod \"9927a847-b4b7-4c22-a3df-3ac672c98c80\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") "
Oct 31 00:00:10.014463 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.014398    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-data\") pod \"9927a847-b4b7-4c22-a3df-3ac672c98c80\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") "
Oct 31 00:00:10.014692 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.014549    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9927a847-b4b7-4c22-a3df-3ac672c98c80-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9927a847-b4b7-4c22-a3df-3ac672c98c80-istiod-ca-cert\") pod \"9927a847-b4b7-4c22-a3df-3ac672c98c80\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") "
Oct 31 00:00:10.014811 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.014692    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-podinfo\") pod \"9927a847-b4b7-4c22-a3df-3ac672c98c80\" (UID: \"9927a847-b4b7-4c22-a3df-3ac672c98c80\") "
Oct 31 00:00:10.015462 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.015438    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:10.015552 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.015469    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npdxl\" (UniqueName: \"kubernetes.io/projected/8adef569-361f-4e2b-82c2-43610bd3a7b8-kube-api-access-npdxl\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:10.015552 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.015485    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:10.015552 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.015480    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-workload-certs" pod "9927a847-b4b7-4c22-a3df-3ac672c98c80" (UID: "9927a847-b4b7-4c22-a3df-3ac672c98c80"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:00:10.015552 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.015500    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8adef569-361f-4e2b-82c2-43610bd3a7b8-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:10.015552 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.015539    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:10.015846 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.015554    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:10.015846 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.015568    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:10.015846 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.015606    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8adef569-361f-4e2b-82c2-43610bd3a7b8-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:10.015846 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.015620    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8adef569-361f-4e2b-82c2-43610bd3a7b8-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:10.016563 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.016258    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-credential-socket" pod "9927a847-b4b7-4c22-a3df-3ac672c98c80" (UID: "9927a847-b4b7-4c22-a3df-3ac672c98c80"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:00:10.016563 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.016372    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9927a847-b4b7-4c22-a3df-3ac672c98c80-istiod-ca-cert" pod "9927a847-b4b7-4c22-a3df-3ac672c98c80" (UID: "9927a847-b4b7-4c22-a3df-3ac672c98c80"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:00:10.016563 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.016206    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-data" pod "9927a847-b4b7-4c22-a3df-3ac672c98c80" (UID: "9927a847-b4b7-4c22-a3df-3ac672c98c80"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:00:10.017151 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.017130    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-workload-socket" pod "9927a847-b4b7-4c22-a3df-3ac672c98c80" (UID: "9927a847-b4b7-4c22-a3df-3ac672c98c80"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:00:10.019029 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.018997    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-envoy" pod "9927a847-b4b7-4c22-a3df-3ac672c98c80" (UID: "9927a847-b4b7-4c22-a3df-3ac672c98c80"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:00:10.028139 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.027684    4921 scope.go:122] "RemoveContainer" containerID="bb8e9bd8927cb8f947c376734c7b9fa9e463996704822f2ffe35ddbc870ea681"
Oct 31 00:00:10.029165 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.029041    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9927a847-b4b7-4c22-a3df-3ac672c98c80-kube-api-access-mdvcl" pod "9927a847-b4b7-4c22-a3df-3ac672c98c80" (UID: "9927a847-b4b7-4c22-a3df-3ac672c98c80"). InnerVolumeSpecName "kube-api-access-mdvcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:00:10.029284 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.029213    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-token" pod "9927a847-b4b7-4c22-a3df-3ac672c98c80" (UID: "9927a847-b4b7-4c22-a3df-3ac672c98c80"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:00:10.058568 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.053744    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-podinfo" pod "9927a847-b4b7-4c22-a3df-3ac672c98c80" (UID: "9927a847-b4b7-4c22-a3df-3ac672c98c80"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:00:10.261447 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.178839    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9927a847-b4b7-4c22-a3df-3ac672c98c80-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:10.261447 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.253253    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:10.261447 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.253286    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:10.261447 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.253302    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:10.261447 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.253316    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:10.261447 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.253330    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:10.261447 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.253344    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:10.261447 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.253358    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdvcl\" (UniqueName: \"kubernetes.io/projected/9927a847-b4b7-4c22-a3df-3ac672c98c80-kube-api-access-mdvcl\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:10.261447 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.253373    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9927a847-b4b7-4c22-a3df-3ac672c98c80-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:10.261447 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.255332    4921 scope.go:122] "RemoveContainer" containerID="8ab8f13c021e91f3305c46ece6859d0ea17655f65f36c64fc4ad9c6b79c3c6ca"
Oct 31 00:00:10.261447 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.256985    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"]
Oct 31 00:00:10.264185 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:00:10.262715    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ab8f13c021e91f3305c46ece6859d0ea17655f65f36c64fc4ad9c6b79c3c6ca\": container with ID starting with 8ab8f13c021e91f3305c46ece6859d0ea17655f65f36c64fc4ad9c6b79c3c6ca not found: ID does not exist" containerID="8ab8f13c021e91f3305c46ece6859d0ea17655f65f36c64fc4ad9c6b79c3c6ca"
Oct 31 00:00:10.264185 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.262764    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab8f13c021e91f3305c46ece6859d0ea17655f65f36c64fc4ad9c6b79c3c6ca"} err="failed to get container status \"8ab8f13c021e91f3305c46ece6859d0ea17655f65f36c64fc4ad9c6b79c3c6ca\": rpc error: code = NotFound desc = could not find container \"8ab8f13c021e91f3305c46ece6859d0ea17655f65f36c64fc4ad9c6b79c3c6ca\": container with ID starting with 8ab8f13c021e91f3305c46ece6859d0ea17655f65f36c64fc4ad9c6b79c3c6ca not found: ID does not exist"
Oct 31 00:00:10.264185 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.262797    4921 scope.go:122] "RemoveContainer" containerID="bb8e9bd8927cb8f947c376734c7b9fa9e463996704822f2ffe35ddbc870ea681"
Oct 31 00:00:10.264185 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:00:10.263189    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb8e9bd8927cb8f947c376734c7b9fa9e463996704822f2ffe35ddbc870ea681\": container with ID starting with bb8e9bd8927cb8f947c376734c7b9fa9e463996704822f2ffe35ddbc870ea681 not found: ID does not exist" containerID="bb8e9bd8927cb8f947c376734c7b9fa9e463996704822f2ffe35ddbc870ea681"
Oct 31 00:00:10.264185 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.263214    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb8e9bd8927cb8f947c376734c7b9fa9e463996704822f2ffe35ddbc870ea681"} err="failed to get container status \"bb8e9bd8927cb8f947c376734c7b9fa9e463996704822f2ffe35ddbc870ea681\": rpc error: code = NotFound desc = could not find container \"bb8e9bd8927cb8f947c376734c7b9fa9e463996704822f2ffe35ddbc870ea681\": container with ID starting with bb8e9bd8927cb8f947c376734c7b9fa9e463996704822f2ffe35ddbc870ea681 not found: ID does not exist"
Oct 31 00:00:10.264185 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.263231    4921 scope.go:122] "RemoveContainer" containerID="4ad6a1ef59b73fc85309daa39b91ef975a73603641730f3d5f5e6b6116bbd414"
Oct 31 00:00:10.264185 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.263935    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-kxgt8"]
Oct 31 00:00:10.304304 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.304020    4921 scope.go:122] "RemoveContainer" containerID="4ad6a1ef59b73fc85309daa39b91ef975a73603641730f3d5f5e6b6116bbd414"
Oct 31 00:00:10.304527 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:00:10.304482    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ad6a1ef59b73fc85309daa39b91ef975a73603641730f3d5f5e6b6116bbd414\": container with ID starting with 4ad6a1ef59b73fc85309daa39b91ef975a73603641730f3d5f5e6b6116bbd414 not found: ID does not exist" containerID="4ad6a1ef59b73fc85309daa39b91ef975a73603641730f3d5f5e6b6116bbd414"
Oct 31 00:00:10.304582 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.304529    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ad6a1ef59b73fc85309daa39b91ef975a73603641730f3d5f5e6b6116bbd414"} err="failed to get container status \"4ad6a1ef59b73fc85309daa39b91ef975a73603641730f3d5f5e6b6116bbd414\": rpc error: code = NotFound desc = could not find container \"4ad6a1ef59b73fc85309daa39b91ef975a73603641730f3d5f5e6b6116bbd414\": container with ID starting with 4ad6a1ef59b73fc85309daa39b91ef975a73603641730f3d5f5e6b6116bbd414 not found: ID does not exist"
Oct 31 00:00:10.307194 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.306845    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9"]
Oct 31 00:00:10.349191 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.349163    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"]
Oct 31 00:00:10.356915 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.356893    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-e15304-openshift-default-bc69747c7-7cj6f"]
Oct 31 00:00:10.704406 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.704371    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"]
Oct 31 00:00:10.750900 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.750867    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"]
Oct 31 00:00:10.910873 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.910840    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8adef569-361f-4e2b-82c2-43610bd3a7b8" path="/var/lib/kubelet/pods/8adef569-361f-4e2b-82c2-43610bd3a7b8/volumes"
Oct 31 00:00:10.911385 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.911369    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9927a847-b4b7-4c22-a3df-3ac672c98c80" path="/var/lib/kubelet/pods/9927a847-b4b7-4c22-a3df-3ac672c98c80/volumes"
Oct 31 00:00:10.965416 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:10.965378    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:11.029818 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:11.029780    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9" event={"ID":"5e2b3853-7e76-44f3-9536-02f877d8f6b6","Type":"ContainerStarted","Data":"2d10608b31fccf48c0f487ab171c0d0dd2ee165bb2555cd36b68a5ae7c6d318a"}
Oct 31 00:00:11.030007 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:11.029843    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9" event={"ID":"5e2b3853-7e76-44f3-9536-02f877d8f6b6","Type":"ContainerStarted","Data":"8f26a065f90bbd7be7f3c4dc789cd928c3b4a2afb12750eb9c54883d901eda6f"}
Oct 31 00:00:11.120407 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:11.113213    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9" podStartSLOduration=2.113187991 podStartE2EDuration="2.113187991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:00:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:00:11.058437771 +0000 UTC m=+2470.303293540" watchObservedRunningTime="2026-10-31 00:00:11.113187991 +0000 UTC m=+2470.358043760"
Oct 31 00:00:11.165836 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:11.165732    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:11.423833 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:00:11.423751    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:00:12.038280 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:12.038245    4921 generic.go:356] "Generic (PLEG): container finished" podID="5e2b3853-7e76-44f3-9536-02f877d8f6b6" containerID="2d10608b31fccf48c0f487ab171c0d0dd2ee165bb2555cd36b68a5ae7c6d318a" exitCode=0
Oct 31 00:00:12.038466 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:12.038294    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9" event={"ID":"5e2b3853-7e76-44f3-9536-02f877d8f6b6","Type":"ContainerDied","Data":"2d10608b31fccf48c0f487ab171c0d0dd2ee165bb2555cd36b68a5ae7c6d318a"}
Oct 31 00:00:12.350089 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:12.348730    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:13.262832 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:13.262799    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9"
Oct 31 00:00:13.367671 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:13.357372    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:13.454631 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:13.454580    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5e2b3853-7e76-44f3-9536-02f877d8f6b6-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5e2b3853-7e76-44f3-9536-02f877d8f6b6-maas-api-xks-ca\") pod \"5e2b3853-7e76-44f3-9536-02f877d8f6b6\" (UID: \"5e2b3853-7e76-44f3-9536-02f877d8f6b6\") "
Oct 31 00:00:13.454819 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:13.454688    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5e2b3853-7e76-44f3-9536-02f877d8f6b6-kube-api-access-zsf45\" (UniqueName: \"kubernetes.io/projected/5e2b3853-7e76-44f3-9536-02f877d8f6b6-kube-api-access-zsf45\") pod \"5e2b3853-7e76-44f3-9536-02f877d8f6b6\" (UID: \"5e2b3853-7e76-44f3-9536-02f877d8f6b6\") "
Oct 31 00:00:13.454883 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:13.454815    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5e2b3853-7e76-44f3-9536-02f877d8f6b6-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5e2b3853-7e76-44f3-9536-02f877d8f6b6-maas-api-openshift-ca\") pod \"5e2b3853-7e76-44f3-9536-02f877d8f6b6\" (UID: \"5e2b3853-7e76-44f3-9536-02f877d8f6b6\") "
Oct 31 00:00:13.455197 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:13.455166    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e2b3853-7e76-44f3-9536-02f877d8f6b6-maas-api-openshift-ca" pod "5e2b3853-7e76-44f3-9536-02f877d8f6b6" (UID: "5e2b3853-7e76-44f3-9536-02f877d8f6b6"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:00:13.455656 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:13.455617    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5e2b3853-7e76-44f3-9536-02f877d8f6b6-maas-api-openshift-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:13.457126 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:13.457099    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e2b3853-7e76-44f3-9536-02f877d8f6b6-maas-api-xks-ca" pod "5e2b3853-7e76-44f3-9536-02f877d8f6b6" (UID: "5e2b3853-7e76-44f3-9536-02f877d8f6b6"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:00:13.457260 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:13.457153    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e2b3853-7e76-44f3-9536-02f877d8f6b6-kube-api-access-zsf45" pod "5e2b3853-7e76-44f3-9536-02f877d8f6b6" (UID: "5e2b3853-7e76-44f3-9536-02f877d8f6b6"). InnerVolumeSpecName "kube-api-access-zsf45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:00:13.511585 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:13.511533    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:13.557202 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:13.557167    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5e2b3853-7e76-44f3-9536-02f877d8f6b6-maas-api-xks-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:13.557202 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:13.557204    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsf45\" (UniqueName: \"kubernetes.io/projected/5e2b3853-7e76-44f3-9536-02f877d8f6b6-kube-api-access-zsf45\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:13.680711 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:13.680679    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:14.057562 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:14.057477    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9"
Oct 31 00:00:14.057562 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:14.057501    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9" event={"ID":"5e2b3853-7e76-44f3-9536-02f877d8f6b6","Type":"ContainerDied","Data":"8f26a065f90bbd7be7f3c4dc789cd928c3b4a2afb12750eb9c54883d901eda6f"}
Oct 31 00:00:14.057562 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:14.057549    4921 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f26a065f90bbd7be7f3c4dc789cd928c3b4a2afb12750eb9c54883d901eda6f"
Oct 31 00:00:14.298187 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:14.298151    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb"]
Oct 31 00:00:14.323030 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:14.322910    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:14.609294 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:14.608722    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:14.644649 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:14.642102    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb"
Oct 31 00:00:14.694567 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:14.694535    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/484903ba-039f-440a-96d4-bbc02fc56f7f-kube-api-access-2mdvd\" (UniqueName: \"kubernetes.io/projected/484903ba-039f-440a-96d4-bbc02fc56f7f-kube-api-access-2mdvd\") pod \"484903ba-039f-440a-96d4-bbc02fc56f7f\" (UID: \"484903ba-039f-440a-96d4-bbc02fc56f7f\") "
Oct 31 00:00:14.694893 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:14.694868    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/484903ba-039f-440a-96d4-bbc02fc56f7f-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/484903ba-039f-440a-96d4-bbc02fc56f7f-maas-api-service-ca\") pod \"484903ba-039f-440a-96d4-bbc02fc56f7f\" (UID: \"484903ba-039f-440a-96d4-bbc02fc56f7f\") "
Oct 31 00:00:14.696155 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:14.696124    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/484903ba-039f-440a-96d4-bbc02fc56f7f-maas-api-service-ca" pod "484903ba-039f-440a-96d4-bbc02fc56f7f" (UID: "484903ba-039f-440a-96d4-bbc02fc56f7f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:00:14.700405 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:14.700377    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/484903ba-039f-440a-96d4-bbc02fc56f7f-kube-api-access-2mdvd" pod "484903ba-039f-440a-96d4-bbc02fc56f7f" (UID: "484903ba-039f-440a-96d4-bbc02fc56f7f"). InnerVolumeSpecName "kube-api-access-2mdvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:00:14.787122 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:14.787077    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:14.797441 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:14.797401    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/484903ba-039f-440a-96d4-bbc02fc56f7f-maas-api-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:14.797441 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:14.797438    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mdvd\" (UniqueName: \"kubernetes.io/projected/484903ba-039f-440a-96d4-bbc02fc56f7f-kube-api-access-2mdvd\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:14.883716 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:14.881227    4921 scope.go:122] "RemoveContainer" containerID="30b1837e1ae1676c6d5865f1fd6bae202fc1bcdaa13f0aa818197a4a8b4eadd8"
Oct 31 00:00:14.939526 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:14.937109    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:15.068576 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:15.068532    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb" event={"ID":"484903ba-039f-440a-96d4-bbc02fc56f7f","Type":"ContainerDied","Data":"7ff84a9b64e03e8762e1bcc3c9974bb49c12d6950151a753748670607f286f8a"}
Oct 31 00:00:15.068793 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:15.068674    4921 scope.go:122] "RemoveContainer" containerID="9d2cb96ed7f39fd08a1a8db826af63c3a6fb42ff04f4d3fff20a3423fc7c1a91"
Oct 31 00:00:15.068793 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:15.068742    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb"
Oct 31 00:00:15.114359 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:15.114324    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb"]
Oct 31 00:00:15.118672 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:15.118448    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-200408-29890080-rjwlb"]
Oct 31 00:00:15.395846 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:15.395806    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:15.915642 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:15.915575    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:16.079241 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:16.079207    4921 generic.go:356] "Generic (PLEG): container finished" podID="1ef59b37-69e3-44db-b44a-474785053368" containerID="ae97676eb50a463570448754ce56fb31c72417d0422fc302462bc313b755de3a" exitCode=60
Oct 31 00:00:16.079424 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:16.079221    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr"]
Oct 31 00:00:16.079424 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:16.079301    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g" event={"ID":"1ef59b37-69e3-44db-b44a-474785053368","Type":"ContainerDied","Data":"ae97676eb50a463570448754ce56fb31c72417d0422fc302462bc313b755de3a"}
Oct 31 00:00:16.079424 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:16.079331    4921 scope.go:122] "RemoveContainer" containerID="30b1837e1ae1676c6d5865f1fd6bae202fc1bcdaa13f0aa818197a4a8b4eadd8"
Oct 31 00:00:16.079861 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:16.079844    4921 scope.go:122] "RemoveContainer" containerID="ae97676eb50a463570448754ce56fb31c72417d0422fc302462bc313b755de3a"
Oct 31 00:00:16.080224 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:00:16.080192    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g_odh-ai-gateway-infra(1ef59b37-69e3-44db-b44a-474785053368)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g" podUID="1ef59b37-69e3-44db-b44a-474785053368"
Oct 31 00:00:16.168997 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:16.168903    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:16.436746 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:16.435102    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:16.876461 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:16.876365    4921 scope.go:122] "RemoveContainer" containerID="b61585a83694e417c7153639b16f28a31e887d4d603eff73a6ed9adddadd8567"
Oct 31 00:00:16.903385 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:16.903345    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="484903ba-039f-440a-96d4-bbc02fc56f7f" path="/var/lib/kubelet/pods/484903ba-039f-440a-96d4-bbc02fc56f7f/volumes"
Oct 31 00:00:17.072692 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:17.070494    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:17.167564 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:17.167524    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g"]
Oct 31 00:00:17.373807 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:17.373771    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g"
Oct 31 00:00:17.446759 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:17.446668    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ef59b37-69e3-44db-b44a-474785053368-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef59b37-69e3-44db-b44a-474785053368-maas-api-service-ca\") pod \"1ef59b37-69e3-44db-b44a-474785053368\" (UID: \"1ef59b37-69e3-44db-b44a-474785053368\") "
Oct 31 00:00:17.447232 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:17.447066    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ef59b37-69e3-44db-b44a-474785053368-maas-api-service-ca" pod "1ef59b37-69e3-44db-b44a-474785053368" (UID: "1ef59b37-69e3-44db-b44a-474785053368"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:00:17.447302 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:17.447260    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef59b37-69e3-44db-b44a-474785053368-maas-api-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:17.548012 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:17.547979    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ef59b37-69e3-44db-b44a-474785053368-kube-api-access-sv25q\" (UniqueName: \"kubernetes.io/projected/1ef59b37-69e3-44db-b44a-474785053368-kube-api-access-sv25q\") pod \"1ef59b37-69e3-44db-b44a-474785053368\" (UID: \"1ef59b37-69e3-44db-b44a-474785053368\") "
Oct 31 00:00:17.550350 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:17.550320    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ef59b37-69e3-44db-b44a-474785053368-kube-api-access-sv25q" pod "1ef59b37-69e3-44db-b44a-474785053368" (UID: "1ef59b37-69e3-44db-b44a-474785053368"). InnerVolumeSpecName "kube-api-access-sv25q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:00:17.649729 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:17.649696    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sv25q\" (UniqueName: \"kubernetes.io/projected/1ef59b37-69e3-44db-b44a-474785053368-kube-api-access-sv25q\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:17.711258 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:17.711161    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:17.866954 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:17.866914    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:18.038064 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.037988    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"]
Oct 31 00:00:18.038225 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.038188    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj" podUID="efb5db91-83e2-4884-bd0d-6a7d10787929" containerName="maas-api" containerID="cri-o://303f9103f3936d61693f15527dccb8ecb9eb65146eb9b6aebec3556302dbf4a8" gracePeriod=30
Oct 31 00:00:18.156376 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.156345    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g"
Oct 31 00:00:18.156560 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.156369    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g" event={"ID":"1ef59b37-69e3-44db-b44a-474785053368","Type":"ContainerDied","Data":"79185847d240c10a8c91f47e49aa9b5780142ff547af93c4b1c5beff6a9d14c8"}
Oct 31 00:00:18.156560 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.156448    4921 scope.go:122] "RemoveContainer" containerID="ae97676eb50a463570448754ce56fb31c72417d0422fc302462bc313b755de3a"
Oct 31 00:00:18.158496 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.158468    4921 generic.go:356] "Generic (PLEG): container finished" podID="c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" containerID="a2b529fb72214c4a17fcd9d66173ef5653d9ba697d4fa9f5333129f410b2bb25" exitCode=0
Oct 31 00:00:18.158678 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.158658    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb" event={"ID":"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970","Type":"ContainerDied","Data":"a2b529fb72214c4a17fcd9d66173ef5653d9ba697d4fa9f5333129f410b2bb25"}
Oct 31 00:00:18.160245 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.160224    4921 scope.go:122] "RemoveContainer" containerID="a2b529fb72214c4a17fcd9d66173ef5653d9ba697d4fa9f5333129f410b2bb25"
Oct 31 00:00:18.161375 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.161350    4921 generic.go:356] "Generic (PLEG): container finished" podID="3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a" containerID="11e33af8cc2cd188d97ec8bf43fc1794669e8283638b00369da17be242347861" exitCode=60
Oct 31 00:00:18.161492 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.161428    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg" event={"ID":"3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a","Type":"ContainerDied","Data":"11e33af8cc2cd188d97ec8bf43fc1794669e8283638b00369da17be242347861"}
Oct 31 00:00:18.161947 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.161925    4921 scope.go:122] "RemoveContainer" containerID="11e33af8cc2cd188d97ec8bf43fc1794669e8283638b00369da17be242347861"
Oct 31 00:00:18.162078 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.161918    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 31 00:00:18.162150 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.162083    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 31 00:00:18.162150 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.162134    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 31 00:00:18.162264 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:00:18.162245    4921 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg_odh-ai-gateway-infra(3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg" podUID="3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a"
Oct 31 00:00:18.165571 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.165545    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:18.169053 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.169034    4921 scope.go:122] "RemoveContainer" containerID="b61585a83694e417c7153639b16f28a31e887d4d603eff73a6ed9adddadd8567"
Oct 31 00:00:18.299563 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.299508    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g"]
Oct 31 00:00:18.464235 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.305242    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-d3dcca-29890080-jg79g"]
Oct 31 00:00:18.502947 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.502459    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:18.616616 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.612963    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"
Oct 31 00:00:18.731519 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.731424    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:18.797196 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.796807    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/efb5db91-83e2-4884-bd0d-6a7d10787929-kube-api-access-hm7gn\" (UniqueName: \"kubernetes.io/projected/efb5db91-83e2-4884-bd0d-6a7d10787929-kube-api-access-hm7gn\") pod \"efb5db91-83e2-4884-bd0d-6a7d10787929\" (UID: \"efb5db91-83e2-4884-bd0d-6a7d10787929\") "
Oct 31 00:00:18.797196 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.796984    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/efb5db91-83e2-4884-bd0d-6a7d10787929-metrics-certs\" (UniqueName: \"kubernetes.io/secret/efb5db91-83e2-4884-bd0d-6a7d10787929-metrics-certs\") pod \"efb5db91-83e2-4884-bd0d-6a7d10787929\" (UID: \"efb5db91-83e2-4884-bd0d-6a7d10787929\") "
Oct 31 00:00:18.797196 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.797057    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/efb5db91-83e2-4884-bd0d-6a7d10787929-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efb5db91-83e2-4884-bd0d-6a7d10787929-openshift-service-ca\") pod \"efb5db91-83e2-4884-bd0d-6a7d10787929\" (UID: \"efb5db91-83e2-4884-bd0d-6a7d10787929\") "
Oct 31 00:00:18.797196 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.797141    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/efb5db91-83e2-4884-bd0d-6a7d10787929-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efb5db91-83e2-4884-bd0d-6a7d10787929-maas-api-tls\") pod \"efb5db91-83e2-4884-bd0d-6a7d10787929\" (UID: \"efb5db91-83e2-4884-bd0d-6a7d10787929\") "
Oct 31 00:00:18.802700 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.802618    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efb5db91-83e2-4884-bd0d-6a7d10787929-maas-api-tls" pod "efb5db91-83e2-4884-bd0d-6a7d10787929" (UID: "efb5db91-83e2-4884-bd0d-6a7d10787929"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:00:18.806260 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.806183    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efb5db91-83e2-4884-bd0d-6a7d10787929-metrics-certs" pod "efb5db91-83e2-4884-bd0d-6a7d10787929" (UID: "efb5db91-83e2-4884-bd0d-6a7d10787929"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:00:18.829636 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.820341    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efb5db91-83e2-4884-bd0d-6a7d10787929-openshift-service-ca" pod "efb5db91-83e2-4884-bd0d-6a7d10787929" (UID: "efb5db91-83e2-4884-bd0d-6a7d10787929"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:00:18.853348 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.851474    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efb5db91-83e2-4884-bd0d-6a7d10787929-kube-api-access-hm7gn" pod "efb5db91-83e2-4884-bd0d-6a7d10787929" (UID: "efb5db91-83e2-4884-bd0d-6a7d10787929"). InnerVolumeSpecName "kube-api-access-hm7gn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:00:18.887362 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.887329    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1ef59b37-69e3-44db-b44a-474785053368" path="/var/lib/kubelet/pods/1ef59b37-69e3-44db-b44a-474785053368/volumes"
Oct 31 00:00:18.900256 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.899943    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm7gn\" (UniqueName: \"kubernetes.io/projected/efb5db91-83e2-4884-bd0d-6a7d10787929-kube-api-access-hm7gn\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:18.900256 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.900220    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efb5db91-83e2-4884-bd0d-6a7d10787929-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:18.900256 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.900232    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efb5db91-83e2-4884-bd0d-6a7d10787929-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:18.900256 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.900241    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efb5db91-83e2-4884-bd0d-6a7d10787929-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:18.914780 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:18.914753    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:19.191303 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.191262    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb" event={"ID":"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970","Type":"ContainerStarted","Data":"90c3cf18f316b0572758542becc54c57c2beeb7b347560767db6c8596f04756a"}
Oct 31 00:00:19.196738 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.195246    4921 generic.go:356] "Generic (PLEG): container finished" podID="efb5db91-83e2-4884-bd0d-6a7d10787929" containerID="303f9103f3936d61693f15527dccb8ecb9eb65146eb9b6aebec3556302dbf4a8" exitCode=0
Oct 31 00:00:19.196738 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.195356    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj" event={"ID":"efb5db91-83e2-4884-bd0d-6a7d10787929","Type":"ContainerDied","Data":"303f9103f3936d61693f15527dccb8ecb9eb65146eb9b6aebec3556302dbf4a8"}
Oct 31 00:00:19.196738 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.195391    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj" event={"ID":"efb5db91-83e2-4884-bd0d-6a7d10787929","Type":"ContainerDied","Data":"ea6a08b73efd4c0d13e6613ffa27cd10c9ed0fc8106c256dc7c6e29dc5143993"}
Oct 31 00:00:19.196738 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.195413    4921 scope.go:122] "RemoveContainer" containerID="303f9103f3936d61693f15527dccb8ecb9eb65146eb9b6aebec3556302dbf4a8"
Oct 31 00:00:19.196738 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.195473    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"
Oct 31 00:00:19.207763 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.207739    4921 scope.go:122] "RemoveContainer" containerID="303f9103f3936d61693f15527dccb8ecb9eb65146eb9b6aebec3556302dbf4a8"
Oct 31 00:00:19.208057 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:00:19.208038    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"303f9103f3936d61693f15527dccb8ecb9eb65146eb9b6aebec3556302dbf4a8\": container with ID starting with 303f9103f3936d61693f15527dccb8ecb9eb65146eb9b6aebec3556302dbf4a8 not found: ID does not exist" containerID="303f9103f3936d61693f15527dccb8ecb9eb65146eb9b6aebec3556302dbf4a8"
Oct 31 00:00:19.208127 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.208065    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"303f9103f3936d61693f15527dccb8ecb9eb65146eb9b6aebec3556302dbf4a8"} err="failed to get container status \"303f9103f3936d61693f15527dccb8ecb9eb65146eb9b6aebec3556302dbf4a8\": rpc error: code = NotFound desc = could not find container \"303f9103f3936d61693f15527dccb8ecb9eb65146eb9b6aebec3556302dbf4a8\": container with ID starting with 303f9103f3936d61693f15527dccb8ecb9eb65146eb9b6aebec3556302dbf4a8 not found: ID does not exist"
Oct 31 00:00:19.235446 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.235400    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:19.249612 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.249567    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"]
Oct 31 00:00:19.252883 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.252857    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj"]
Oct 31 00:00:19.294350 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.294309    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg"]
Oct 31 00:00:19.507324 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.507297    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg"
Oct 31 00:00:19.611875 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.611843    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a-maas-api-service-ca\") pod \"3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a\" (UID: \"3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a\") "
Oct 31 00:00:19.612053 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.611930    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a-kube-api-access-tg2fj\" (UniqueName: \"kubernetes.io/projected/3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a-kube-api-access-tg2fj\") pod \"3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a\" (UID: \"3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a\") "
Oct 31 00:00:19.612239 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.612215    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a-maas-api-service-ca" pod "3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a" (UID: "3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:00:19.612450 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.612436    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a-maas-api-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:19.614140 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.614112    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a-kube-api-access-tg2fj" pod "3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a" (UID: "3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a"). InnerVolumeSpecName "kube-api-access-tg2fj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:00:19.691632 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.688087    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 31 00:00:19.691632 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.688230    4921 patch_prober.go:29] interesting pod/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused" start-of-body=
Oct 31 00:00:19.691632 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.688276    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb" podUID="c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused"
Oct 31 00:00:19.714181 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:19.714093    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg2fj\" (UniqueName: \"kubernetes.io/projected/3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a-kube-api-access-tg2fj\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:20.029615 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:20.026245    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:20.209210 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:20.209183    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg"
Oct 31 00:00:20.209424 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:20.209224    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg" event={"ID":"3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a","Type":"ContainerDied","Data":"11465effa0527b33f4e6f8cf9608455ae137d0a771033386e9c901a7d804c54b"}
Oct 31 00:00:20.209424 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:20.209286    4921 scope.go:122] "RemoveContainer" containerID="11e33af8cc2cd188d97ec8bf43fc1794669e8283638b00369da17be242347861"
Oct 31 00:00:20.241315 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:20.241282    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg"]
Oct 31 00:00:20.261888 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:20.261847    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-dd3a15-29890080-wkndg"]
Oct 31 00:00:20.691622 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:20.691041    4921 patch_prober.go:29] interesting pod/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused" start-of-body=
Oct 31 00:00:20.691622 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:20.691105    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb" podUID="c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused"
Oct 31 00:00:20.903470 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:20.903437    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a" path="/var/lib/kubelet/pods/3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a/volumes"
Oct 31 00:00:20.904009 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:20.903993    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="efb5db91-83e2-4884-bd0d-6a7d10787929" path="/var/lib/kubelet/pods/efb5db91-83e2-4884-bd0d-6a7d10787929/volumes"
Oct 31 00:00:21.087669 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:21.084674    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr" podUID="e0f8155c-e961-4fec-9802-20e2ac4a0428" containerName="payload-processing" containerID="cri-o://96beb12d375a35951f37465c6d9ae883b67a98efbebef88800ac7409c757dd49" gracePeriod=25
Oct 31 00:00:21.100618 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:21.090510    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:21.536642 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:21.536574    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-4e6c3b-fbc859649-pf9rj" podUID="efb5db91-83e2-4884-bd0d-6a7d10787929" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.127:8443/health\": context deadline exceeded"
Oct 31 00:00:21.670621 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:21.667974    4921 patch_prober.go:29] interesting pod/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused" start-of-body=
Oct 31 00:00:21.670621 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:21.668032    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb" podUID="c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused"
Oct 31 00:00:21.994656 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:21.994040    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:22.313738 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:22.313574    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:22.508259 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:22.508225    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:22.675618 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:22.670050    4921 patch_prober.go:29] interesting pod/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused" start-of-body=
Oct 31 00:00:22.675618 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:22.670114    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb" podUID="c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused"
Oct 31 00:00:22.981686 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:22.970161    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:23.523221 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:23.523192    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:23.670623 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:23.668039    4921 patch_prober.go:29] interesting pod/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused" start-of-body=
Oct 31 00:00:23.670623 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:23.668098    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb" podUID="c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused"
Oct 31 00:00:23.991617 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:23.988191    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:24.674847 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:24.674809    4921 patch_prober.go:29] interesting pod/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused" start-of-body=
Oct 31 00:00:24.677723 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:24.676322    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb" podUID="c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused"
Oct 31 00:00:24.784246 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:24.784201    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:25.102746 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:25.102587    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:25.304617 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:25.293166    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:25.601135 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:25.601094    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:25.672523 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:25.672493    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 31 00:00:25.672856 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:25.672837    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 31 00:00:25.673459 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:25.673441    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 31 00:00:25.728441 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:25.728227    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main" containerID="cri-o://19e51aca58b21f68f94cf952d613dc643ff077a2efecfa6ffc7ba9992c182281" gracePeriod=45
Oct 31 00:00:25.799183 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:25.799134    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:25.821239 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:25.821200    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main" containerID="cri-o://33efad03ffeb7081e49c2b7353a9441c9e99bbd1589fb27d409360f5c746bf06" gracePeriod=45
Oct 31 00:00:26.135393 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.135366    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 31 00:00:26.146180 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.146154    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 31 00:00:26.152581 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.152557    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf03d62a-8708-41ed-9013-90e30a26cd9a-kube-api-access-5qh8d\" (UniqueName: \"kubernetes.io/projected/cf03d62a-8708-41ed-9013-90e30a26cd9a-kube-api-access-5qh8d\") pod \"cf03d62a-8708-41ed-9013-90e30a26cd9a\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") "
Oct 31 00:00:26.152739 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.152672    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-tmp-dir\") pod \"cf03d62a-8708-41ed-9013-90e30a26cd9a\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") "
Oct 31 00:00:26.152808 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.152742    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/288e6fd4-35b6-4452-8069-0f22ad2c094b-tls-certs\" (UniqueName: \"kubernetes.io/secret/288e6fd4-35b6-4452-8069-0f22ad2c094b-tls-certs\") pod \"288e6fd4-35b6-4452-8069-0f22ad2c094b\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") "
Oct 31 00:00:26.152808 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.152763    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-dshm\") pod \"288e6fd4-35b6-4452-8069-0f22ad2c094b\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") "
Oct 31 00:00:26.152808 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.152785    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-model-cache\") pod \"288e6fd4-35b6-4452-8069-0f22ad2c094b\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") "
Oct 31 00:00:26.152808 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.152803    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-home\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-home\") pod \"cf03d62a-8708-41ed-9013-90e30a26cd9a\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") "
Oct 31 00:00:26.153045 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.152853    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/288e6fd4-35b6-4452-8069-0f22ad2c094b-kube-api-access-htmbw\" (UniqueName: \"kubernetes.io/projected/288e6fd4-35b6-4452-8069-0f22ad2c094b-kube-api-access-htmbw\") pod \"288e6fd4-35b6-4452-8069-0f22ad2c094b\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") "
Oct 31 00:00:26.153045 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.152877    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-model-cache\") pod \"cf03d62a-8708-41ed-9013-90e30a26cd9a\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") "
Oct 31 00:00:26.153045 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.152916    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-home\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-home\") pod \"288e6fd4-35b6-4452-8069-0f22ad2c094b\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") "
Oct 31 00:00:26.153045 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.152933    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-dshm\") pod \"cf03d62a-8708-41ed-9013-90e30a26cd9a\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") "
Oct 31 00:00:26.153045 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.152936    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-tmp-dir" pod "cf03d62a-8708-41ed-9013-90e30a26cd9a" (UID: "cf03d62a-8708-41ed-9013-90e30a26cd9a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:00:26.153045 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.152967    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-tmp-dir\") pod \"288e6fd4-35b6-4452-8069-0f22ad2c094b\" (UID: \"288e6fd4-35b6-4452-8069-0f22ad2c094b\") "
Oct 31 00:00:26.153045 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.153033    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cf03d62a-8708-41ed-9013-90e30a26cd9a-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf03d62a-8708-41ed-9013-90e30a26cd9a-tls-certs\") pod \"cf03d62a-8708-41ed-9013-90e30a26cd9a\" (UID: \"cf03d62a-8708-41ed-9013-90e30a26cd9a\") "
Oct 31 00:00:26.153412 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.153076    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-model-cache" pod "288e6fd4-35b6-4452-8069-0f22ad2c094b" (UID: "288e6fd4-35b6-4452-8069-0f22ad2c094b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:00:26.153412 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.153158    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-model-cache" pod "cf03d62a-8708-41ed-9013-90e30a26cd9a" (UID: "cf03d62a-8708-41ed-9013-90e30a26cd9a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:00:26.153412 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.153302    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-home" pod "cf03d62a-8708-41ed-9013-90e30a26cd9a" (UID: "cf03d62a-8708-41ed-9013-90e30a26cd9a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:00:26.153571 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.153498    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-tmp-dir" pod "288e6fd4-35b6-4452-8069-0f22ad2c094b" (UID: "288e6fd4-35b6-4452-8069-0f22ad2c094b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:00:26.153926 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.153779    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-home" pod "288e6fd4-35b6-4452-8069-0f22ad2c094b" (UID: "288e6fd4-35b6-4452-8069-0f22ad2c094b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:00:26.154173 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.154111    4921 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-model-cache\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:26.154173 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.154138    4921 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-home\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:26.154173 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.154152    4921 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-tmp-dir\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:26.154173 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.154167    4921 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-tmp-dir\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:26.154173 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.154180    4921 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-model-cache\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:26.154173 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.154194    4921 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-home\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:26.155409 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.155387    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf03d62a-8708-41ed-9013-90e30a26cd9a-kube-api-access-5qh8d" pod "cf03d62a-8708-41ed-9013-90e30a26cd9a" (UID: "cf03d62a-8708-41ed-9013-90e30a26cd9a"). InnerVolumeSpecName "kube-api-access-5qh8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:00:26.155906 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.155882    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/288e6fd4-35b6-4452-8069-0f22ad2c094b-kube-api-access-htmbw" pod "288e6fd4-35b6-4452-8069-0f22ad2c094b" (UID: "288e6fd4-35b6-4452-8069-0f22ad2c094b"). InnerVolumeSpecName "kube-api-access-htmbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:00:26.156031 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.156004    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-dshm" pod "cf03d62a-8708-41ed-9013-90e30a26cd9a" (UID: "cf03d62a-8708-41ed-9013-90e30a26cd9a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:00:26.157059 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.157037    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-dshm" pod "288e6fd4-35b6-4452-8069-0f22ad2c094b" (UID: "288e6fd4-35b6-4452-8069-0f22ad2c094b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:00:26.157183 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.157166    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/288e6fd4-35b6-4452-8069-0f22ad2c094b-tls-certs" pod "288e6fd4-35b6-4452-8069-0f22ad2c094b" (UID: "288e6fd4-35b6-4452-8069-0f22ad2c094b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:00:26.157741 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.157708    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf03d62a-8708-41ed-9013-90e30a26cd9a-tls-certs" pod "cf03d62a-8708-41ed-9013-90e30a26cd9a" (UID: "cf03d62a-8708-41ed-9013-90e30a26cd9a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:00:26.255163 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.255066    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htmbw\" (UniqueName: \"kubernetes.io/projected/288e6fd4-35b6-4452-8069-0f22ad2c094b-kube-api-access-htmbw\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:26.255163 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.255100    4921 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf03d62a-8708-41ed-9013-90e30a26cd9a-dshm\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:26.255163 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.255116    4921 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf03d62a-8708-41ed-9013-90e30a26cd9a-tls-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:26.255163 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.255128    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qh8d\" (UniqueName: \"kubernetes.io/projected/cf03d62a-8708-41ed-9013-90e30a26cd9a-kube-api-access-5qh8d\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:26.255163 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.255143    4921 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/288e6fd4-35b6-4452-8069-0f22ad2c094b-tls-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:26.255163 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.255155    4921 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/288e6fd4-35b6-4452-8069-0f22ad2c094b-dshm\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:26.277550 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.277520    4921 generic.go:356] "Generic (PLEG): container finished" podID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerID="19e51aca58b21f68f94cf952d613dc643ff077a2efecfa6ffc7ba9992c182281" exitCode=0
Oct 31 00:00:26.277737 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.277580    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"
Oct 31 00:00:26.277737 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.277645    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" event={"ID":"cf03d62a-8708-41ed-9013-90e30a26cd9a","Type":"ContainerDied","Data":"19e51aca58b21f68f94cf952d613dc643ff077a2efecfa6ffc7ba9992c182281"}
Oct 31 00:00:26.277737 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.277690    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66" event={"ID":"cf03d62a-8708-41ed-9013-90e30a26cd9a","Type":"ContainerDied","Data":"a0bc94292037259eed83eec1aa89bf7175d43cef3ea07807411fd0ccba82778b"}
Oct 31 00:00:26.277737 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.277712    4921 scope.go:122] "RemoveContainer" containerID="19e51aca58b21f68f94cf952d613dc643ff077a2efecfa6ffc7ba9992c182281"
Oct 31 00:00:26.279446 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.279420    4921 generic.go:356] "Generic (PLEG): container finished" podID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerID="33efad03ffeb7081e49c2b7353a9441c9e99bbd1589fb27d409360f5c746bf06" exitCode=0
Oct 31 00:00:26.280451 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.280430    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"
Oct 31 00:00:26.281665 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.281636    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" event={"ID":"288e6fd4-35b6-4452-8069-0f22ad2c094b","Type":"ContainerDied","Data":"33efad03ffeb7081e49c2b7353a9441c9e99bbd1589fb27d409360f5c746bf06"}
Oct 31 00:00:26.281785 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.281678    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j" event={"ID":"288e6fd4-35b6-4452-8069-0f22ad2c094b","Type":"ContainerDied","Data":"71f448b6e4f6ebe40f72a803366011debcb7628d18f3e4f6e154e53a61915011"}
Oct 31 00:00:26.291325 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.290767    4921 scope.go:122] "RemoveContainer" containerID="19e51aca58b21f68f94cf952d613dc643ff077a2efecfa6ffc7ba9992c182281"
Oct 31 00:00:26.291821 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:00:26.291794    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19e51aca58b21f68f94cf952d613dc643ff077a2efecfa6ffc7ba9992c182281\": container with ID starting with 19e51aca58b21f68f94cf952d613dc643ff077a2efecfa6ffc7ba9992c182281 not found: ID does not exist" containerID="19e51aca58b21f68f94cf952d613dc643ff077a2efecfa6ffc7ba9992c182281"
Oct 31 00:00:26.291933 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.291834    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19e51aca58b21f68f94cf952d613dc643ff077a2efecfa6ffc7ba9992c182281"} err="failed to get container status \"19e51aca58b21f68f94cf952d613dc643ff077a2efecfa6ffc7ba9992c182281\": rpc error: code = NotFound desc = could not find container \"19e51aca58b21f68f94cf952d613dc643ff077a2efecfa6ffc7ba9992c182281\": container with ID starting with 19e51aca58b21f68f94cf952d613dc643ff077a2efecfa6ffc7ba9992c182281 not found: ID does not exist"
Oct 31 00:00:26.291933 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.291860    4921 scope.go:122] "RemoveContainer" containerID="33efad03ffeb7081e49c2b7353a9441c9e99bbd1589fb27d409360f5c746bf06"
Oct 31 00:00:26.302369 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.302350    4921 scope.go:122] "RemoveContainer" containerID="33efad03ffeb7081e49c2b7353a9441c9e99bbd1589fb27d409360f5c746bf06"
Oct 31 00:00:26.302680 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:00:26.302653    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33efad03ffeb7081e49c2b7353a9441c9e99bbd1589fb27d409360f5c746bf06\": container with ID starting with 33efad03ffeb7081e49c2b7353a9441c9e99bbd1589fb27d409360f5c746bf06 not found: ID does not exist" containerID="33efad03ffeb7081e49c2b7353a9441c9e99bbd1589fb27d409360f5c746bf06"
Oct 31 00:00:26.302752 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.302691    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33efad03ffeb7081e49c2b7353a9441c9e99bbd1589fb27d409360f5c746bf06"} err="failed to get container status \"33efad03ffeb7081e49c2b7353a9441c9e99bbd1589fb27d409360f5c746bf06\": rpc error: code = NotFound desc = could not find container \"33efad03ffeb7081e49c2b7353a9441c9e99bbd1589fb27d409360f5c746bf06\": container with ID starting with 33efad03ffeb7081e49c2b7353a9441c9e99bbd1589fb27d409360f5c746bf06 not found: ID does not exist"
Oct 31 00:00:26.343463 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.343434    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"]
Oct 31 00:00:26.346385 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.346363    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-b567bb/distinct-2-w3-b567bb-kserve-7485875cd7-n4l66"]
Oct 31 00:00:26.358041 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.358014    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"]
Oct 31 00:00:26.362296 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:00:26.362263    4921 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf03d62a_8708_41ed_9013_90e30a26cd9a.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod288e6fd4_35b6_4452_8069_0f22ad2c094b.slice/crio-71f448b6e4f6ebe40f72a803366011debcb7628d18f3e4f6e154e53a61915011\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod288e6fd4_35b6_4452_8069_0f22ad2c094b.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf03d62a_8708_41ed_9013_90e30a26cd9a.slice/crio-a0bc94292037259eed83eec1aa89bf7175d43cef3ea07807411fd0ccba82778b\": RecentStats: unable to find data in memory cache]"
Oct 31 00:00:26.375576 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.375553    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-b567bb/simulator-w3-b567bb-kserve-5d6cc4b4fb-pdm8j"]
Oct 31 00:00:26.826623 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.821688    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:26.899631 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.892770    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr" podUID="e0f8155c-e961-4fec-9802-20e2ac4a0428" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:00:26.935436 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.935398    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" path="/var/lib/kubelet/pods/288e6fd4-35b6-4452-8069-0f22ad2c094b/volumes"
Oct 31 00:00:26.936150 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:26.936127    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" path="/var/lib/kubelet/pods/cf03d62a-8708-41ed-9013-90e30a26cd9a/volumes"
Oct 31 00:00:27.731789 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:27.731752    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:27.958497 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:27.957807    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:28.170487 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:28.170456    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:28.554201 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:28.554093    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:28.773326 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:28.769252    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:29.390460 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:29.390395    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:30.614255 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:30.614223    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:31.205307 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:31.205274    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:31.584298 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:31.584265    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:32.683617 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:32.676211    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:33.118746 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:33.118665    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:33.855788 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:33.855428    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:34.690964 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:34.690929    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:34.964390 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:34.955172    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:35.154359 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:35.154303    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:35.429150 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:35.429117    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:35.655312 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:35.655273    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:35.850658 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:35.850553    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:36.031513 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:36.031471    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:36.284677 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:36.284626    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:36.858994 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:36.858955    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr" podUID="e0f8155c-e961-4fec-9802-20e2ac4a0428" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:00:37.810225 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:37.810192    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:39.260057 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:39.258048    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:40.543652 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:40.543606    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:41.363420 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:41.363355    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr"
Oct 31 00:00:41.408803 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:00:41.408764    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:00:41.424926 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:41.424897    4921 generic.go:356] "Generic (PLEG): container finished" podID="e0f8155c-e961-4fec-9802-20e2ac4a0428" containerID="96beb12d375a35951f37465c6d9ae883b67a98efbebef88800ac7409c757dd49" exitCode=0
Oct 31 00:00:41.425090 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:41.424945    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr"
Oct 31 00:00:41.425090 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:41.424981    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr" event={"ID":"e0f8155c-e961-4fec-9802-20e2ac4a0428","Type":"ContainerDied","Data":"96beb12d375a35951f37465c6d9ae883b67a98efbebef88800ac7409c757dd49"}
Oct 31 00:00:41.425090 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:41.425075    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr" event={"ID":"e0f8155c-e961-4fec-9802-20e2ac4a0428","Type":"ContainerDied","Data":"50392a99dfc6e95d295ac7c7c81a6113fade122cf5c4bf808f809b3d4b4ef808"}
Oct 31 00:00:41.425218 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:41.425102    4921 scope.go:122] "RemoveContainer" containerID="96beb12d375a35951f37465c6d9ae883b67a98efbebef88800ac7409c757dd49"
Oct 31 00:00:41.437381 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:41.437353    4921 scope.go:122] "RemoveContainer" containerID="96beb12d375a35951f37465c6d9ae883b67a98efbebef88800ac7409c757dd49"
Oct 31 00:00:41.438236 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:00:41.438137    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96beb12d375a35951f37465c6d9ae883b67a98efbebef88800ac7409c757dd49\": container with ID starting with 96beb12d375a35951f37465c6d9ae883b67a98efbebef88800ac7409c757dd49 not found: ID does not exist" containerID="96beb12d375a35951f37465c6d9ae883b67a98efbebef88800ac7409c757dd49"
Oct 31 00:00:41.438236 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:41.438175    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96beb12d375a35951f37465c6d9ae883b67a98efbebef88800ac7409c757dd49"} err="failed to get container status \"96beb12d375a35951f37465c6d9ae883b67a98efbebef88800ac7409c757dd49\": rpc error: code = NotFound desc = could not find container \"96beb12d375a35951f37465c6d9ae883b67a98efbebef88800ac7409c757dd49\": container with ID starting with 96beb12d375a35951f37465c6d9ae883b67a98efbebef88800ac7409c757dd49 not found: ID does not exist"
Oct 31 00:00:41.441682 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:41.441661    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e0f8155c-e961-4fec-9802-20e2ac4a0428-kube-api-access-6b5gh\" (UniqueName: \"kubernetes.io/projected/e0f8155c-e961-4fec-9802-20e2ac4a0428-kube-api-access-6b5gh\") pod \"e0f8155c-e961-4fec-9802-20e2ac4a0428\" (UID: \"e0f8155c-e961-4fec-9802-20e2ac4a0428\") "
Oct 31 00:00:41.441799 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:41.441751    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e0f8155c-e961-4fec-9802-20e2ac4a0428-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0f8155c-e961-4fec-9802-20e2ac4a0428-plugins-config-volume\") pod \"e0f8155c-e961-4fec-9802-20e2ac4a0428\" (UID: \"e0f8155c-e961-4fec-9802-20e2ac4a0428\") "
Oct 31 00:00:41.442100 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:41.442078    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0f8155c-e961-4fec-9802-20e2ac4a0428-plugins-config-volume" pod "e0f8155c-e961-4fec-9802-20e2ac4a0428" (UID: "e0f8155c-e961-4fec-9802-20e2ac4a0428"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:00:41.442319 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:41.442302    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0f8155c-e961-4fec-9802-20e2ac4a0428-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:41.443917 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:41.443893    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0f8155c-e961-4fec-9802-20e2ac4a0428-kube-api-access-6b5gh" pod "e0f8155c-e961-4fec-9802-20e2ac4a0428" (UID: "e0f8155c-e961-4fec-9802-20e2ac4a0428"). InnerVolumeSpecName "kube-api-access-6b5gh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:00:41.544262 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:41.544230    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b5gh\" (UniqueName: \"kubernetes.io/projected/e0f8155c-e961-4fec-9802-20e2ac4a0428-kube-api-access-6b5gh\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:00:41.759187 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:41.759155    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr"]
Oct 31 00:00:41.769613 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:41.766258    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-b567bb-65d5c89669-hjnzr"]
Oct 31 00:00:41.898401 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:41.898367    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:42.884048 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:42.884013    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e0f8155c-e961-4fec-9802-20e2ac4a0428" path="/var/lib/kubelet/pods/e0f8155c-e961-4fec-9802-20e2ac4a0428/volumes"
Oct 31 00:00:42.999617 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:42.999540    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:43.653366 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:43.653298    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:43.877301 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:43.877254    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:44.512864 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:44.512814    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:44.787404 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:44.787306    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:44.988735 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:44.988693    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:45.920926 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:45.920892    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:46.891238 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:46.891202    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:47.448772 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:47.448742    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:47.922538 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:47.922423    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:48.754548 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:48.754484    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:49.518348 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:49.518314    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:50.212474 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:50.212439    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:50.955775 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:50.955739    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:51.814629 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:51.807832    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:52.502467 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:52.502428    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:53.247624 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:53.246881    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:53.960951 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:53.960915    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:54.729308 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:54.729277    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:54.863538 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:54.863508    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:55.041424 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:55.041326    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:55.190482 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:55.190444    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:55.458646 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:55.458607    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"]
Oct 31 00:00:55.458862 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:55.458838    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td" podUID="22dee8ec-69c0-4889-adb1-8ecde0d7b66a" containerName="istio-proxy" containerID="cri-o://19915ae7629493778d44bd2dbec4319b6d0091ac56fd165f1f53090f409208cc" gracePeriod=30
Oct 31 00:00:55.539444 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:55.539409    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:55.550946 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:55.550919    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"]
Oct 31 00:00:55.551385 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:55.551158    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t" podUID="4993a595-ab1b-49b4-bb75-3efa3f127527" containerName="istio-proxy" containerID="cri-o://74e402b99c238752fe0e0ffccc1687a3fe275ea11c8c9f949b8f7bf73281cc62" gracePeriod=30
Oct 31 00:00:55.747558 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:55.747476    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:55.904233 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:55.904204    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:56.913507 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:56.913476    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:57.091833 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:57.091799    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:57.236331 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:57.236248    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:57.398316 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:57.398267    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"]
Oct 31 00:00:57.398579 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:57.398537    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c" podUID="8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" containerName="istio-proxy" containerID="cri-o://d07d9c6592ecb0eae271cb704cef28d3e3eba92c5822653321ce19fd03c59e45" gracePeriod=30
Oct 31 00:00:57.401747 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:57.401725    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"]
Oct 31 00:00:57.401922 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:57.401902    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7" podUID="d32e7e03-43b2-463a-844f-b34c46203491" containerName="istio-proxy" containerID="cri-o://38af2ba2e052f2b2521a3c6835c6024fd3cdfc7df7124a9d2e6071a3de167793" gracePeriod=30
Oct 31 00:00:57.520712 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:57.520621    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:57.711567 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:57.711530    4921 patch_prober.go:29] interesting pod/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:00:57.711780 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:57.711604    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td" podUID="22dee8ec-69c0-4889-adb1-8ecde0d7b66a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:00:57.989617 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:57.987116    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:58.980357 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:58.974164    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:59.145481 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:59.145441    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:59.322976 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:59.322895    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:59.513713 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:59.512951    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:59.655413 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:59.655382    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:00:59.765036 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:59.764995    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"]
Oct 31 00:00:59.765363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:59.765331    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv" podUID="4f146534-bcab-407d-ad28-d9528ca641c3" containerName="istio-proxy" containerID="cri-o://ec30b3f5b55fdb357570390feeefd4ea98c53f8953f35cb48ce16615fd5448a8" gracePeriod=30
Oct 31 00:00:59.879220 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:00:59.879183    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:00.127044 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.126959    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:00.584556 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.584526    4921 generic.go:356] "Generic (PLEG): container finished" podID="22dee8ec-69c0-4889-adb1-8ecde0d7b66a" containerID="19915ae7629493778d44bd2dbec4319b6d0091ac56fd165f1f53090f409208cc" exitCode=0
Oct 31 00:01:00.584927 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.584621    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td" event={"ID":"22dee8ec-69c0-4889-adb1-8ecde0d7b66a","Type":"ContainerDied","Data":"19915ae7629493778d44bd2dbec4319b6d0091ac56fd165f1f53090f409208cc"}
Oct 31 00:01:00.584927 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.584695    4921 scope.go:122] "RemoveContainer" containerID="7aec0905983c2beab328983940a6b63cf5af50eb687ae8243ea62949632366f2"
Oct 31 00:01:00.755316 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.755216    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 31 00:01:00.863317 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.863287    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 31 00:01:00.920421 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.920393    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-envoy\") pod \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") "
Oct 31 00:01:00.920604 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.920483    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-podinfo\") pod \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") "
Oct 31 00:01:00.920604 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.920506    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-data\") pod \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") "
Oct 31 00:01:00.920604 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.920543    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-workload-certs\") pod \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") "
Oct 31 00:01:00.920604 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.920582    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-workload-socket\") pod \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") "
Oct 31 00:01:00.920831 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.920670    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-kube-api-access-gnt7r\" (UniqueName: \"kubernetes.io/projected/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-kube-api-access-gnt7r\") pod \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") "
Oct 31 00:01:00.920831 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.920714    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-token\" (UniqueName: \"kubernetes.io/projected/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-token\") pod \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") "
Oct 31 00:01:00.920831 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.920753    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istiod-ca-cert\") pod \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") "
Oct 31 00:01:00.920831 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.920809    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-credential-socket\") pod \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\" (UID: \"22dee8ec-69c0-4889-adb1-8ecde0d7b66a\") "
Oct 31 00:01:00.921186 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.921157    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-data" pod "22dee8ec-69c0-4889-adb1-8ecde0d7b66a" (UID: "22dee8ec-69c0-4889-adb1-8ecde0d7b66a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:00.921277 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.921191    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-workload-certs" pod "22dee8ec-69c0-4889-adb1-8ecde0d7b66a" (UID: "22dee8ec-69c0-4889-adb1-8ecde0d7b66a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:00.921417 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.921392    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-credential-socket" pod "22dee8ec-69c0-4889-adb1-8ecde0d7b66a" (UID: "22dee8ec-69c0-4889-adb1-8ecde0d7b66a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:00.921417 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.921395    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-workload-socket" pod "22dee8ec-69c0-4889-adb1-8ecde0d7b66a" (UID: "22dee8ec-69c0-4889-adb1-8ecde0d7b66a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:00.921525 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.921459    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:00.921525 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.921479    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:00.921525 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.921484    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istiod-ca-cert" pod "22dee8ec-69c0-4889-adb1-8ecde0d7b66a" (UID: "22dee8ec-69c0-4889-adb1-8ecde0d7b66a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:01:00.922925 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.922899    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-envoy" pod "22dee8ec-69c0-4889-adb1-8ecde0d7b66a" (UID: "22dee8ec-69c0-4889-adb1-8ecde0d7b66a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:00.923497 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.923475    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-podinfo" pod "22dee8ec-69c0-4889-adb1-8ecde0d7b66a" (UID: "22dee8ec-69c0-4889-adb1-8ecde0d7b66a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:01:00.923620 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.923518    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-kube-api-access-gnt7r" pod "22dee8ec-69c0-4889-adb1-8ecde0d7b66a" (UID: "22dee8ec-69c0-4889-adb1-8ecde0d7b66a"). InnerVolumeSpecName "kube-api-access-gnt7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:01:00.923905 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:00.923886    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-token" pod "22dee8ec-69c0-4889-adb1-8ecde0d7b66a" (UID: "22dee8ec-69c0-4889-adb1-8ecde0d7b66a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:01:01.022711 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.022634    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-data\") pod \"4993a595-ab1b-49b4-bb75-3efa3f127527\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") "
Oct 31 00:01:01.022711 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.022693    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-token\" (UniqueName: \"kubernetes.io/projected/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-token\") pod \"4993a595-ab1b-49b4-bb75-3efa3f127527\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") "
Oct 31 00:01:01.022945 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.022758    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-podinfo\") pod \"4993a595-ab1b-49b4-bb75-3efa3f127527\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") "
Oct 31 00:01:01.022945 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.022815    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-envoy\") pod \"4993a595-ab1b-49b4-bb75-3efa3f127527\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") "
Oct 31 00:01:01.022945 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.022892    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-data" pod "4993a595-ab1b-49b4-bb75-3efa3f127527" (UID: "4993a595-ab1b-49b4-bb75-3efa3f127527"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:01.022945 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.022901    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4993a595-ab1b-49b4-bb75-3efa3f127527-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4993a595-ab1b-49b4-bb75-3efa3f127527-istiod-ca-cert\") pod \"4993a595-ab1b-49b4-bb75-3efa3f127527\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") "
Oct 31 00:01:01.023269 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.022988    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4993a595-ab1b-49b4-bb75-3efa3f127527-kube-api-access-9fw7g\" (UniqueName: \"kubernetes.io/projected/4993a595-ab1b-49b4-bb75-3efa3f127527-kube-api-access-9fw7g\") pod \"4993a595-ab1b-49b4-bb75-3efa3f127527\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") "
Oct 31 00:01:01.023269 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.023015    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-workload-socket\") pod \"4993a595-ab1b-49b4-bb75-3efa3f127527\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") "
Oct 31 00:01:01.023269 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.023108    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-workload-certs\") pod \"4993a595-ab1b-49b4-bb75-3efa3f127527\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") "
Oct 31 00:01:01.023269 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.023154    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-credential-socket\") pod \"4993a595-ab1b-49b4-bb75-3efa3f127527\" (UID: \"4993a595-ab1b-49b4-bb75-3efa3f127527\") "
Oct 31 00:01:01.023269 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.023238    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4993a595-ab1b-49b4-bb75-3efa3f127527-istiod-ca-cert" pod "4993a595-ab1b-49b4-bb75-3efa3f127527" (UID: "4993a595-ab1b-49b4-bb75-3efa3f127527"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:01:01.023675 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.023319    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-workload-socket" pod "4993a595-ab1b-49b4-bb75-3efa3f127527" (UID: "4993a595-ab1b-49b4-bb75-3efa3f127527"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:01.023675 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.023297    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-workload-certs" pod "4993a595-ab1b-49b4-bb75-3efa3f127527" (UID: "4993a595-ab1b-49b4-bb75-3efa3f127527"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:01.023675 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.023562    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-credential-socket" pod "4993a595-ab1b-49b4-bb75-3efa3f127527" (UID: "4993a595-ab1b-49b4-bb75-3efa3f127527"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:01.024736 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.024708    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:01.024876 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.024736    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:01.024876 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.024755    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:01.024876 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.024771    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:01.024876 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.024787    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:01.024876 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.024801    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:01.024876 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.024815    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:01.024876 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.024829    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnt7r\" (UniqueName: \"kubernetes.io/projected/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-kube-api-access-gnt7r\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:01.024876 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.024844    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:01.024876 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.024857    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:01.024876 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.024869    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22dee8ec-69c0-4889-adb1-8ecde0d7b66a-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:01.025441 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.024883    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4993a595-ab1b-49b4-bb75-3efa3f127527-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:01.025441 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.025420    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4993a595-ab1b-49b4-bb75-3efa3f127527-kube-api-access-9fw7g" pod "4993a595-ab1b-49b4-bb75-3efa3f127527" (UID: "4993a595-ab1b-49b4-bb75-3efa3f127527"). InnerVolumeSpecName "kube-api-access-9fw7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:01:01.025512 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.025458    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-podinfo" pod "4993a595-ab1b-49b4-bb75-3efa3f127527" (UID: "4993a595-ab1b-49b4-bb75-3efa3f127527"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:01:01.025654 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.025637    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-token" pod "4993a595-ab1b-49b4-bb75-3efa3f127527" (UID: "4993a595-ab1b-49b4-bb75-3efa3f127527"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:01:01.025715 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.025695    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-envoy" pod "4993a595-ab1b-49b4-bb75-3efa3f127527" (UID: "4993a595-ab1b-49b4-bb75-3efa3f127527"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:01.104538 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.104504    4921 patch_prober.go:29] interesting pod/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:01:01.104809 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.104566    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c" podUID="8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:01:01.125738 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.125709    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fw7g\" (UniqueName: \"kubernetes.io/projected/4993a595-ab1b-49b4-bb75-3efa3f127527-kube-api-access-9fw7g\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:01.125738 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.125739    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:01.125922 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.125753    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:01.125922 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.125767    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4993a595-ab1b-49b4-bb75-3efa3f127527-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:01.131835 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.131454    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:01.596848 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.596806    4921 generic.go:356] "Generic (PLEG): container finished" podID="4993a595-ab1b-49b4-bb75-3efa3f127527" containerID="74e402b99c238752fe0e0ffccc1687a3fe275ea11c8c9f949b8f7bf73281cc62" exitCode=0
Oct 31 00:01:01.597323 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.596884    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"
Oct 31 00:01:01.597323 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.596883    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t" event={"ID":"4993a595-ab1b-49b4-bb75-3efa3f127527","Type":"ContainerDied","Data":"74e402b99c238752fe0e0ffccc1687a3fe275ea11c8c9f949b8f7bf73281cc62"}
Oct 31 00:01:01.597323 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.596989    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t" event={"ID":"4993a595-ab1b-49b4-bb75-3efa3f127527","Type":"ContainerDied","Data":"c59bc5c0f2e205bf6d01b88f2a329ab0e68c70c63c8b16cd8ababd150e0b1a45"}
Oct 31 00:01:01.597323 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.597021    4921 scope.go:122] "RemoveContainer" containerID="74e402b99c238752fe0e0ffccc1687a3fe275ea11c8c9f949b8f7bf73281cc62"
Oct 31 00:01:01.602639 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.598797    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"
Oct 31 00:01:01.602639 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.598855    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td" event={"ID":"22dee8ec-69c0-4889-adb1-8ecde0d7b66a","Type":"ContainerDied","Data":"e10e0f29990efb7e328f5f091bfd27b7870e4c4a4ffb847fc3922fa3cd7634d9"}
Oct 31 00:01:01.608676 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.608658    4921 scope.go:122] "RemoveContainer" containerID="f1802b43c1ae5d798d2066d9b5191bd5c35fe5f9bd6d6c2744f48323b009c445"
Oct 31 00:01:01.620170 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.620149    4921 scope.go:122] "RemoveContainer" containerID="74e402b99c238752fe0e0ffccc1687a3fe275ea11c8c9f949b8f7bf73281cc62"
Oct 31 00:01:01.620545 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:01:01.620522    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74e402b99c238752fe0e0ffccc1687a3fe275ea11c8c9f949b8f7bf73281cc62\": container with ID starting with 74e402b99c238752fe0e0ffccc1687a3fe275ea11c8c9f949b8f7bf73281cc62 not found: ID does not exist" containerID="74e402b99c238752fe0e0ffccc1687a3fe275ea11c8c9f949b8f7bf73281cc62"
Oct 31 00:01:01.620642 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.620557    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74e402b99c238752fe0e0ffccc1687a3fe275ea11c8c9f949b8f7bf73281cc62"} err="failed to get container status \"74e402b99c238752fe0e0ffccc1687a3fe275ea11c8c9f949b8f7bf73281cc62\": rpc error: code = NotFound desc = could not find container \"74e402b99c238752fe0e0ffccc1687a3fe275ea11c8c9f949b8f7bf73281cc62\": container with ID starting with 74e402b99c238752fe0e0ffccc1687a3fe275ea11c8c9f949b8f7bf73281cc62 not found: ID does not exist"
Oct 31 00:01:01.620642 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.620578    4921 scope.go:122] "RemoveContainer" containerID="f1802b43c1ae5d798d2066d9b5191bd5c35fe5f9bd6d6c2744f48323b009c445"
Oct 31 00:01:01.620879 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:01:01.620859    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1802b43c1ae5d798d2066d9b5191bd5c35fe5f9bd6d6c2744f48323b009c445\": container with ID starting with f1802b43c1ae5d798d2066d9b5191bd5c35fe5f9bd6d6c2744f48323b009c445 not found: ID does not exist" containerID="f1802b43c1ae5d798d2066d9b5191bd5c35fe5f9bd6d6c2744f48323b009c445"
Oct 31 00:01:01.620938 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.620885    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1802b43c1ae5d798d2066d9b5191bd5c35fe5f9bd6d6c2744f48323b009c445"} err="failed to get container status \"f1802b43c1ae5d798d2066d9b5191bd5c35fe5f9bd6d6c2744f48323b009c445\": rpc error: code = NotFound desc = could not find container \"f1802b43c1ae5d798d2066d9b5191bd5c35fe5f9bd6d6c2744f48323b009c445\": container with ID starting with f1802b43c1ae5d798d2066d9b5191bd5c35fe5f9bd6d6c2744f48323b009c445 not found: ID does not exist"
Oct 31 00:01:01.620938 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.620900    4921 scope.go:122] "RemoveContainer" containerID="19915ae7629493778d44bd2dbec4319b6d0091ac56fd165f1f53090f409208cc"
Oct 31 00:01:01.634926 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.634901    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"]
Oct 31 00:01:01.638178 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.638157    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w0-4e6c3b-openshift-default-5c8565bc57-srl5t"]
Oct 31 00:01:01.646696 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.646675    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"]
Oct 31 00:01:01.652722 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:01.652698    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-843d8c-openshift-default-6d5b86bb45-7v4td"]
Oct 31 00:01:02.060229 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.060194    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:02.614291 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.614242    4921 generic.go:356] "Generic (PLEG): container finished" podID="8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" containerID="d07d9c6592ecb0eae271cb704cef28d3e3eba92c5822653321ce19fd03c59e45" exitCode=0
Oct 31 00:01:02.614789 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.614325    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c" event={"ID":"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7","Type":"ContainerDied","Data":"d07d9c6592ecb0eae271cb704cef28d3e3eba92c5822653321ce19fd03c59e45"}
Oct 31 00:01:02.616413 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.616383    4921 generic.go:356] "Generic (PLEG): container finished" podID="d32e7e03-43b2-463a-844f-b34c46203491" containerID="38af2ba2e052f2b2521a3c6835c6024fd3cdfc7df7124a9d2e6071a3de167793" exitCode=0
Oct 31 00:01:02.616555 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.616468    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7" event={"ID":"d32e7e03-43b2-463a-844f-b34c46203491","Type":"ContainerDied","Data":"38af2ba2e052f2b2521a3c6835c6024fd3cdfc7df7124a9d2e6071a3de167793"}
Oct 31 00:01:02.735159 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.735106    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 31 00:01:02.739016 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.738994    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 31 00:01:02.744642 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.744575    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-kube-api-access-s8xq5\" (UniqueName: \"kubernetes.io/projected/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-kube-api-access-s8xq5\") pod \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") "
Oct 31 00:01:02.744777 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.744645    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-credential-socket\") pod \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") "
Oct 31 00:01:02.744777 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.744676    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d32e7e03-43b2-463a-844f-b34c46203491-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d32e7e03-43b2-463a-844f-b34c46203491-istiod-ca-cert\") pod \"d32e7e03-43b2-463a-844f-b34c46203491\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") "
Oct 31 00:01:02.744777 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.744720    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-workload-socket\") pod \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") "
Oct 31 00:01:02.744777 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.744759    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-workload-certs\") pod \"d32e7e03-43b2-463a-844f-b34c46203491\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") "
Oct 31 00:01:02.745031 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.744839    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-workload-socket\") pod \"d32e7e03-43b2-463a-844f-b34c46203491\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") "
Oct 31 00:01:02.745031 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.744909    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d32e7e03-43b2-463a-844f-b34c46203491-kube-api-access-cv4bv\" (UniqueName: \"kubernetes.io/projected/d32e7e03-43b2-463a-844f-b34c46203491-kube-api-access-cv4bv\") pod \"d32e7e03-43b2-463a-844f-b34c46203491\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") "
Oct 31 00:01:02.745031 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.744944    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-data\") pod \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") "
Oct 31 00:01:02.745031 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.744976    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-istio-data\") pod \"d32e7e03-43b2-463a-844f-b34c46203491\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") "
Oct 31 00:01:02.745031 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.745010    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istiod-ca-cert\") pod \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") "
Oct 31 00:01:02.745301 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.745093    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-token\" (UniqueName: \"kubernetes.io/projected/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-token\") pod \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") "
Oct 31 00:01:02.745301 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.745142    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d32e7e03-43b2-463a-844f-b34c46203491-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d32e7e03-43b2-463a-844f-b34c46203491-istio-podinfo\") pod \"d32e7e03-43b2-463a-844f-b34c46203491\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") "
Oct 31 00:01:02.745301 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.745180    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d32e7e03-43b2-463a-844f-b34c46203491-istio-token\" (UniqueName: \"kubernetes.io/projected/d32e7e03-43b2-463a-844f-b34c46203491-istio-token\") pod \"d32e7e03-43b2-463a-844f-b34c46203491\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") "
Oct 31 00:01:02.745301 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.745211    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-podinfo\") pod \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") "
Oct 31 00:01:02.745301 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.745279    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-credential-socket\") pod \"d32e7e03-43b2-463a-844f-b34c46203491\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") "
Oct 31 00:01:02.746338 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.745638    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-istio-envoy\") pod \"d32e7e03-43b2-463a-844f-b34c46203491\" (UID: \"d32e7e03-43b2-463a-844f-b34c46203491\") "
Oct 31 00:01:02.746338 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.745690    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-workload-certs\") pod \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") "
Oct 31 00:01:02.746338 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.745728    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-envoy\") pod \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\" (UID: \"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7\") "
Oct 31 00:01:02.747288 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.745684    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-workload-socket" pod "8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" (UID: "8a466c39-73fa-48a5-a599-1bdfcd5f5eb7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:02.747288 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.745689    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d32e7e03-43b2-463a-844f-b34c46203491-istiod-ca-cert" pod "d32e7e03-43b2-463a-844f-b34c46203491" (UID: "d32e7e03-43b2-463a-844f-b34c46203491"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:01:02.747288 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.745810    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-workload-socket" pod "d32e7e03-43b2-463a-844f-b34c46203491" (UID: "d32e7e03-43b2-463a-844f-b34c46203491"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:02.747288 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.746008    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-credential-socket" pod "8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" (UID: "8a466c39-73fa-48a5-a599-1bdfcd5f5eb7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:02.747288 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.746183    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-istio-data" pod "d32e7e03-43b2-463a-844f-b34c46203491" (UID: "d32e7e03-43b2-463a-844f-b34c46203491"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:02.747288 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.746484    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-workload-certs" pod "8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" (UID: "8a466c39-73fa-48a5-a599-1bdfcd5f5eb7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:02.747288 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.746706    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istiod-ca-cert" pod "8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" (UID: "8a466c39-73fa-48a5-a599-1bdfcd5f5eb7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:01:02.747288 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.746742    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-data" pod "8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" (UID: "8a466c39-73fa-48a5-a599-1bdfcd5f5eb7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:02.747288 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.746918    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-workload-certs" pod "d32e7e03-43b2-463a-844f-b34c46203491" (UID: "d32e7e03-43b2-463a-844f-b34c46203491"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:02.747836 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.747482    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:02.747836 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.747505    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d32e7e03-43b2-463a-844f-b34c46203491-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:02.747836 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.747520    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:02.747836 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.747534    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:02.747836 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.747548    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:02.747836 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.747562    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:02.747836 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.747576    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:02.747836 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.747634    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:02.747836 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.747647    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:02.747836 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.747707    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-credential-socket" pod "d32e7e03-43b2-463a-844f-b34c46203491" (UID: "d32e7e03-43b2-463a-844f-b34c46203491"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:02.749070 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.749042    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-kube-api-access-s8xq5" pod "8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" (UID: "8a466c39-73fa-48a5-a599-1bdfcd5f5eb7"). InnerVolumeSpecName "kube-api-access-s8xq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:01:02.750171 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.750138    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-envoy" pod "8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" (UID: "8a466c39-73fa-48a5-a599-1bdfcd5f5eb7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:02.752019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.751994    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-istio-envoy" pod "d32e7e03-43b2-463a-844f-b34c46203491" (UID: "d32e7e03-43b2-463a-844f-b34c46203491"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:02.752218 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.752157    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d32e7e03-43b2-463a-844f-b34c46203491-istio-podinfo" pod "d32e7e03-43b2-463a-844f-b34c46203491" (UID: "d32e7e03-43b2-463a-844f-b34c46203491"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:01:02.752353 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.752298    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d32e7e03-43b2-463a-844f-b34c46203491-kube-api-access-cv4bv" pod "d32e7e03-43b2-463a-844f-b34c46203491" (UID: "d32e7e03-43b2-463a-844f-b34c46203491"). InnerVolumeSpecName "kube-api-access-cv4bv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:01:02.752487 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.752465    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-token" pod "8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" (UID: "8a466c39-73fa-48a5-a599-1bdfcd5f5eb7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:01:02.753053 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.753034    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d32e7e03-43b2-463a-844f-b34c46203491-istio-token" pod "d32e7e03-43b2-463a-844f-b34c46203491" (UID: "d32e7e03-43b2-463a-844f-b34c46203491"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:01:02.754250 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.754230    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-podinfo" pod "8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" (UID: "8a466c39-73fa-48a5-a599-1bdfcd5f5eb7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:01:02.834626 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.834550    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:02.852618 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.851571    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8xq5\" (UniqueName: \"kubernetes.io/projected/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-kube-api-access-s8xq5\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:02.852618 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.851644    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cv4bv\" (UniqueName: \"kubernetes.io/projected/d32e7e03-43b2-463a-844f-b34c46203491-kube-api-access-cv4bv\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:02.852618 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.851661    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:02.852618 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.851685    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d32e7e03-43b2-463a-844f-b34c46203491-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:02.852618 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.851699    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d32e7e03-43b2-463a-844f-b34c46203491-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:02.852618 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.851712    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:02.852618 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.851727    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:02.852618 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.851740    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d32e7e03-43b2-463a-844f-b34c46203491-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:02.852618 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.851753    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:02.886235 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.886194    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="22dee8ec-69c0-4889-adb1-8ecde0d7b66a" path="/var/lib/kubelet/pods/22dee8ec-69c0-4889-adb1-8ecde0d7b66a/volumes"
Oct 31 00:01:02.886751 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:02.886735    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4993a595-ab1b-49b4-bb75-3efa3f127527" path="/var/lib/kubelet/pods/4993a595-ab1b-49b4-bb75-3efa3f127527/volumes"
Oct 31 00:01:03.624538 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:03.624503    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c" event={"ID":"8a466c39-73fa-48a5-a599-1bdfcd5f5eb7","Type":"ContainerDied","Data":"3b3c6d42354d9585bec31aa8c7097434fc52158761570a00b1cbfa7618dc4755"}
Oct 31 00:01:03.624538 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:03.624525    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"
Oct 31 00:01:03.625119 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:03.624644    4921 scope.go:122] "RemoveContainer" containerID="d07d9c6592ecb0eae271cb704cef28d3e3eba92c5822653321ce19fd03c59e45"
Oct 31 00:01:03.626352 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:03.626336    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"
Oct 31 00:01:03.626535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:03.626333    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7" event={"ID":"d32e7e03-43b2-463a-844f-b34c46203491","Type":"ContainerDied","Data":"cb3d1849464c30573fea91f0a909434d34e4fa858b608255ac24f579afb2e818"}
Oct 31 00:01:03.635490 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:03.635462    4921 scope.go:122] "RemoveContainer" containerID="38af2ba2e052f2b2521a3c6835c6024fd3cdfc7df7124a9d2e6071a3de167793"
Oct 31 00:01:03.649341 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:03.649315    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"]
Oct 31 00:01:03.653004 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:03.652977    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-6rdh7"]
Oct 31 00:01:03.656987 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:03.656003    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:03.693101 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:03.693062    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"]
Oct 31 00:01:03.693332 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:03.693125    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-b567bb-openshift-default-f5f7c68ff-ghv9c"]
Oct 31 00:01:04.469752 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:04.469674    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:04.884526 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:04.884493    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" path="/var/lib/kubelet/pods/8a466c39-73fa-48a5-a599-1bdfcd5f5eb7/volumes"
Oct 31 00:01:04.885236 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:04.885097    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d32e7e03-43b2-463a-844f-b34c46203491" path="/var/lib/kubelet/pods/d32e7e03-43b2-463a-844f-b34c46203491/volumes"
Oct 31 00:01:05.052647 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.052570    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 31 00:01:05.179238 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.179206    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f146534-bcab-407d-ad28-d9528ca641c3-kube-api-access-2srr7\" (UniqueName: \"kubernetes.io/projected/4f146534-bcab-407d-ad28-d9528ca641c3-kube-api-access-2srr7\") pod \"4f146534-bcab-407d-ad28-d9528ca641c3\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") "
Oct 31 00:01:05.179238 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.179236    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f146534-bcab-407d-ad28-d9528ca641c3-istio-token\" (UniqueName: \"kubernetes.io/projected/4f146534-bcab-407d-ad28-d9528ca641c3-istio-token\") pod \"4f146534-bcab-407d-ad28-d9528ca641c3\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") "
Oct 31 00:01:05.179504 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.179287    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-istio-data\") pod \"4f146534-bcab-407d-ad28-d9528ca641c3\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") "
Oct 31 00:01:05.179504 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.179321    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4f146534-bcab-407d-ad28-d9528ca641c3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f146534-bcab-407d-ad28-d9528ca641c3-istio-podinfo\") pod \"4f146534-bcab-407d-ad28-d9528ca641c3\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") "
Oct 31 00:01:05.179504 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.179360    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-istio-envoy\") pod \"4f146534-bcab-407d-ad28-d9528ca641c3\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") "
Oct 31 00:01:05.179504 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.179397    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-workload-socket\") pod \"4f146534-bcab-407d-ad28-d9528ca641c3\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") "
Oct 31 00:01:05.179789 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.179546    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-workload-certs\") pod \"4f146534-bcab-407d-ad28-d9528ca641c3\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") "
Oct 31 00:01:05.179789 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.179669    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4f146534-bcab-407d-ad28-d9528ca641c3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f146534-bcab-407d-ad28-d9528ca641c3-istiod-ca-cert\") pod \"4f146534-bcab-407d-ad28-d9528ca641c3\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") "
Oct 31 00:01:05.179789 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.179710    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-credential-socket\") pod \"4f146534-bcab-407d-ad28-d9528ca641c3\" (UID: \"4f146534-bcab-407d-ad28-d9528ca641c3\") "
Oct 31 00:01:05.179964 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.179857    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-workload-socket" pod "4f146534-bcab-407d-ad28-d9528ca641c3" (UID: "4f146534-bcab-407d-ad28-d9528ca641c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:05.179964 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.179870    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-workload-certs" pod "4f146534-bcab-407d-ad28-d9528ca641c3" (UID: "4f146534-bcab-407d-ad28-d9528ca641c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:05.180129 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.180082    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-credential-socket" pod "4f146534-bcab-407d-ad28-d9528ca641c3" (UID: "4f146534-bcab-407d-ad28-d9528ca641c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:05.180360 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.180170    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f146534-bcab-407d-ad28-d9528ca641c3-istiod-ca-cert" pod "4f146534-bcab-407d-ad28-d9528ca641c3" (UID: "4f146534-bcab-407d-ad28-d9528ca641c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:01:05.180360 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.180219    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-istio-data" pod "4f146534-bcab-407d-ad28-d9528ca641c3" (UID: "4f146534-bcab-407d-ad28-d9528ca641c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:05.180542 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.180518    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f146534-bcab-407d-ad28-d9528ca641c3-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:05.180702 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.180545    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:05.180702 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.180560    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:05.180702 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.180573    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:05.180702 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.180588    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:05.181975 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.181942    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f146534-bcab-407d-ad28-d9528ca641c3-istio-podinfo" pod "4f146534-bcab-407d-ad28-d9528ca641c3" (UID: "4f146534-bcab-407d-ad28-d9528ca641c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:01:05.182075 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.181944    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f146534-bcab-407d-ad28-d9528ca641c3-istio-token" pod "4f146534-bcab-407d-ad28-d9528ca641c3" (UID: "4f146534-bcab-407d-ad28-d9528ca641c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:01:05.182406 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.182387    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-istio-envoy" pod "4f146534-bcab-407d-ad28-d9528ca641c3" (UID: "4f146534-bcab-407d-ad28-d9528ca641c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:05.182455 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.182434    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f146534-bcab-407d-ad28-d9528ca641c3-kube-api-access-2srr7" pod "4f146534-bcab-407d-ad28-d9528ca641c3" (UID: "4f146534-bcab-407d-ad28-d9528ca641c3"). InnerVolumeSpecName "kube-api-access-2srr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:01:05.282028 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.281991    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2srr7\" (UniqueName: \"kubernetes.io/projected/4f146534-bcab-407d-ad28-d9528ca641c3-kube-api-access-2srr7\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:05.282028 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.282022    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f146534-bcab-407d-ad28-d9528ca641c3-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:05.282028 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.282034    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f146534-bcab-407d-ad28-d9528ca641c3-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:05.282279 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.282043    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f146534-bcab-407d-ad28-d9528ca641c3-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:05.314160 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.314071    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:05.452669 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.452635    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:05.645374 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.645341    4921 generic.go:356] "Generic (PLEG): container finished" podID="4f146534-bcab-407d-ad28-d9528ca641c3" containerID="ec30b3f5b55fdb357570390feeefd4ea98c53f8953f35cb48ce16615fd5448a8" exitCode=0
Oct 31 00:01:05.645581 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.645399    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"
Oct 31 00:01:05.645581 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.645422    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv" event={"ID":"4f146534-bcab-407d-ad28-d9528ca641c3","Type":"ContainerDied","Data":"ec30b3f5b55fdb357570390feeefd4ea98c53f8953f35cb48ce16615fd5448a8"}
Oct 31 00:01:05.645581 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.645485    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv" event={"ID":"4f146534-bcab-407d-ad28-d9528ca641c3","Type":"ContainerDied","Data":"ddbf6ae8ff833a696dbd7a3e95c495487336e9e0660dbf7c84e023c450bcc5ed"}
Oct 31 00:01:05.645581 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.645508    4921 scope.go:122] "RemoveContainer" containerID="ec30b3f5b55fdb357570390feeefd4ea98c53f8953f35cb48ce16615fd5448a8"
Oct 31 00:01:05.658161 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.658124    4921 scope.go:122] "RemoveContainer" containerID="8e79abb0b84797a86b7b15786064306fe8b99fae712da6e1f57102470c34b679"
Oct 31 00:01:05.668572 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.668549    4921 scope.go:122] "RemoveContainer" containerID="ec30b3f5b55fdb357570390feeefd4ea98c53f8953f35cb48ce16615fd5448a8"
Oct 31 00:01:05.668929 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:01:05.668903    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec30b3f5b55fdb357570390feeefd4ea98c53f8953f35cb48ce16615fd5448a8\": container with ID starting with ec30b3f5b55fdb357570390feeefd4ea98c53f8953f35cb48ce16615fd5448a8 not found: ID does not exist" containerID="ec30b3f5b55fdb357570390feeefd4ea98c53f8953f35cb48ce16615fd5448a8"
Oct 31 00:01:05.669067 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.668940    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec30b3f5b55fdb357570390feeefd4ea98c53f8953f35cb48ce16615fd5448a8"} err="failed to get container status \"ec30b3f5b55fdb357570390feeefd4ea98c53f8953f35cb48ce16615fd5448a8\": rpc error: code = NotFound desc = could not find container \"ec30b3f5b55fdb357570390feeefd4ea98c53f8953f35cb48ce16615fd5448a8\": container with ID starting with ec30b3f5b55fdb357570390feeefd4ea98c53f8953f35cb48ce16615fd5448a8 not found: ID does not exist"
Oct 31 00:01:05.669067 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.668964    4921 scope.go:122] "RemoveContainer" containerID="8e79abb0b84797a86b7b15786064306fe8b99fae712da6e1f57102470c34b679"
Oct 31 00:01:05.669271 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:01:05.669252    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e79abb0b84797a86b7b15786064306fe8b99fae712da6e1f57102470c34b679\": container with ID starting with 8e79abb0b84797a86b7b15786064306fe8b99fae712da6e1f57102470c34b679 not found: ID does not exist" containerID="8e79abb0b84797a86b7b15786064306fe8b99fae712da6e1f57102470c34b679"
Oct 31 00:01:05.669343 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.669277    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e79abb0b84797a86b7b15786064306fe8b99fae712da6e1f57102470c34b679"} err="failed to get container status \"8e79abb0b84797a86b7b15786064306fe8b99fae712da6e1f57102470c34b679\": rpc error: code = NotFound desc = could not find container \"8e79abb0b84797a86b7b15786064306fe8b99fae712da6e1f57102470c34b679\": container with ID starting with 8e79abb0b84797a86b7b15786064306fe8b99fae712da6e1f57102470c34b679 not found: ID does not exist"
Oct 31 00:01:05.675713 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.675677    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"]
Oct 31 00:01:05.678643 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:05.678622    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-200408-openshift-default-7fdd497699-t6tqv"]
Oct 31 00:01:06.189839 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:06.189805    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:06.285176 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:06.285144    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv"]
Oct 31 00:01:06.375196 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:06.375161    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:06.558673 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:06.555240    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:06.884483 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:06.884448    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4f146534-bcab-407d-ad28-d9528ca641c3" path="/var/lib/kubelet/pods/4f146534-bcab-407d-ad28-d9528ca641c3/volumes"
Oct 31 00:01:06.981598 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:06.981570    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:07.719398 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:07.719358    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:08.421346 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:08.421316    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:09.150624 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:09.149335    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:09.751004 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:09.750957    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:09.928876 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:09.928829    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:10.062490 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:10.062388    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:10.443406 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:10.443372    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g"]
Oct 31 00:01:10.533577 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:10.533522    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:10.675393 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:10.675361    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:11.116034 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:11.106263    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:11.286274 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:11.286236    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv" podUID="e977815f-d174-41e5-9485-2281325ca37c" containerName="payload-pre-processing" containerID="cri-o://c05cace4bf4b88689f3511fcb2ea680a307b863dc45501bdf5db5a42c2a53631" gracePeriod=25
Oct 31 00:01:11.408264 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:01:11.408222    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:01:11.560200 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:11.560175    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv"
Oct 31 00:01:11.670679 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:11.670569    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e977815f-d174-41e5-9485-2281325ca37c-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e977815f-d174-41e5-9485-2281325ca37c-plugins-config-volume\") pod \"e977815f-d174-41e5-9485-2281325ca37c\" (UID: \"e977815f-d174-41e5-9485-2281325ca37c\") "
Oct 31 00:01:11.670879 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:11.670699    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e977815f-d174-41e5-9485-2281325ca37c-kube-api-access-24q66\" (UniqueName: \"kubernetes.io/projected/e977815f-d174-41e5-9485-2281325ca37c-kube-api-access-24q66\") pod \"e977815f-d174-41e5-9485-2281325ca37c\" (UID: \"e977815f-d174-41e5-9485-2281325ca37c\") "
Oct 31 00:01:11.671352 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:11.671319    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e977815f-d174-41e5-9485-2281325ca37c-plugins-config-volume" pod "e977815f-d174-41e5-9485-2281325ca37c" (UID: "e977815f-d174-41e5-9485-2281325ca37c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:01:11.673260 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:11.673236    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e977815f-d174-41e5-9485-2281325ca37c-kube-api-access-24q66" pod "e977815f-d174-41e5-9485-2281325ca37c" (UID: "e977815f-d174-41e5-9485-2281325ca37c"). InnerVolumeSpecName "kube-api-access-24q66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:01:11.690310 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:11.690279    4921 generic.go:356] "Generic (PLEG): container finished" podID="e977815f-d174-41e5-9485-2281325ca37c" containerID="c05cace4bf4b88689f3511fcb2ea680a307b863dc45501bdf5db5a42c2a53631" exitCode=0
Oct 31 00:01:11.690397 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:11.690331    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv"
Oct 31 00:01:11.690397 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:11.690330    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv" event={"ID":"e977815f-d174-41e5-9485-2281325ca37c","Type":"ContainerDied","Data":"c05cace4bf4b88689f3511fcb2ea680a307b863dc45501bdf5db5a42c2a53631"}
Oct 31 00:01:11.690476 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:11.690440    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv" event={"ID":"e977815f-d174-41e5-9485-2281325ca37c","Type":"ContainerDied","Data":"79f2b2997f0f6361d073e314c4aa756898575d569c6757bb50523f3941bed260"}
Oct 31 00:01:11.690476 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:11.690471    4921 scope.go:122] "RemoveContainer" containerID="c05cace4bf4b88689f3511fcb2ea680a307b863dc45501bdf5db5a42c2a53631"
Oct 31 00:01:11.702464 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:11.702444    4921 scope.go:122] "RemoveContainer" containerID="c05cace4bf4b88689f3511fcb2ea680a307b863dc45501bdf5db5a42c2a53631"
Oct 31 00:01:11.702785 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:01:11.702760    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c05cace4bf4b88689f3511fcb2ea680a307b863dc45501bdf5db5a42c2a53631\": container with ID starting with c05cace4bf4b88689f3511fcb2ea680a307b863dc45501bdf5db5a42c2a53631 not found: ID does not exist" containerID="c05cace4bf4b88689f3511fcb2ea680a307b863dc45501bdf5db5a42c2a53631"
Oct 31 00:01:11.702866 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:11.702795    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c05cace4bf4b88689f3511fcb2ea680a307b863dc45501bdf5db5a42c2a53631"} err="failed to get container status \"c05cace4bf4b88689f3511fcb2ea680a307b863dc45501bdf5db5a42c2a53631\": rpc error: code = NotFound desc = could not find container \"c05cace4bf4b88689f3511fcb2ea680a307b863dc45501bdf5db5a42c2a53631\": container with ID starting with c05cace4bf4b88689f3511fcb2ea680a307b863dc45501bdf5db5a42c2a53631 not found: ID does not exist"
Oct 31 00:01:11.717833 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:11.717810    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv"]
Oct 31 00:01:11.725647 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:11.725623    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w0-885999-b9844cb7f-pcxkv"]
Oct 31 00:01:11.772254 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:11.772219    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e977815f-d174-41e5-9485-2281325ca37c-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:11.772254 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:11.772248    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24q66\" (UniqueName: \"kubernetes.io/projected/e977815f-d174-41e5-9485-2281325ca37c-kube-api-access-24q66\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:11.946565 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:11.939829    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:12.739827 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:12.739792    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:12.883757 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:12.883723    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e977815f-d174-41e5-9485-2281325ca37c" path="/var/lib/kubelet/pods/e977815f-d174-41e5-9485-2281325ca37c/volumes"
Oct 31 00:01:13.443464 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:13.443433    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:13.992655 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:13.992622    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"]
Oct 31 00:01:13.993148 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:13.992845    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj" podUID="95ef5560-869d-42e3-80d5-090a164ad8e0" containerName="maas-api" containerID="cri-o://6b33cfad9285b3d30ccd7ca3db1009aee098d3c74d82ac4d492601a6bf416458" gracePeriod=30
Oct 31 00:01:14.074481 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.074453    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:14.277668 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.273538    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:14.379774 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.375608    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"
Oct 31 00:01:14.409638 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.409576    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:14.411702 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.411674    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/95ef5560-869d-42e3-80d5-090a164ad8e0-metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ef5560-869d-42e3-80d5-090a164ad8e0-metrics-certs\") pod \"95ef5560-869d-42e3-80d5-090a164ad8e0\" (UID: \"95ef5560-869d-42e3-80d5-090a164ad8e0\") "
Oct 31 00:01:14.411875 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.411720    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/95ef5560-869d-42e3-80d5-090a164ad8e0-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95ef5560-869d-42e3-80d5-090a164ad8e0-openshift-service-ca\") pod \"95ef5560-869d-42e3-80d5-090a164ad8e0\" (UID: \"95ef5560-869d-42e3-80d5-090a164ad8e0\") "
Oct 31 00:01:14.411875 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.411854    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/95ef5560-869d-42e3-80d5-090a164ad8e0-kube-api-access-sjpfd\" (UniqueName: \"kubernetes.io/projected/95ef5560-869d-42e3-80d5-090a164ad8e0-kube-api-access-sjpfd\") pod \"95ef5560-869d-42e3-80d5-090a164ad8e0\" (UID: \"95ef5560-869d-42e3-80d5-090a164ad8e0\") "
Oct 31 00:01:14.412003 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.411947    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/95ef5560-869d-42e3-80d5-090a164ad8e0-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95ef5560-869d-42e3-80d5-090a164ad8e0-maas-api-tls\") pod \"95ef5560-869d-42e3-80d5-090a164ad8e0\" (UID: \"95ef5560-869d-42e3-80d5-090a164ad8e0\") "
Oct 31 00:01:14.412401 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.412376    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95ef5560-869d-42e3-80d5-090a164ad8e0-openshift-service-ca" pod "95ef5560-869d-42e3-80d5-090a164ad8e0" (UID: "95ef5560-869d-42e3-80d5-090a164ad8e0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:01:14.415084 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.414674    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95ef5560-869d-42e3-80d5-090a164ad8e0-metrics-certs" pod "95ef5560-869d-42e3-80d5-090a164ad8e0" (UID: "95ef5560-869d-42e3-80d5-090a164ad8e0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:01:14.418577 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.418554    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95ef5560-869d-42e3-80d5-090a164ad8e0-maas-api-tls" pod "95ef5560-869d-42e3-80d5-090a164ad8e0" (UID: "95ef5560-869d-42e3-80d5-090a164ad8e0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:01:14.420777 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.420750    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95ef5560-869d-42e3-80d5-090a164ad8e0-kube-api-access-sjpfd" pod "95ef5560-869d-42e3-80d5-090a164ad8e0" (UID: "95ef5560-869d-42e3-80d5-090a164ad8e0"). InnerVolumeSpecName "kube-api-access-sjpfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:01:14.515855 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.515809    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ef5560-869d-42e3-80d5-090a164ad8e0-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:14.516110 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.516085    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95ef5560-869d-42e3-80d5-090a164ad8e0-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:14.516301 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.516283    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjpfd\" (UniqueName: \"kubernetes.io/projected/95ef5560-869d-42e3-80d5-090a164ad8e0-kube-api-access-sjpfd\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:14.516413 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.516399    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95ef5560-869d-42e3-80d5-090a164ad8e0-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:14.552291 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.552194    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:14.711744 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.711706    4921 generic.go:356] "Generic (PLEG): container finished" podID="95ef5560-869d-42e3-80d5-090a164ad8e0" containerID="6b33cfad9285b3d30ccd7ca3db1009aee098d3c74d82ac4d492601a6bf416458" exitCode=0
Oct 31 00:01:14.711939 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.711777    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"
Oct 31 00:01:14.711939 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.711801    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj" event={"ID":"95ef5560-869d-42e3-80d5-090a164ad8e0","Type":"ContainerDied","Data":"6b33cfad9285b3d30ccd7ca3db1009aee098d3c74d82ac4d492601a6bf416458"}
Oct 31 00:01:14.711939 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.711856    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj" event={"ID":"95ef5560-869d-42e3-80d5-090a164ad8e0","Type":"ContainerDied","Data":"ab11b11ef1fbd3a59e6abba7c5f6c04307d4a0ca0ce2b123fdd8877eb396c02f"}
Oct 31 00:01:14.711939 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.711877    4921 scope.go:122] "RemoveContainer" containerID="6b33cfad9285b3d30ccd7ca3db1009aee098d3c74d82ac4d492601a6bf416458"
Oct 31 00:01:14.722470 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.722454    4921 scope.go:122] "RemoveContainer" containerID="6b33cfad9285b3d30ccd7ca3db1009aee098d3c74d82ac4d492601a6bf416458"
Oct 31 00:01:14.722818 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:01:14.722796    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b33cfad9285b3d30ccd7ca3db1009aee098d3c74d82ac4d492601a6bf416458\": container with ID starting with 6b33cfad9285b3d30ccd7ca3db1009aee098d3c74d82ac4d492601a6bf416458 not found: ID does not exist" containerID="6b33cfad9285b3d30ccd7ca3db1009aee098d3c74d82ac4d492601a6bf416458"
Oct 31 00:01:14.722965 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.722828    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b33cfad9285b3d30ccd7ca3db1009aee098d3c74d82ac4d492601a6bf416458"} err="failed to get container status \"6b33cfad9285b3d30ccd7ca3db1009aee098d3c74d82ac4d492601a6bf416458\": rpc error: code = NotFound desc = could not find container \"6b33cfad9285b3d30ccd7ca3db1009aee098d3c74d82ac4d492601a6bf416458\": container with ID starting with 6b33cfad9285b3d30ccd7ca3db1009aee098d3c74d82ac4d492601a6bf416458 not found: ID does not exist"
Oct 31 00:01:14.735623 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.735573    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"]
Oct 31 00:01:14.739571 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.739550    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-86d846-54dbf4795-p8rfj"]
Oct 31 00:01:14.877646 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.877527    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:14.883675 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:14.883650    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="95ef5560-869d-42e3-80d5-090a164ad8e0" path="/var/lib/kubelet/pods/95ef5560-869d-42e3-80d5-090a164ad8e0/volumes"
Oct 31 00:01:15.425754 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:15.425725    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:15.461549 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:15.445304    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g" podUID="7dc2062f-cb3b-4b8b-b38d-635eea0f547a" containerName="payload-processing" containerID="cri-o://a5e5718133467ae7486695bd16aba049e1f06abdf27d8d1e35de4696bd47f949" gracePeriod=25
Oct 31 00:01:15.720138 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:15.720107    4921 generic.go:356] "Generic (PLEG): container finished" podID="7dc2062f-cb3b-4b8b-b38d-635eea0f547a" containerID="a5e5718133467ae7486695bd16aba049e1f06abdf27d8d1e35de4696bd47f949" exitCode=0
Oct 31 00:01:15.720276 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:15.720180    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g" event={"ID":"7dc2062f-cb3b-4b8b-b38d-635eea0f547a","Type":"ContainerDied","Data":"a5e5718133467ae7486695bd16aba049e1f06abdf27d8d1e35de4696bd47f949"}
Oct 31 00:01:15.749507 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:15.749472    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g"
Oct 31 00:01:15.832730 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:15.832694    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7dc2062f-cb3b-4b8b-b38d-635eea0f547a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dc2062f-cb3b-4b8b-b38d-635eea0f547a-plugins-config-volume\") pod \"7dc2062f-cb3b-4b8b-b38d-635eea0f547a\" (UID: \"7dc2062f-cb3b-4b8b-b38d-635eea0f547a\") "
Oct 31 00:01:15.832926 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:15.832905    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7dc2062f-cb3b-4b8b-b38d-635eea0f547a-kube-api-access-9xn7n\" (UniqueName: \"kubernetes.io/projected/7dc2062f-cb3b-4b8b-b38d-635eea0f547a-kube-api-access-9xn7n\") pod \"7dc2062f-cb3b-4b8b-b38d-635eea0f547a\" (UID: \"7dc2062f-cb3b-4b8b-b38d-635eea0f547a\") "
Oct 31 00:01:15.833146 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:15.833124    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dc2062f-cb3b-4b8b-b38d-635eea0f547a-plugins-config-volume" pod "7dc2062f-cb3b-4b8b-b38d-635eea0f547a" (UID: "7dc2062f-cb3b-4b8b-b38d-635eea0f547a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:01:15.833409 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:15.833389    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dc2062f-cb3b-4b8b-b38d-635eea0f547a-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:15.835108 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:15.835087    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dc2062f-cb3b-4b8b-b38d-635eea0f547a-kube-api-access-9xn7n" pod "7dc2062f-cb3b-4b8b-b38d-635eea0f547a" (UID: "7dc2062f-cb3b-4b8b-b38d-635eea0f547a"). InnerVolumeSpecName "kube-api-access-9xn7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:01:15.934178 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:15.934146    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xn7n\" (UniqueName: \"kubernetes.io/projected/7dc2062f-cb3b-4b8b-b38d-635eea0f547a-kube-api-access-9xn7n\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:16.126302 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:16.126207    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:16.728297 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:16.728262    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g"
Oct 31 00:01:16.728755 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:16.728319    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g" event={"ID":"7dc2062f-cb3b-4b8b-b38d-635eea0f547a","Type":"ContainerDied","Data":"d1cf071395eae00aae0cd82488e0b177f7f8f3b1c08c11dbdfb59b4ce6da8044"}
Oct 31 00:01:16.728755 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:16.728381    4921 scope.go:122] "RemoveContainer" containerID="a5e5718133467ae7486695bd16aba049e1f06abdf27d8d1e35de4696bd47f949"
Oct 31 00:01:16.795213 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:16.795182    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g"]
Oct 31 00:01:16.806646 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:16.806620    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-86d846-7b86c9dc6c-b8q6g"]
Oct 31 00:01:16.882790 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:16.882755    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7dc2062f-cb3b-4b8b-b38d-635eea0f547a" path="/var/lib/kubelet/pods/7dc2062f-cb3b-4b8b-b38d-635eea0f547a/volumes"
Oct 31 00:01:16.900420 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:16.900377    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:17.618807 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:17.618774    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:17.763873 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:17.763831    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:18.021751 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:18.021694    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:18.460392 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:18.460357    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:18.608417 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:18.608382    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:19.471417 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:19.471387    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:20.211183 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:20.211150    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:20.927664 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:20.927586    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:21.590185 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:21.590156    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:21.721039 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:21.721008    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:21.846784 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:21.846688    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"]
Oct 31 00:01:21.846953 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:21.846903    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b" podUID="441b53d1-a1f2-493b-a111-afff2d1aac61" containerName="istio-proxy" containerID="cri-o://a106145efc7a59350e831b833bd3f1792b228092de07ae88a4f01e55d0e8b737" gracePeriod=30
Oct 31 00:01:21.923247 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:21.923207    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:22.417517 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:22.417486    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:22.555770 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:22.555566    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:23.407899 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:23.407863    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"]
Oct 31 00:01:23.457008 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:23.456978    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:23.585016 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:23.584987    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:24.355383 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:24.355309    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:25.053453 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:25.053407    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:25.766801 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:25.766765    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:26.444310 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:26.444274    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:27.107522 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.107497    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 31 00:01:27.127929 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.127849    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-podinfo\") pod \"441b53d1-a1f2-493b-a111-afff2d1aac61\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") "
Oct 31 00:01:27.127929 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.127909    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-token\" (UniqueName: \"kubernetes.io/projected/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-token\") pod \"441b53d1-a1f2-493b-a111-afff2d1aac61\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") "
Oct 31 00:01:27.128167 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.127995    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/441b53d1-a1f2-493b-a111-afff2d1aac61-kube-api-access-dm5lj\" (UniqueName: \"kubernetes.io/projected/441b53d1-a1f2-493b-a111-afff2d1aac61-kube-api-access-dm5lj\") pod \"441b53d1-a1f2-493b-a111-afff2d1aac61\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") "
Oct 31 00:01:27.128167 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.128050    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-credential-socket\") pod \"441b53d1-a1f2-493b-a111-afff2d1aac61\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") "
Oct 31 00:01:27.128167 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.128095    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-workload-socket\") pod \"441b53d1-a1f2-493b-a111-afff2d1aac61\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") "
Oct 31 00:01:27.128167 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.128134    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-workload-certs\") pod \"441b53d1-a1f2-493b-a111-afff2d1aac61\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") "
Oct 31 00:01:27.128396 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.128167    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-envoy\") pod \"441b53d1-a1f2-493b-a111-afff2d1aac61\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") "
Oct 31 00:01:27.128396 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.128200    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-data\") pod \"441b53d1-a1f2-493b-a111-afff2d1aac61\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") "
Oct 31 00:01:27.128396 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.128275    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/441b53d1-a1f2-493b-a111-afff2d1aac61-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/441b53d1-a1f2-493b-a111-afff2d1aac61-istiod-ca-cert\") pod \"441b53d1-a1f2-493b-a111-afff2d1aac61\" (UID: \"441b53d1-a1f2-493b-a111-afff2d1aac61\") "
Oct 31 00:01:27.128558 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.128466    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-workload-certs" pod "441b53d1-a1f2-493b-a111-afff2d1aac61" (UID: "441b53d1-a1f2-493b-a111-afff2d1aac61"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:27.128558 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.128482    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-workload-socket" pod "441b53d1-a1f2-493b-a111-afff2d1aac61" (UID: "441b53d1-a1f2-493b-a111-afff2d1aac61"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:27.128823 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.128711    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-data" pod "441b53d1-a1f2-493b-a111-afff2d1aac61" (UID: "441b53d1-a1f2-493b-a111-afff2d1aac61"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:27.128823 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.128780    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/441b53d1-a1f2-493b-a111-afff2d1aac61-istiod-ca-cert" pod "441b53d1-a1f2-493b-a111-afff2d1aac61" (UID: "441b53d1-a1f2-493b-a111-afff2d1aac61"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:01:27.128999 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.128899    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:27.128999 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.128922    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:27.128999 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.128936    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:27.129173 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.129128    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-credential-socket" pod "441b53d1-a1f2-493b-a111-afff2d1aac61" (UID: "441b53d1-a1f2-493b-a111-afff2d1aac61"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:27.130425 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.130391    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/441b53d1-a1f2-493b-a111-afff2d1aac61-kube-api-access-dm5lj" pod "441b53d1-a1f2-493b-a111-afff2d1aac61" (UID: "441b53d1-a1f2-493b-a111-afff2d1aac61"). InnerVolumeSpecName "kube-api-access-dm5lj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:01:27.130557 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.130476    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-envoy" pod "441b53d1-a1f2-493b-a111-afff2d1aac61" (UID: "441b53d1-a1f2-493b-a111-afff2d1aac61"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:27.130646 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.130553    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-podinfo" pod "441b53d1-a1f2-493b-a111-afff2d1aac61" (UID: "441b53d1-a1f2-493b-a111-afff2d1aac61"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:01:27.130816 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.130795    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-token" pod "441b53d1-a1f2-493b-a111-afff2d1aac61" (UID: "441b53d1-a1f2-493b-a111-afff2d1aac61"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:01:27.137784 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.137751    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:27.230589 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.230547    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/441b53d1-a1f2-493b-a111-afff2d1aac61-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:27.230761 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.230587    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:27.230761 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.230640    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:27.230761 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.230651    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm5lj\" (UniqueName: \"kubernetes.io/projected/441b53d1-a1f2-493b-a111-afff2d1aac61-kube-api-access-dm5lj\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:27.230761 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.230661    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:27.230761 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.230670    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/441b53d1-a1f2-493b-a111-afff2d1aac61-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:27.345253 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.345220    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"]
Oct 31 00:01:27.500690 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.500656    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:27.812702 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.812608    4921 generic.go:356] "Generic (PLEG): container finished" podID="441b53d1-a1f2-493b-a111-afff2d1aac61" containerID="a106145efc7a59350e831b833bd3f1792b228092de07ae88a4f01e55d0e8b737" exitCode=0
Oct 31 00:01:27.812702 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.812672    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"
Oct 31 00:01:27.812920 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.812620    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b" event={"ID":"441b53d1-a1f2-493b-a111-afff2d1aac61","Type":"ContainerDied","Data":"a106145efc7a59350e831b833bd3f1792b228092de07ae88a4f01e55d0e8b737"}
Oct 31 00:01:27.812920 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.812756    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b" event={"ID":"441b53d1-a1f2-493b-a111-afff2d1aac61","Type":"ContainerDied","Data":"6648a33bc8de5534486b04c0a1f1602afe985d87ee20b7033fc00b2e74393f1b"}
Oct 31 00:01:27.812920 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.812793    4921 scope.go:122] "RemoveContainer" containerID="a106145efc7a59350e831b833bd3f1792b228092de07ae88a4f01e55d0e8b737"
Oct 31 00:01:27.824155 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.824139    4921 scope.go:122] "RemoveContainer" containerID="cc40c0d08cd7e3d0cffdd160711c9f85f313ce8e064a750b110193a8f9836219"
Oct 31 00:01:27.833622 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.833573    4921 scope.go:122] "RemoveContainer" containerID="a106145efc7a59350e831b833bd3f1792b228092de07ae88a4f01e55d0e8b737"
Oct 31 00:01:27.833879 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:01:27.833859    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a106145efc7a59350e831b833bd3f1792b228092de07ae88a4f01e55d0e8b737\": container with ID starting with a106145efc7a59350e831b833bd3f1792b228092de07ae88a4f01e55d0e8b737 not found: ID does not exist" containerID="a106145efc7a59350e831b833bd3f1792b228092de07ae88a4f01e55d0e8b737"
Oct 31 00:01:27.833963 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.833892    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a106145efc7a59350e831b833bd3f1792b228092de07ae88a4f01e55d0e8b737"} err="failed to get container status \"a106145efc7a59350e831b833bd3f1792b228092de07ae88a4f01e55d0e8b737\": rpc error: code = NotFound desc = could not find container \"a106145efc7a59350e831b833bd3f1792b228092de07ae88a4f01e55d0e8b737\": container with ID starting with a106145efc7a59350e831b833bd3f1792b228092de07ae88a4f01e55d0e8b737 not found: ID does not exist"
Oct 31 00:01:27.833963 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.833919    4921 scope.go:122] "RemoveContainer" containerID="cc40c0d08cd7e3d0cffdd160711c9f85f313ce8e064a750b110193a8f9836219"
Oct 31 00:01:27.834195 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:01:27.834177    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc40c0d08cd7e3d0cffdd160711c9f85f313ce8e064a750b110193a8f9836219\": container with ID starting with cc40c0d08cd7e3d0cffdd160711c9f85f313ce8e064a750b110193a8f9836219 not found: ID does not exist" containerID="cc40c0d08cd7e3d0cffdd160711c9f85f313ce8e064a750b110193a8f9836219"
Oct 31 00:01:27.834238 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.834201    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc40c0d08cd7e3d0cffdd160711c9f85f313ce8e064a750b110193a8f9836219"} err="failed to get container status \"cc40c0d08cd7e3d0cffdd160711c9f85f313ce8e064a750b110193a8f9836219\": rpc error: code = NotFound desc = could not find container \"cc40c0d08cd7e3d0cffdd160711c9f85f313ce8e064a750b110193a8f9836219\": container with ID starting with cc40c0d08cd7e3d0cffdd160711c9f85f313ce8e064a750b110193a8f9836219 not found: ID does not exist"
Oct 31 00:01:27.839913 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.839867    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"]
Oct 31 00:01:27.842792 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.842771    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-86d846-openshift-default-57f548668f-t795b"]
Oct 31 00:01:27.992059 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:27.978169    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:28.728204 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:28.728169    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:28.878729 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:28.878699    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:28.883851 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:28.883827    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="441b53d1-a1f2-493b-a111-afff2d1aac61" path="/var/lib/kubelet/pods/441b53d1-a1f2-493b-a111-afff2d1aac61/volumes"
Oct 31 00:01:29.415258 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:29.415211    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:30.222815 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:30.222782    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:31.039190 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:31.039153    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:31.736892 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:31.736860    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:32.514441 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:32.514412    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:32.711326 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:32.711290    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh"]
Oct 31 00:01:32.803678 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:32.803513    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:33.015623 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:33.012283    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:33.744951 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:33.744909    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:34.550620 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:34.546575    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:34.812000 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:34.811920    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:34.943506 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:34.943477    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:35.330703 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:35.330668    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:36.059630 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:36.045965    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:36.830019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:36.829978    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:37.526417 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:37.526380    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:37.712429 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:37.712392    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh" podUID="56c37261-af56-45b1-8dcf-60c89754d2f7" containerName="payload-pre-processing" containerID="cri-o://317f1c65d60b07c6996ea5c65984b5ff7f781c7409a5a4c7d59d1eca2622298c" gracePeriod=25
Oct 31 00:01:38.220054 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.220017    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:38.430944 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.430909    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main" containerID="cri-o://3627b7e9d0a185b825a30539501bcfbed5bf1c962a2e31e7d71684bdb7710283" gracePeriod=45
Oct 31 00:01:38.703145 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.703112    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 31 00:01:38.789928 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.789895    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-home\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-home\") pod \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") "
Oct 31 00:01:38.790155 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.789970    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-tmp-dir\") pod \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") "
Oct 31 00:01:38.790155 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.790002    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-dshm\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-dshm\") pod \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") "
Oct 31 00:01:38.790155 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.790036    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/43c0107d-53f5-4fa8-809b-5ecab19c6e58-tls-certs\" (UniqueName: \"kubernetes.io/secret/43c0107d-53f5-4fa8-809b-5ecab19c6e58-tls-certs\") pod \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") "
Oct 31 00:01:38.790155 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.790090    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-model-cache\") pod \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") "
Oct 31 00:01:38.790394 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.790188    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43c0107d-53f5-4fa8-809b-5ecab19c6e58-kube-api-access-98ncn\" (UniqueName: \"kubernetes.io/projected/43c0107d-53f5-4fa8-809b-5ecab19c6e58-kube-api-access-98ncn\") pod \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\" (UID: \"43c0107d-53f5-4fa8-809b-5ecab19c6e58\") "
Oct 31 00:01:38.790394 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.790220    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-home" pod "43c0107d-53f5-4fa8-809b-5ecab19c6e58" (UID: "43c0107d-53f5-4fa8-809b-5ecab19c6e58"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:38.790394 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.790289    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-tmp-dir" pod "43c0107d-53f5-4fa8-809b-5ecab19c6e58" (UID: "43c0107d-53f5-4fa8-809b-5ecab19c6e58"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:38.790567 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.790514    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-model-cache" pod "43c0107d-53f5-4fa8-809b-5ecab19c6e58" (UID: "43c0107d-53f5-4fa8-809b-5ecab19c6e58"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:38.791225 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.791198    4921 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-home\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:38.791369 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.791228    4921 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-tmp-dir\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:38.791369 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.791244    4921 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-model-cache\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:38.794740 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.794676    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-dshm" pod "43c0107d-53f5-4fa8-809b-5ecab19c6e58" (UID: "43c0107d-53f5-4fa8-809b-5ecab19c6e58"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:38.794740 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.794689    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43c0107d-53f5-4fa8-809b-5ecab19c6e58-tls-certs" pod "43c0107d-53f5-4fa8-809b-5ecab19c6e58" (UID: "43c0107d-53f5-4fa8-809b-5ecab19c6e58"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:01:38.794740 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.794734    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43c0107d-53f5-4fa8-809b-5ecab19c6e58-kube-api-access-98ncn" pod "43c0107d-53f5-4fa8-809b-5ecab19c6e58" (UID: "43c0107d-53f5-4fa8-809b-5ecab19c6e58"). InnerVolumeSpecName "kube-api-access-98ncn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:01:38.888251 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.888219    4921 generic.go:356] "Generic (PLEG): container finished" podID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerID="3627b7e9d0a185b825a30539501bcfbed5bf1c962a2e31e7d71684bdb7710283" exitCode=0
Oct 31 00:01:38.888251 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.888263    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" event={"ID":"43c0107d-53f5-4fa8-809b-5ecab19c6e58","Type":"ContainerDied","Data":"3627b7e9d0a185b825a30539501bcfbed5bf1c962a2e31e7d71684bdb7710283"}
Oct 31 00:01:38.888536 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.888272    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"
Oct 31 00:01:38.888536 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.888302    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn" event={"ID":"43c0107d-53f5-4fa8-809b-5ecab19c6e58","Type":"ContainerDied","Data":"fb6390ec89720c2a50c3ee7cac1c76436b8ab6a2c791bde97c73ae9ccea98ba9"}
Oct 31 00:01:38.888536 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.888323    4921 scope.go:122] "RemoveContainer" containerID="3627b7e9d0a185b825a30539501bcfbed5bf1c962a2e31e7d71684bdb7710283"
Oct 31 00:01:38.892457 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.892428    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98ncn\" (UniqueName: \"kubernetes.io/projected/43c0107d-53f5-4fa8-809b-5ecab19c6e58-kube-api-access-98ncn\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:38.892457 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.892460    4921 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43c0107d-53f5-4fa8-809b-5ecab19c6e58-dshm\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:38.892700 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.892473    4921 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43c0107d-53f5-4fa8-809b-5ecab19c6e58-tls-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:38.901163 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.901144    4921 scope.go:122] "RemoveContainer" containerID="3627b7e9d0a185b825a30539501bcfbed5bf1c962a2e31e7d71684bdb7710283"
Oct 31 00:01:38.901460 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:01:38.901440    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3627b7e9d0a185b825a30539501bcfbed5bf1c962a2e31e7d71684bdb7710283\": container with ID starting with 3627b7e9d0a185b825a30539501bcfbed5bf1c962a2e31e7d71684bdb7710283 not found: ID does not exist" containerID="3627b7e9d0a185b825a30539501bcfbed5bf1c962a2e31e7d71684bdb7710283"
Oct 31 00:01:38.901531 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.901469    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3627b7e9d0a185b825a30539501bcfbed5bf1c962a2e31e7d71684bdb7710283"} err="failed to get container status \"3627b7e9d0a185b825a30539501bcfbed5bf1c962a2e31e7d71684bdb7710283\": rpc error: code = NotFound desc = could not find container \"3627b7e9d0a185b825a30539501bcfbed5bf1c962a2e31e7d71684bdb7710283\": container with ID starting with 3627b7e9d0a185b825a30539501bcfbed5bf1c962a2e31e7d71684bdb7710283 not found: ID does not exist"
Oct 31 00:01:38.913811 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.913782    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"]
Oct 31 00:01:38.918943 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.918921    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-d3dcca/distinct-w0-d3dcca-kserve-84888cf469-ctrhn"]
Oct 31 00:01:38.950311 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:38.950284    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:39.751617 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:39.749648    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:40.507823 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:40.507774    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:40.883866 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:40.883835    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" path="/var/lib/kubelet/pods/43c0107d-53f5-4fa8-809b-5ecab19c6e58/volumes"
Oct 31 00:01:41.200934 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:41.200833    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:41.403980 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:01:41.403947    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:01:41.915191 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:41.915161    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:42.367488 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.367395    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main" containerID="cri-o://8867c8fa5d2c3113a631b844d411243e3d93453c34d17f790167f0d3f93c9c23" gracePeriod=45
Oct 31 00:01:42.646277 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.646253    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 31 00:01:42.775610 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.775560    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f0f53351-2b81-489a-a08e-dd0d49682556-kube-api-access-d5qw8\" (UniqueName: \"kubernetes.io/projected/f0f53351-2b81-489a-a08e-dd0d49682556-kube-api-access-d5qw8\") pod \"f0f53351-2b81-489a-a08e-dd0d49682556\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") "
Oct 31 00:01:42.775797 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.775665    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-model-cache\") pod \"f0f53351-2b81-489a-a08e-dd0d49682556\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") "
Oct 31 00:01:42.775797 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.775705    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-dshm\") pod \"f0f53351-2b81-489a-a08e-dd0d49682556\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") "
Oct 31 00:01:42.775797 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.775789    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-tmp-dir\") pod \"f0f53351-2b81-489a-a08e-dd0d49682556\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") "
Oct 31 00:01:42.775989 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.775885    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f0f53351-2b81-489a-a08e-dd0d49682556-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f53351-2b81-489a-a08e-dd0d49682556-tls-certs\") pod \"f0f53351-2b81-489a-a08e-dd0d49682556\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") "
Oct 31 00:01:42.775989 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.775930    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-home\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-home\") pod \"f0f53351-2b81-489a-a08e-dd0d49682556\" (UID: \"f0f53351-2b81-489a-a08e-dd0d49682556\") "
Oct 31 00:01:42.776104 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.775983    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-model-cache" pod "f0f53351-2b81-489a-a08e-dd0d49682556" (UID: "f0f53351-2b81-489a-a08e-dd0d49682556"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:42.776104 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.776061    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-tmp-dir" pod "f0f53351-2b81-489a-a08e-dd0d49682556" (UID: "f0f53351-2b81-489a-a08e-dd0d49682556"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:42.776242 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.776216    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-home" pod "f0f53351-2b81-489a-a08e-dd0d49682556" (UID: "f0f53351-2b81-489a-a08e-dd0d49682556"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:42.776479 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.776457    4921 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-home\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:42.776479 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.776476    4921 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-model-cache\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:42.776734 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.776487    4921 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-tmp-dir\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:42.778128 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.778099    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0f53351-2b81-489a-a08e-dd0d49682556-kube-api-access-d5qw8" pod "f0f53351-2b81-489a-a08e-dd0d49682556" (UID: "f0f53351-2b81-489a-a08e-dd0d49682556"). InnerVolumeSpecName "kube-api-access-d5qw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:01:42.778219 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.778158    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0f53351-2b81-489a-a08e-dd0d49682556-tls-certs" pod "f0f53351-2b81-489a-a08e-dd0d49682556" (UID: "f0f53351-2b81-489a-a08e-dd0d49682556"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:01:42.778219 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.778177    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-dshm" pod "f0f53351-2b81-489a-a08e-dd0d49682556" (UID: "f0f53351-2b81-489a-a08e-dd0d49682556"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:01:42.864268 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.864219    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:42.894673 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.893876    4921 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f53351-2b81-489a-a08e-dd0d49682556-tls-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:42.894673 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.893905    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5qw8\" (UniqueName: \"kubernetes.io/projected/f0f53351-2b81-489a-a08e-dd0d49682556-kube-api-access-d5qw8\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:42.894673 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.893922    4921 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0f53351-2b81-489a-a08e-dd0d49682556-dshm\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:42.914162 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.914129    4921 generic.go:356] "Generic (PLEG): container finished" podID="f0f53351-2b81-489a-a08e-dd0d49682556" containerID="8867c8fa5d2c3113a631b844d411243e3d93453c34d17f790167f0d3f93c9c23" exitCode=0
Oct 31 00:01:42.914331 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.914176    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"
Oct 31 00:01:42.914331 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.914214    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" event={"ID":"f0f53351-2b81-489a-a08e-dd0d49682556","Type":"ContainerDied","Data":"8867c8fa5d2c3113a631b844d411243e3d93453c34d17f790167f0d3f93c9c23"}
Oct 31 00:01:42.914331 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.914259    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k" event={"ID":"f0f53351-2b81-489a-a08e-dd0d49682556","Type":"ContainerDied","Data":"abe534bc986ef3559a63531978096beeb9b1f1548d0d7af66c3678153ea65e99"}
Oct 31 00:01:42.914331 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.914281    4921 scope.go:122] "RemoveContainer" containerID="8867c8fa5d2c3113a631b844d411243e3d93453c34d17f790167f0d3f93c9c23"
Oct 31 00:01:42.926690 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.926656    4921 scope.go:122] "RemoveContainer" containerID="8867c8fa5d2c3113a631b844d411243e3d93453c34d17f790167f0d3f93c9c23"
Oct 31 00:01:42.927049 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:01:42.927019    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8867c8fa5d2c3113a631b844d411243e3d93453c34d17f790167f0d3f93c9c23\": container with ID starting with 8867c8fa5d2c3113a631b844d411243e3d93453c34d17f790167f0d3f93c9c23 not found: ID does not exist" containerID="8867c8fa5d2c3113a631b844d411243e3d93453c34d17f790167f0d3f93c9c23"
Oct 31 00:01:42.927121 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.927060    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8867c8fa5d2c3113a631b844d411243e3d93453c34d17f790167f0d3f93c9c23"} err="failed to get container status \"8867c8fa5d2c3113a631b844d411243e3d93453c34d17f790167f0d3f93c9c23\": rpc error: code = NotFound desc = could not find container \"8867c8fa5d2c3113a631b844d411243e3d93453c34d17f790167f0d3f93c9c23\": container with ID starting with 8867c8fa5d2c3113a631b844d411243e3d93453c34d17f790167f0d3f93c9c23 not found: ID does not exist"
Oct 31 00:01:42.936273 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.936243    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"]
Oct 31 00:01:42.939257 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:42.939235    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-9ef03a/distinct-2-w2-9ef03a-kserve-57c848988d-lwn5k"]
Oct 31 00:01:43.785352 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:43.785313    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:44.539645 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:44.537061    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:44.882959 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:44.882933    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" path="/var/lib/kubelet/pods/f0f53351-2b81-489a-a08e-dd0d49682556/volumes"
Oct 31 00:01:45.427052 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:45.427015    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:45.852097 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:45.851998    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh" podUID="56c37261-af56-45b1-8dcf-60c89754d2f7" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:01:46.149274 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:46.149234    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:46.842210 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:46.842178    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:47.632081 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:47.632040    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:48.454834 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:48.454797    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:48.950087 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:48.950055    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"]
Oct 31 00:01:48.950870 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:48.950323    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6" podUID="8069d118-e6cb-420b-9502-85918a0169ef" containerName="maas-api" containerID="cri-o://eba9a436ad375b8a45203c9a365f662b2ed42e8585e3f4c581a918240c861279" gracePeriod=30
Oct 31 00:01:49.024964 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.024918    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:49.232698 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.222111    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:49.326771 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.326743    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"
Oct 31 00:01:49.348833 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.348801    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:49.379074 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.379042    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8069d118-e6cb-420b-9502-85918a0169ef-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8069d118-e6cb-420b-9502-85918a0169ef-maas-api-tls\") pod \"8069d118-e6cb-420b-9502-85918a0169ef\" (UID: \"8069d118-e6cb-420b-9502-85918a0169ef\") "
Oct 31 00:01:49.379279 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.379113    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8069d118-e6cb-420b-9502-85918a0169ef-kube-api-access-xml4s\" (UniqueName: \"kubernetes.io/projected/8069d118-e6cb-420b-9502-85918a0169ef-kube-api-access-xml4s\") pod \"8069d118-e6cb-420b-9502-85918a0169ef\" (UID: \"8069d118-e6cb-420b-9502-85918a0169ef\") "
Oct 31 00:01:49.379279 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.379172    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8069d118-e6cb-420b-9502-85918a0169ef-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8069d118-e6cb-420b-9502-85918a0169ef-metrics-certs\") pod \"8069d118-e6cb-420b-9502-85918a0169ef\" (UID: \"8069d118-e6cb-420b-9502-85918a0169ef\") "
Oct 31 00:01:49.379414 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.379282    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8069d118-e6cb-420b-9502-85918a0169ef-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8069d118-e6cb-420b-9502-85918a0169ef-openshift-service-ca\") pod \"8069d118-e6cb-420b-9502-85918a0169ef\" (UID: \"8069d118-e6cb-420b-9502-85918a0169ef\") "
Oct 31 00:01:49.380257 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.380228    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8069d118-e6cb-420b-9502-85918a0169ef-openshift-service-ca" pod "8069d118-e6cb-420b-9502-85918a0169ef" (UID: "8069d118-e6cb-420b-9502-85918a0169ef"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:01:49.383113 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.383083    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8069d118-e6cb-420b-9502-85918a0169ef-maas-api-tls" pod "8069d118-e6cb-420b-9502-85918a0169ef" (UID: "8069d118-e6cb-420b-9502-85918a0169ef"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:01:49.383226 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.383113    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8069d118-e6cb-420b-9502-85918a0169ef-metrics-certs" pod "8069d118-e6cb-420b-9502-85918a0169ef" (UID: "8069d118-e6cb-420b-9502-85918a0169ef"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:01:49.383226 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.383127    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8069d118-e6cb-420b-9502-85918a0169ef-kube-api-access-xml4s" pod "8069d118-e6cb-420b-9502-85918a0169ef" (UID: "8069d118-e6cb-420b-9502-85918a0169ef"). InnerVolumeSpecName "kube-api-access-xml4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:01:49.486714 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.485323    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8069d118-e6cb-420b-9502-85918a0169ef-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:49.486714 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.485362    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xml4s\" (UniqueName: \"kubernetes.io/projected/8069d118-e6cb-420b-9502-85918a0169ef-kube-api-access-xml4s\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:49.486714 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.485379    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8069d118-e6cb-420b-9502-85918a0169ef-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:49.486714 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.485392    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8069d118-e6cb-420b-9502-85918a0169ef-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:49.488059 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.488012    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:49.846473 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.846393    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:49.966273 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.966243    4921 generic.go:356] "Generic (PLEG): container finished" podID="8069d118-e6cb-420b-9502-85918a0169ef" containerID="eba9a436ad375b8a45203c9a365f662b2ed42e8585e3f4c581a918240c861279" exitCode=0
Oct 31 00:01:49.966806 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.966290    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"
Oct 31 00:01:49.966806 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.966330    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6" event={"ID":"8069d118-e6cb-420b-9502-85918a0169ef","Type":"ContainerDied","Data":"eba9a436ad375b8a45203c9a365f662b2ed42e8585e3f4c581a918240c861279"}
Oct 31 00:01:49.966806 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.966387    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6" event={"ID":"8069d118-e6cb-420b-9502-85918a0169ef","Type":"ContainerDied","Data":"1e144929c0121f67bb2a75c11d70bd5c53242720792ad519a9dbca75f4ef840b"}
Oct 31 00:01:49.966806 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.966414    4921 scope.go:122] "RemoveContainer" containerID="eba9a436ad375b8a45203c9a365f662b2ed42e8585e3f4c581a918240c861279"
Oct 31 00:01:49.981111 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.981066    4921 scope.go:122] "RemoveContainer" containerID="eba9a436ad375b8a45203c9a365f662b2ed42e8585e3f4c581a918240c861279"
Oct 31 00:01:49.981457 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:01:49.981426    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eba9a436ad375b8a45203c9a365f662b2ed42e8585e3f4c581a918240c861279\": container with ID starting with eba9a436ad375b8a45203c9a365f662b2ed42e8585e3f4c581a918240c861279 not found: ID does not exist" containerID="eba9a436ad375b8a45203c9a365f662b2ed42e8585e3f4c581a918240c861279"
Oct 31 00:01:49.981567 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.981471    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eba9a436ad375b8a45203c9a365f662b2ed42e8585e3f4c581a918240c861279"} err="failed to get container status \"eba9a436ad375b8a45203c9a365f662b2ed42e8585e3f4c581a918240c861279\": rpc error: code = NotFound desc = could not find container \"eba9a436ad375b8a45203c9a365f662b2ed42e8585e3f4c581a918240c861279\": container with ID starting with eba9a436ad375b8a45203c9a365f662b2ed42e8585e3f4c581a918240c861279 not found: ID does not exist"
Oct 31 00:01:49.995313 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.995291    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"]
Oct 31 00:01:49.997627 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:49.997586    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d3dcca-5cf7f496f7-rxdp6"]
Oct 31 00:01:50.031967 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:50.031921    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:50.208729 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:50.206107    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:50.345237 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:50.345211    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:50.467142 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:50.467068    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:50.870061 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:50.869983    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:50.882768 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:50.882743    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8069d118-e6cb-420b-9502-85918a0169ef" path="/var/lib/kubelet/pods/8069d118-e6cb-420b-9502-85918a0169ef/volumes"
Oct 31 00:01:51.238008 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:51.237978    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:52.060795 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:52.060759    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:52.675426 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:52.675391    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:53.451789 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:53.451747    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:54.291441 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:54.291410    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:54.851188 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:54.851147    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:55.020782 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:55.020747    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:55.731742 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:55.731701    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:55.852413 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:55.852368    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh" podUID="56c37261-af56-45b1-8dcf-60c89754d2f7" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:01:56.427636 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:56.427561    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:56.789751 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:56.789670    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:56.927216 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:56.927169    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:57.096634 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:57.096518    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"]
Oct 31 00:01:57.096915 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:57.096861    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q" podUID="ac24a789-f285-4a46-8121-579b4b3bd264" containerName="istio-proxy" containerID="cri-o://326a1d400a1ba18e4d25e6a96703f5b4d479be493e1ba75844173e738a586ce5" gracePeriod=30
Oct 31 00:01:57.219777 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:57.219728    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:57.386116 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:57.383663    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:57.983841 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:57.983772    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh"
Oct 31 00:01:58.023935 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.023903    4921 generic.go:356] "Generic (PLEG): container finished" podID="56c37261-af56-45b1-8dcf-60c89754d2f7" containerID="317f1c65d60b07c6996ea5c65984b5ff7f781c7409a5a4c7d59d1eca2622298c" exitCode=0
Oct 31 00:01:58.024132 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.023941    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh"
Oct 31 00:01:58.024132 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.023976    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh" event={"ID":"56c37261-af56-45b1-8dcf-60c89754d2f7","Type":"ContainerDied","Data":"317f1c65d60b07c6996ea5c65984b5ff7f781c7409a5a4c7d59d1eca2622298c"}
Oct 31 00:01:58.024132 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.024042    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh" event={"ID":"56c37261-af56-45b1-8dcf-60c89754d2f7","Type":"ContainerDied","Data":"c207cb5026d73fcda2b294390e7d6b2466983283721852ecb8cacd31f1259980"}
Oct 31 00:01:58.024132 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.024072    4921 scope.go:122] "RemoveContainer" containerID="317f1c65d60b07c6996ea5c65984b5ff7f781c7409a5a4c7d59d1eca2622298c"
Oct 31 00:01:58.034134 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.034109    4921 scope.go:122] "RemoveContainer" containerID="317f1c65d60b07c6996ea5c65984b5ff7f781c7409a5a4c7d59d1eca2622298c"
Oct 31 00:01:58.034468 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:01:58.034447    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"317f1c65d60b07c6996ea5c65984b5ff7f781c7409a5a4c7d59d1eca2622298c\": container with ID starting with 317f1c65d60b07c6996ea5c65984b5ff7f781c7409a5a4c7d59d1eca2622298c not found: ID does not exist" containerID="317f1c65d60b07c6996ea5c65984b5ff7f781c7409a5a4c7d59d1eca2622298c"
Oct 31 00:01:58.034554 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.034485    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"317f1c65d60b07c6996ea5c65984b5ff7f781c7409a5a4c7d59d1eca2622298c"} err="failed to get container status \"317f1c65d60b07c6996ea5c65984b5ff7f781c7409a5a4c7d59d1eca2622298c\": rpc error: code = NotFound desc = could not find container \"317f1c65d60b07c6996ea5c65984b5ff7f781c7409a5a4c7d59d1eca2622298c\": container with ID starting with 317f1c65d60b07c6996ea5c65984b5ff7f781c7409a5a4c7d59d1eca2622298c not found: ID does not exist"
Oct 31 00:01:58.054083 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.054060    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:58.133516 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.133484    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/56c37261-af56-45b1-8dcf-60c89754d2f7-kube-api-access-6vxj2\" (UniqueName: \"kubernetes.io/projected/56c37261-af56-45b1-8dcf-60c89754d2f7-kube-api-access-6vxj2\") pod \"56c37261-af56-45b1-8dcf-60c89754d2f7\" (UID: \"56c37261-af56-45b1-8dcf-60c89754d2f7\") "
Oct 31 00:01:58.133942 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.133920    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/56c37261-af56-45b1-8dcf-60c89754d2f7-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56c37261-af56-45b1-8dcf-60c89754d2f7-plugins-config-volume\") pod \"56c37261-af56-45b1-8dcf-60c89754d2f7\" (UID: \"56c37261-af56-45b1-8dcf-60c89754d2f7\") "
Oct 31 00:01:58.135288 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.134490    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56c37261-af56-45b1-8dcf-60c89754d2f7-plugins-config-volume" pod "56c37261-af56-45b1-8dcf-60c89754d2f7" (UID: "56c37261-af56-45b1-8dcf-60c89754d2f7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:01:58.150886 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.148497    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56c37261-af56-45b1-8dcf-60c89754d2f7-kube-api-access-6vxj2" pod "56c37261-af56-45b1-8dcf-60c89754d2f7" (UID: "56c37261-af56-45b1-8dcf-60c89754d2f7"). InnerVolumeSpecName "kube-api-access-6vxj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:01:58.184038 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.183991    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:58.236490 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.236414    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vxj2\" (UniqueName: \"kubernetes.io/projected/56c37261-af56-45b1-8dcf-60c89754d2f7-kube-api-access-6vxj2\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:58.236490 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.236441    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56c37261-af56-45b1-8dcf-60c89754d2f7-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:01:58.251469 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.251442    4921 patch_prober.go:29] interesting pod/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:01:58.251631 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.251515    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q" podUID="ac24a789-f285-4a46-8121-579b4b3bd264" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:01:58.356245 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.356214    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh"]
Oct 31 00:01:58.361485 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.361452    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-9ef03a-7cf56948c9-p77dh"]
Oct 31 00:01:58.388845 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.388814    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"]
Oct 31 00:01:58.389132 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.389057    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j" podUID="b14e7bdd-df95-4c34-958c-3b023b9596fa" containerName="istio-proxy" containerID="cri-o://1bbabf31c888e9aea6dc43ed91e1adbaaf1eeb15ab9f1bf13f38a0b5effd33de" gracePeriod=30
Oct 31 00:01:58.596870 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.596785    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:58.884073 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:58.884043    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="56c37261-af56-45b1-8dcf-60c89754d2f7" path="/var/lib/kubelet/pods/56c37261-af56-45b1-8dcf-60c89754d2f7/volumes"
Oct 31 00:01:59.018415 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:59.018376    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:01:59.729621 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:01:59.727887    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:00.491270 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:00.491237    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:01.319704 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:01.319667    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:01.449261 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:01.449153    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:02.045165 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.045132    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:02.314519 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.314416    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:02.369266 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.369235    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 31 00:02:02.402579 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.402550    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-workload-socket\") pod \"ac24a789-f285-4a46-8121-579b4b3bd264\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") "
Oct 31 00:02:02.402725 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.402619    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-workload-certs\") pod \"ac24a789-f285-4a46-8121-579b4b3bd264\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") "
Oct 31 00:02:02.402725 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.402657    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ac24a789-f285-4a46-8121-579b4b3bd264-kube-api-access-dks9n\" (UniqueName: \"kubernetes.io/projected/ac24a789-f285-4a46-8121-579b4b3bd264-kube-api-access-dks9n\") pod \"ac24a789-f285-4a46-8121-579b4b3bd264\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") "
Oct 31 00:02:02.402725 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.402693    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-credential-socket\") pod \"ac24a789-f285-4a46-8121-579b4b3bd264\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") "
Oct 31 00:02:02.402882 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.402778    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-istio-data\") pod \"ac24a789-f285-4a46-8121-579b4b3bd264\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") "
Oct 31 00:02:02.402882 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.402815    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ac24a789-f285-4a46-8121-579b4b3bd264-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac24a789-f285-4a46-8121-579b4b3bd264-istiod-ca-cert\") pod \"ac24a789-f285-4a46-8121-579b4b3bd264\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") "
Oct 31 00:02:02.402882 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.402847    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-workload-socket" pod "ac24a789-f285-4a46-8121-579b4b3bd264" (UID: "ac24a789-f285-4a46-8121-579b4b3bd264"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:02:02.403058 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.402859    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-istio-envoy\") pod \"ac24a789-f285-4a46-8121-579b4b3bd264\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") "
Oct 31 00:02:02.403058 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.402906    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-workload-certs" pod "ac24a789-f285-4a46-8121-579b4b3bd264" (UID: "ac24a789-f285-4a46-8121-579b4b3bd264"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:02:02.403058 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.402949    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ac24a789-f285-4a46-8121-579b4b3bd264-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac24a789-f285-4a46-8121-579b4b3bd264-istio-podinfo\") pod \"ac24a789-f285-4a46-8121-579b4b3bd264\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") "
Oct 31 00:02:02.403058 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.403025    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ac24a789-f285-4a46-8121-579b4b3bd264-istio-token\" (UniqueName: \"kubernetes.io/projected/ac24a789-f285-4a46-8121-579b4b3bd264-istio-token\") pod \"ac24a789-f285-4a46-8121-579b4b3bd264\" (UID: \"ac24a789-f285-4a46-8121-579b4b3bd264\") "
Oct 31 00:02:02.403058 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.403049    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-credential-socket" pod "ac24a789-f285-4a46-8121-579b4b3bd264" (UID: "ac24a789-f285-4a46-8121-579b4b3bd264"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:02:02.403288 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.403245    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac24a789-f285-4a46-8121-579b4b3bd264-istiod-ca-cert" pod "ac24a789-f285-4a46-8121-579b4b3bd264" (UID: "ac24a789-f285-4a46-8121-579b4b3bd264"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:02:02.403527 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.403512    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:02.403625 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.403530    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac24a789-f285-4a46-8121-579b4b3bd264-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:02.403625 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.403539    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:02.403625 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.403550    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:02.404119 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.404070    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-istio-data" pod "ac24a789-f285-4a46-8121-579b4b3bd264" (UID: "ac24a789-f285-4a46-8121-579b4b3bd264"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:02:02.405552 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.405521    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-istio-envoy" pod "ac24a789-f285-4a46-8121-579b4b3bd264" (UID: "ac24a789-f285-4a46-8121-579b4b3bd264"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:02:02.405661 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.405572    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac24a789-f285-4a46-8121-579b4b3bd264-kube-api-access-dks9n" pod "ac24a789-f285-4a46-8121-579b4b3bd264" (UID: "ac24a789-f285-4a46-8121-579b4b3bd264"). InnerVolumeSpecName "kube-api-access-dks9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:02:02.406439 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.406417    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac24a789-f285-4a46-8121-579b4b3bd264-istio-token" pod "ac24a789-f285-4a46-8121-579b4b3bd264" (UID: "ac24a789-f285-4a46-8121-579b4b3bd264"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:02:02.406540 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.406524    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac24a789-f285-4a46-8121-579b4b3bd264-istio-podinfo" pod "ac24a789-f285-4a46-8121-579b4b3bd264" (UID: "ac24a789-f285-4a46-8121-579b4b3bd264"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:02:02.505211 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.505173    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:02.505211 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.505209    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac24a789-f285-4a46-8121-579b4b3bd264-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:02.505211 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.505225    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac24a789-f285-4a46-8121-579b4b3bd264-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:02.505467 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.505241    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac24a789-f285-4a46-8121-579b4b3bd264-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:02.505467 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.505256    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dks9n\" (UniqueName: \"kubernetes.io/projected/ac24a789-f285-4a46-8121-579b4b3bd264-kube-api-access-dks9n\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:02.861198 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:02.861154    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:03.114076 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.113982    4921 generic.go:356] "Generic (PLEG): container finished" podID="ac24a789-f285-4a46-8121-579b4b3bd264" containerID="326a1d400a1ba18e4d25e6a96703f5b4d479be493e1ba75844173e738a586ce5" exitCode=0
Oct 31 00:02:03.114076 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.114048    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"
Oct 31 00:02:03.114635 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.114075    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q" event={"ID":"ac24a789-f285-4a46-8121-579b4b3bd264","Type":"ContainerDied","Data":"326a1d400a1ba18e4d25e6a96703f5b4d479be493e1ba75844173e738a586ce5"}
Oct 31 00:02:03.114635 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.114133    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q" event={"ID":"ac24a789-f285-4a46-8121-579b4b3bd264","Type":"ContainerDied","Data":"82ebfdf8117e9e4a72c1629133a867970c90f94e73ef52b981a59d1be9334b09"}
Oct 31 00:02:03.114635 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.114157    4921 scope.go:122] "RemoveContainer" containerID="326a1d400a1ba18e4d25e6a96703f5b4d479be493e1ba75844173e738a586ce5"
Oct 31 00:02:03.124624 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.124573    4921 scope.go:122] "RemoveContainer" containerID="2a2ee75c000b3efb7bb9999d43fa38bb14fa1affc510cdefa2362eb6f05034fe"
Oct 31 00:02:03.133952 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.133934    4921 scope.go:122] "RemoveContainer" containerID="326a1d400a1ba18e4d25e6a96703f5b4d479be493e1ba75844173e738a586ce5"
Oct 31 00:02:03.134278 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:02:03.134254    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"326a1d400a1ba18e4d25e6a96703f5b4d479be493e1ba75844173e738a586ce5\": container with ID starting with 326a1d400a1ba18e4d25e6a96703f5b4d479be493e1ba75844173e738a586ce5 not found: ID does not exist" containerID="326a1d400a1ba18e4d25e6a96703f5b4d479be493e1ba75844173e738a586ce5"
Oct 31 00:02:03.134342 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.134286    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"326a1d400a1ba18e4d25e6a96703f5b4d479be493e1ba75844173e738a586ce5"} err="failed to get container status \"326a1d400a1ba18e4d25e6a96703f5b4d479be493e1ba75844173e738a586ce5\": rpc error: code = NotFound desc = could not find container \"326a1d400a1ba18e4d25e6a96703f5b4d479be493e1ba75844173e738a586ce5\": container with ID starting with 326a1d400a1ba18e4d25e6a96703f5b4d479be493e1ba75844173e738a586ce5 not found: ID does not exist"
Oct 31 00:02:03.134342 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.134303    4921 scope.go:122] "RemoveContainer" containerID="2a2ee75c000b3efb7bb9999d43fa38bb14fa1affc510cdefa2362eb6f05034fe"
Oct 31 00:02:03.134580 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:02:03.134563    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a2ee75c000b3efb7bb9999d43fa38bb14fa1affc510cdefa2362eb6f05034fe\": container with ID starting with 2a2ee75c000b3efb7bb9999d43fa38bb14fa1affc510cdefa2362eb6f05034fe not found: ID does not exist" containerID="2a2ee75c000b3efb7bb9999d43fa38bb14fa1affc510cdefa2362eb6f05034fe"
Oct 31 00:02:03.134666 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.134587    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2ee75c000b3efb7bb9999d43fa38bb14fa1affc510cdefa2362eb6f05034fe"} err="failed to get container status \"2a2ee75c000b3efb7bb9999d43fa38bb14fa1affc510cdefa2362eb6f05034fe\": rpc error: code = NotFound desc = could not find container \"2a2ee75c000b3efb7bb9999d43fa38bb14fa1affc510cdefa2362eb6f05034fe\": container with ID starting with 2a2ee75c000b3efb7bb9999d43fa38bb14fa1affc510cdefa2362eb6f05034fe not found: ID does not exist"
Oct 31 00:02:03.141154 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.141129    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"]
Oct 31 00:02:03.145730 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.145706    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-d3dcca-openshift-default-7d6885d9bf-v9g9q"]
Oct 31 00:02:03.650009 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.649972    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:03.680639 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.680610    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 31 00:02:03.743093 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.743058    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-workload-certs\") pod \"b14e7bdd-df95-4c34-958c-3b023b9596fa\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") "
Oct 31 00:02:03.743379 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.743354    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-workload-certs" pod "b14e7bdd-df95-4c34-958c-3b023b9596fa" (UID: "b14e7bdd-df95-4c34-958c-3b023b9596fa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:02:03.743534 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.743449    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-podinfo\") pod \"b14e7bdd-df95-4c34-958c-3b023b9596fa\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") "
Oct 31 00:02:03.744203 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.743931    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-credential-socket" pod "b14e7bdd-df95-4c34-958c-3b023b9596fa" (UID: "b14e7bdd-df95-4c34-958c-3b023b9596fa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:02:03.744203 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.743967    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-credential-socket\") pod \"b14e7bdd-df95-4c34-958c-3b023b9596fa\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") "
Oct 31 00:02:03.744203 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.744041    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b14e7bdd-df95-4c34-958c-3b023b9596fa-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b14e7bdd-df95-4c34-958c-3b023b9596fa-istiod-ca-cert\") pod \"b14e7bdd-df95-4c34-958c-3b023b9596fa\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") "
Oct 31 00:02:03.744203 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.744102    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-workload-socket\") pod \"b14e7bdd-df95-4c34-958c-3b023b9596fa\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") "
Oct 31 00:02:03.744203 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.744134    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-envoy\") pod \"b14e7bdd-df95-4c34-958c-3b023b9596fa\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") "
Oct 31 00:02:03.744203 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.744173    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-data\") pod \"b14e7bdd-df95-4c34-958c-3b023b9596fa\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") "
Oct 31 00:02:03.744662 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.744230    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-token\" (UniqueName: \"kubernetes.io/projected/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-token\") pod \"b14e7bdd-df95-4c34-958c-3b023b9596fa\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") "
Oct 31 00:02:03.744662 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.744262    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b14e7bdd-df95-4c34-958c-3b023b9596fa-kube-api-access-5zw55\" (UniqueName: \"kubernetes.io/projected/b14e7bdd-df95-4c34-958c-3b023b9596fa-kube-api-access-5zw55\") pod \"b14e7bdd-df95-4c34-958c-3b023b9596fa\" (UID: \"b14e7bdd-df95-4c34-958c-3b023b9596fa\") "
Oct 31 00:02:03.744662 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.744354    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-workload-socket" pod "b14e7bdd-df95-4c34-958c-3b023b9596fa" (UID: "b14e7bdd-df95-4c34-958c-3b023b9596fa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:02:03.744662 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.744544    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-data" pod "b14e7bdd-df95-4c34-958c-3b023b9596fa" (UID: "b14e7bdd-df95-4c34-958c-3b023b9596fa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:02:03.744915 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.744849    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:03.744915 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.744867    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:03.744915 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.744887    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:03.744915 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.744906    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:03.746070 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.746008    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b14e7bdd-df95-4c34-958c-3b023b9596fa-istiod-ca-cert" pod "b14e7bdd-df95-4c34-958c-3b023b9596fa" (UID: "b14e7bdd-df95-4c34-958c-3b023b9596fa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:02:03.748152 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.748123    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-podinfo" pod "b14e7bdd-df95-4c34-958c-3b023b9596fa" (UID: "b14e7bdd-df95-4c34-958c-3b023b9596fa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:02:03.748397 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.748369    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-token" pod "b14e7bdd-df95-4c34-958c-3b023b9596fa" (UID: "b14e7bdd-df95-4c34-958c-3b023b9596fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:02:03.752112 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.752083    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b14e7bdd-df95-4c34-958c-3b023b9596fa-kube-api-access-5zw55" pod "b14e7bdd-df95-4c34-958c-3b023b9596fa" (UID: "b14e7bdd-df95-4c34-958c-3b023b9596fa"). InnerVolumeSpecName "kube-api-access-5zw55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:02:03.752511 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.752462    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-envoy" pod "b14e7bdd-df95-4c34-958c-3b023b9596fa" (UID: "b14e7bdd-df95-4c34-958c-3b023b9596fa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:02:03.846249 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.846219    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:03.846249 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.846247    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:03.846460 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.846257    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zw55\" (UniqueName: \"kubernetes.io/projected/b14e7bdd-df95-4c34-958c-3b023b9596fa-kube-api-access-5zw55\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:03.846460 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.846270    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b14e7bdd-df95-4c34-958c-3b023b9596fa-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:03.846460 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:03.846279    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b14e7bdd-df95-4c34-958c-3b023b9596fa-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:04.122775 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:04.122688    4921 generic.go:356] "Generic (PLEG): container finished" podID="b14e7bdd-df95-4c34-958c-3b023b9596fa" containerID="1bbabf31c888e9aea6dc43ed91e1adbaaf1eeb15ab9f1bf13f38a0b5effd33de" exitCode=0
Oct 31 00:02:04.123200 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:04.122778    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j" event={"ID":"b14e7bdd-df95-4c34-958c-3b023b9596fa","Type":"ContainerDied","Data":"1bbabf31c888e9aea6dc43ed91e1adbaaf1eeb15ab9f1bf13f38a0b5effd33de"}
Oct 31 00:02:04.123200 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:04.122848    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j" event={"ID":"b14e7bdd-df95-4c34-958c-3b023b9596fa","Type":"ContainerDied","Data":"450615f4f6cd07da1e8021ed19a464a526df85790f6b927d1304685a82a3c6cf"}
Oct 31 00:02:04.123200 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:04.122788    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"
Oct 31 00:02:04.123200 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:04.122885    4921 scope.go:122] "RemoveContainer" containerID="1bbabf31c888e9aea6dc43ed91e1adbaaf1eeb15ab9f1bf13f38a0b5effd33de"
Oct 31 00:02:04.133461 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:04.133439    4921 scope.go:122] "RemoveContainer" containerID="155ae7b14a7fbbcfce77b8477fbc890696ca53c7621572c4f25b970678bcbe74"
Oct 31 00:02:04.142492 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:04.142471    4921 scope.go:122] "RemoveContainer" containerID="1bbabf31c888e9aea6dc43ed91e1adbaaf1eeb15ab9f1bf13f38a0b5effd33de"
Oct 31 00:02:04.142785 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:02:04.142766    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bbabf31c888e9aea6dc43ed91e1adbaaf1eeb15ab9f1bf13f38a0b5effd33de\": container with ID starting with 1bbabf31c888e9aea6dc43ed91e1adbaaf1eeb15ab9f1bf13f38a0b5effd33de not found: ID does not exist" containerID="1bbabf31c888e9aea6dc43ed91e1adbaaf1eeb15ab9f1bf13f38a0b5effd33de"
Oct 31 00:02:04.142847 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:04.142793    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bbabf31c888e9aea6dc43ed91e1adbaaf1eeb15ab9f1bf13f38a0b5effd33de"} err="failed to get container status \"1bbabf31c888e9aea6dc43ed91e1adbaaf1eeb15ab9f1bf13f38a0b5effd33de\": rpc error: code = NotFound desc = could not find container \"1bbabf31c888e9aea6dc43ed91e1adbaaf1eeb15ab9f1bf13f38a0b5effd33de\": container with ID starting with 1bbabf31c888e9aea6dc43ed91e1adbaaf1eeb15ab9f1bf13f38a0b5effd33de not found: ID does not exist"
Oct 31 00:02:04.142847 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:04.142810    4921 scope.go:122] "RemoveContainer" containerID="155ae7b14a7fbbcfce77b8477fbc890696ca53c7621572c4f25b970678bcbe74"
Oct 31 00:02:04.143109 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:02:04.143088    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"155ae7b14a7fbbcfce77b8477fbc890696ca53c7621572c4f25b970678bcbe74\": container with ID starting with 155ae7b14a7fbbcfce77b8477fbc890696ca53c7621572c4f25b970678bcbe74 not found: ID does not exist" containerID="155ae7b14a7fbbcfce77b8477fbc890696ca53c7621572c4f25b970678bcbe74"
Oct 31 00:02:04.143153 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:04.143118    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"155ae7b14a7fbbcfce77b8477fbc890696ca53c7621572c4f25b970678bcbe74"} err="failed to get container status \"155ae7b14a7fbbcfce77b8477fbc890696ca53c7621572c4f25b970678bcbe74\": rpc error: code = NotFound desc = could not find container \"155ae7b14a7fbbcfce77b8477fbc890696ca53c7621572c4f25b970678bcbe74\": container with ID starting with 155ae7b14a7fbbcfce77b8477fbc890696ca53c7621572c4f25b970678bcbe74 not found: ID does not exist"
Oct 31 00:02:04.148382 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:04.148358    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"]
Oct 31 00:02:04.152169 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:04.152148    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-9ef03a-openshift-default-78cc76c9cc-4vl9j"]
Oct 31 00:02:04.547586 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:04.547546    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:04.882965 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:04.882943    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ac24a789-f285-4a46-8121-579b4b3bd264" path="/var/lib/kubelet/pods/ac24a789-f285-4a46-8121-579b4b3bd264/volumes"
Oct 31 00:02:04.883441 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:04.883426    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b14e7bdd-df95-4c34-958c-3b023b9596fa" path="/var/lib/kubelet/pods/b14e7bdd-df95-4c34-958c-3b023b9596fa/volumes"
Oct 31 00:02:05.341205 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:05.341122    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:05.622980 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:05.622882    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:05.759517 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:05.759481    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:05.886236 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:05.886207    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:06.094575 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:06.094540    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:06.221319 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:06.221289    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:06.439115 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:06.439085    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:06.843171 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:06.843130    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:07.556268 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:07.556231    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:08.345457 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:08.345418    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:09.034989 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:09.034956    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:09.191633 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:09.191570    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:10.017759 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:10.017723    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:10.737323 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:10.737290    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:11.403785 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:02:11.403745    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:02:11.463333 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:11.463288    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:12.323760 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:12.323728    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:12.875368 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:12.875333    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:13.115728 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:13.115686    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:13.777873 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:13.777838    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:14.039711 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:14.039621    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:14.838185 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:14.838153    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:15.640655 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:15.640583    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:16.348293 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:16.348243    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:17.121359 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:17.121325    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:18.050685 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:18.050650    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:18.997278 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:18.997240    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:19.736394 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:19.736359    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:20.440500 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:20.440469    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:21.136546 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:21.136508    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:21.849093 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:21.849062    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:22.541856 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:22.541822    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:23.245491 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:23.245446    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:23.940198 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:23.940153    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:24.574893 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:24.574857    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:24.704344 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:24.704301    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:24.845896 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:24.845810    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:25.594544 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:25.594498    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:26.434120 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:26.434085    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:27.369138 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:27.369101    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:28.127345 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:28.127311    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:28.840295 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:28.840260    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:29.607819 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:29.607783    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:30.447470 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:30.447428    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:31.235885 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:31.235849    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:31.954781 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:31.954724    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:32.630609 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:32.630559    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:33.403312 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:33.403271    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:34.027542 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:34.027512    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:34.726740 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:34.726708    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:35.066260 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:35.066177    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn"]
Oct 31 00:02:35.172100 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:35.172065    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:35.290258 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:35.290227    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:35.426864 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:35.426827    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:36.123353 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:36.123319    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:36.737253 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:36.737216    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:36.899945 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:36.899821    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:37.027424 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:37.027339    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:37.157415 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:37.157372    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:37.540109 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:37.540073    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:37.850195 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:37.850082    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:38.647271 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:38.647205    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:39.326512 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:39.326471    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:40.067024 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:40.066965    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn" podUID="55ce736b-a050-4941-a887-7d9a6229427f" containerName="payload-pre-processing" containerID="cri-o://0c3bd7f269e14f555a877cd8a8961f8120d3a622eddc63b1424dae8e20dcec64" gracePeriod=25
Oct 31 00:02:40.128780 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:40.128747    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:40.663741 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:40.663702    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn" podUID="55ce736b-a050-4941-a887-7d9a6229427f" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:02:40.835490 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:40.835460    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:41.411764 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:02:41.411723    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:02:41.642062 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:41.642029    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:42.340447 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:42.340409    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:43.136676 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:43.136638    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:43.839248 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:43.839213    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:44.584665 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:44.584628    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:44.762881 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:44.762841    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:44.842538 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:44.842457    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"]
Oct 31 00:02:44.842774 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:44.842746    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd" podUID="62106426-3aa0-4918-b5db-ab1a0a70d1e5" containerName="istio-proxy" containerID="cri-o://8f569d39ce2ee816adb0b6857cd63e09a31e99c36d3ece0f4fd6223b015f60f4" gracePeriod=30
Oct 31 00:02:44.919414 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:44.919386    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:45.589506 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:45.589478    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:46.565998 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:46.560373    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:47.193909 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:47.193872    4921 patch_prober.go:29] interesting pod/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:02:47.194324 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:47.193949    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd" podUID="62106426-3aa0-4918-b5db-ab1a0a70d1e5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:02:47.434161 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:47.434121    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:48.138608 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:48.138558    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:48.822853 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:48.822820    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:49.545758 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:49.545719    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:50.122551 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.122490    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 31 00:02:50.216686 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.216658    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-envoy\") pod \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") "
Oct 31 00:02:50.216864 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.216749    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-data\") pod \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") "
Oct 31 00:02:50.216864 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.216780    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-workload-certs\") pod \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") "
Oct 31 00:02:50.216953 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.216862    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-token\" (UniqueName: \"kubernetes.io/projected/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-token\") pod \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") "
Oct 31 00:02:50.217017 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.216947    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-credential-socket\") pod \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") "
Oct 31 00:02:50.217017 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.216975    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istiod-ca-cert\") pod \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") "
Oct 31 00:02:50.217017 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.217002    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-podinfo\") pod \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") "
Oct 31 00:02:50.217171 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.217039    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-data" pod "62106426-3aa0-4918-b5db-ab1a0a70d1e5" (UID: "62106426-3aa0-4918-b5db-ab1a0a70d1e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:02:50.217171 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.217058    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/62106426-3aa0-4918-b5db-ab1a0a70d1e5-kube-api-access-nnr8m\" (UniqueName: \"kubernetes.io/projected/62106426-3aa0-4918-b5db-ab1a0a70d1e5-kube-api-access-nnr8m\") pod \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") "
Oct 31 00:02:50.217171 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.217084    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-workload-socket\") pod \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\" (UID: \"62106426-3aa0-4918-b5db-ab1a0a70d1e5\") "
Oct 31 00:02:50.217347 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.217146    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-workload-certs" pod "62106426-3aa0-4918-b5db-ab1a0a70d1e5" (UID: "62106426-3aa0-4918-b5db-ab1a0a70d1e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:02:50.217347 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.217219    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-credential-socket" pod "62106426-3aa0-4918-b5db-ab1a0a70d1e5" (UID: "62106426-3aa0-4918-b5db-ab1a0a70d1e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:02:50.217463 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.217446    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-workload-socket" pod "62106426-3aa0-4918-b5db-ab1a0a70d1e5" (UID: "62106426-3aa0-4918-b5db-ab1a0a70d1e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:02:50.217550 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.217521    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istiod-ca-cert" pod "62106426-3aa0-4918-b5db-ab1a0a70d1e5" (UID: "62106426-3aa0-4918-b5db-ab1a0a70d1e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:02:50.217897 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.217762    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:50.217897 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.217791    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:50.217897 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.217806    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:50.217897 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.217822    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:50.217897 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.217834    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:50.219170 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.219141    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-envoy" pod "62106426-3aa0-4918-b5db-ab1a0a70d1e5" (UID: "62106426-3aa0-4918-b5db-ab1a0a70d1e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:02:50.219401 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.219383    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-token" pod "62106426-3aa0-4918-b5db-ab1a0a70d1e5" (UID: "62106426-3aa0-4918-b5db-ab1a0a70d1e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:02:50.219487 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.219469    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-podinfo" pod "62106426-3aa0-4918-b5db-ab1a0a70d1e5" (UID: "62106426-3aa0-4918-b5db-ab1a0a70d1e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:02:50.219643 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.219614    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62106426-3aa0-4918-b5db-ab1a0a70d1e5-kube-api-access-nnr8m" pod "62106426-3aa0-4918-b5db-ab1a0a70d1e5" (UID: "62106426-3aa0-4918-b5db-ab1a0a70d1e5"). InnerVolumeSpecName "kube-api-access-nnr8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:02:50.319063 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.319030    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:50.319063 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.319058    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:50.319063 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.319067    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62106426-3aa0-4918-b5db-ab1a0a70d1e5-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:50.319299 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.319077    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnr8m\" (UniqueName: \"kubernetes.io/projected/62106426-3aa0-4918-b5db-ab1a0a70d1e5-kube-api-access-nnr8m\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:02:50.330169 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.330135    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:50.470092 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.470060    4921 generic.go:356] "Generic (PLEG): container finished" podID="62106426-3aa0-4918-b5db-ab1a0a70d1e5" containerID="8f569d39ce2ee816adb0b6857cd63e09a31e99c36d3ece0f4fd6223b015f60f4" exitCode=0
Oct 31 00:02:50.470294 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.470107    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"
Oct 31 00:02:50.470294 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.470142    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd" event={"ID":"62106426-3aa0-4918-b5db-ab1a0a70d1e5","Type":"ContainerDied","Data":"8f569d39ce2ee816adb0b6857cd63e09a31e99c36d3ece0f4fd6223b015f60f4"}
Oct 31 00:02:50.470294 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.470198    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd" event={"ID":"62106426-3aa0-4918-b5db-ab1a0a70d1e5","Type":"ContainerDied","Data":"d96978bd72be2aa86647a86231d681f2509c219ec5f76ec345647b3988127d19"}
Oct 31 00:02:50.470294 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.470222    4921 scope.go:122] "RemoveContainer" containerID="8f569d39ce2ee816adb0b6857cd63e09a31e99c36d3ece0f4fd6223b015f60f4"
Oct 31 00:02:50.481458 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.481440    4921 scope.go:122] "RemoveContainer" containerID="f64bb7c0a9df2391acc1f595476c8045327c17ee0c2437cd3c90c5b98e573135"
Oct 31 00:02:50.490351 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.490333    4921 scope.go:122] "RemoveContainer" containerID="8f569d39ce2ee816adb0b6857cd63e09a31e99c36d3ece0f4fd6223b015f60f4"
Oct 31 00:02:50.490666 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:02:50.490648    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f569d39ce2ee816adb0b6857cd63e09a31e99c36d3ece0f4fd6223b015f60f4\": container with ID starting with 8f569d39ce2ee816adb0b6857cd63e09a31e99c36d3ece0f4fd6223b015f60f4 not found: ID does not exist" containerID="8f569d39ce2ee816adb0b6857cd63e09a31e99c36d3ece0f4fd6223b015f60f4"
Oct 31 00:02:50.490714 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.490675    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f569d39ce2ee816adb0b6857cd63e09a31e99c36d3ece0f4fd6223b015f60f4"} err="failed to get container status \"8f569d39ce2ee816adb0b6857cd63e09a31e99c36d3ece0f4fd6223b015f60f4\": rpc error: code = NotFound desc = could not find container \"8f569d39ce2ee816adb0b6857cd63e09a31e99c36d3ece0f4fd6223b015f60f4\": container with ID starting with 8f569d39ce2ee816adb0b6857cd63e09a31e99c36d3ece0f4fd6223b015f60f4 not found: ID does not exist"
Oct 31 00:02:50.490714 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.490692    4921 scope.go:122] "RemoveContainer" containerID="f64bb7c0a9df2391acc1f595476c8045327c17ee0c2437cd3c90c5b98e573135"
Oct 31 00:02:50.490923 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:02:50.490904    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f64bb7c0a9df2391acc1f595476c8045327c17ee0c2437cd3c90c5b98e573135\": container with ID starting with f64bb7c0a9df2391acc1f595476c8045327c17ee0c2437cd3c90c5b98e573135 not found: ID does not exist" containerID="f64bb7c0a9df2391acc1f595476c8045327c17ee0c2437cd3c90c5b98e573135"
Oct 31 00:02:50.490971 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.490932    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f64bb7c0a9df2391acc1f595476c8045327c17ee0c2437cd3c90c5b98e573135"} err="failed to get container status \"f64bb7c0a9df2391acc1f595476c8045327c17ee0c2437cd3c90c5b98e573135\": rpc error: code = NotFound desc = could not find container \"f64bb7c0a9df2391acc1f595476c8045327c17ee0c2437cd3c90c5b98e573135\": container with ID starting with f64bb7c0a9df2391acc1f595476c8045327c17ee0c2437cd3c90c5b98e573135 not found: ID does not exist"
Oct 31 00:02:50.495989 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.495967    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"]
Oct 31 00:02:50.505039 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.505021    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-6b38a4-openshift-default-5569579f7f-6n8bd"]
Oct 31 00:02:50.662871 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.662840    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn" podUID="55ce736b-a050-4941-a887-7d9a6229427f" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:02:50.883063 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:50.883037    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="62106426-3aa0-4918-b5db-ab1a0a70d1e5" path="/var/lib/kubelet/pods/62106426-3aa0-4918-b5db-ab1a0a70d1e5/volumes"
Oct 31 00:02:51.124462 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:51.124427    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:51.829566 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:51.829524    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:52.567448 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:52.567406    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:53.233839 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:53.233798    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:53.943743 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:53.943692    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:54.747656 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:54.747568    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:54.883901 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:54.883866    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:55.449390 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:55.449349    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:55.691258 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:55.691227    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5"]
Oct 31 00:02:55.712535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:55.712448    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6"]
Oct 31 00:02:55.823789 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:55.823756    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:55.966871 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:55.966764    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:56.339273 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:56.339174    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:56.908847 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:56.908799    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:57.072262 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:57.072222    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:57.205254 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:57.205167    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:57.427095 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:57.427058    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:57.735177 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:57.735142    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:58.079012 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:58.078444    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:58.954645 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:58.954519    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:02:59.760089 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:02:59.760017    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:00.335711 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.335655    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn"
Oct 31 00:03:00.437454 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.437425    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/55ce736b-a050-4941-a887-7d9a6229427f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55ce736b-a050-4941-a887-7d9a6229427f-plugins-config-volume\") pod \"55ce736b-a050-4941-a887-7d9a6229427f\" (UID: \"55ce736b-a050-4941-a887-7d9a6229427f\") "
Oct 31 00:03:00.437648 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.437490    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/55ce736b-a050-4941-a887-7d9a6229427f-kube-api-access-5pn2z\" (UniqueName: \"kubernetes.io/projected/55ce736b-a050-4941-a887-7d9a6229427f-kube-api-access-5pn2z\") pod \"55ce736b-a050-4941-a887-7d9a6229427f\" (UID: \"55ce736b-a050-4941-a887-7d9a6229427f\") "
Oct 31 00:03:00.437880 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.437848    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55ce736b-a050-4941-a887-7d9a6229427f-plugins-config-volume" pod "55ce736b-a050-4941-a887-7d9a6229427f" (UID: "55ce736b-a050-4941-a887-7d9a6229427f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:03:00.439640 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.439613    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55ce736b-a050-4941-a887-7d9a6229427f-kube-api-access-5pn2z" pod "55ce736b-a050-4941-a887-7d9a6229427f" (UID: "55ce736b-a050-4941-a887-7d9a6229427f"). InnerVolumeSpecName "kube-api-access-5pn2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:03:00.535012 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.534976    4921 generic.go:356] "Generic (PLEG): container finished" podID="55ce736b-a050-4941-a887-7d9a6229427f" containerID="0c3bd7f269e14f555a877cd8a8961f8120d3a622eddc63b1424dae8e20dcec64" exitCode=0
Oct 31 00:03:00.535012 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.535016    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn"
Oct 31 00:03:00.535324 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.535045    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn" event={"ID":"55ce736b-a050-4941-a887-7d9a6229427f","Type":"ContainerDied","Data":"0c3bd7f269e14f555a877cd8a8961f8120d3a622eddc63b1424dae8e20dcec64"}
Oct 31 00:03:00.535324 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.535090    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn" event={"ID":"55ce736b-a050-4941-a887-7d9a6229427f","Type":"ContainerDied","Data":"9d762ee66d73f88666637e67810e2d5a41b53dfd4447a72cbb302a626b8c7a4e"}
Oct 31 00:03:00.535324 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.535114    4921 scope.go:122] "RemoveContainer" containerID="0c3bd7f269e14f555a877cd8a8961f8120d3a622eddc63b1424dae8e20dcec64"
Oct 31 00:03:00.538959 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.538939    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55ce736b-a050-4941-a887-7d9a6229427f-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:00.538959 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.538961    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pn2z\" (UniqueName: \"kubernetes.io/projected/55ce736b-a050-4941-a887-7d9a6229427f-kube-api-access-5pn2z\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:00.545759 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.545738    4921 scope.go:122] "RemoveContainer" containerID="0c3bd7f269e14f555a877cd8a8961f8120d3a622eddc63b1424dae8e20dcec64"
Oct 31 00:03:00.546028 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:03:00.546011    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c3bd7f269e14f555a877cd8a8961f8120d3a622eddc63b1424dae8e20dcec64\": container with ID starting with 0c3bd7f269e14f555a877cd8a8961f8120d3a622eddc63b1424dae8e20dcec64 not found: ID does not exist" containerID="0c3bd7f269e14f555a877cd8a8961f8120d3a622eddc63b1424dae8e20dcec64"
Oct 31 00:03:00.546084 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.546036    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c3bd7f269e14f555a877cd8a8961f8120d3a622eddc63b1424dae8e20dcec64"} err="failed to get container status \"0c3bd7f269e14f555a877cd8a8961f8120d3a622eddc63b1424dae8e20dcec64\": rpc error: code = NotFound desc = could not find container \"0c3bd7f269e14f555a877cd8a8961f8120d3a622eddc63b1424dae8e20dcec64\": container with ID starting with 0c3bd7f269e14f555a877cd8a8961f8120d3a622eddc63b1424dae8e20dcec64 not found: ID does not exist"
Oct 31 00:03:00.557529 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.557508    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn"]
Oct 31 00:03:00.568213 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.568177    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:00.572734 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.572665    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-6b38a4-869d9d8cd7-d8gkn"]
Oct 31 00:03:00.692493 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.692453    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5" podUID="30e1183d-5ec4-44bc-a3ff-585db970d413" containerName="payload-processing" containerID="cri-o://5acbbb8d21278c8abc15f5f1e1f978ac482d8fecad6b01be69688f32b19b779f" gracePeriod=25
Oct 31 00:03:00.713020 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.712984    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6" podUID="a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90" containerName="payload-pre-processing" containerID="cri-o://2aa1107dcd4feb5aaa86a3567ec5272c5b8cd5271e14e4e27e687757e4ca150b" gracePeriod=25
Oct 31 00:03:00.802417 ip-10-0-142-208 kubenswrapper[4921]: W1031 00:03:00.802392    4921 logging.go:55] [core] [Channel #5397 SubChannel #5398]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.159:50052", ServerName: "10.132.0.159:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.159:50052: connect: connection refused"
Oct 31 00:03:00.888535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.888123    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="55ce736b-a050-4941-a887-7d9a6229427f" path="/var/lib/kubelet/pods/55ce736b-a050-4941-a887-7d9a6229427f/volumes"
Oct 31 00:03:00.933615 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:00.933570    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5"
Oct 31 00:03:01.046354 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:01.046275    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/30e1183d-5ec4-44bc-a3ff-585db970d413-kube-api-access-wmj8n\" (UniqueName: \"kubernetes.io/projected/30e1183d-5ec4-44bc-a3ff-585db970d413-kube-api-access-wmj8n\") pod \"30e1183d-5ec4-44bc-a3ff-585db970d413\" (UID: \"30e1183d-5ec4-44bc-a3ff-585db970d413\") "
Oct 31 00:03:01.046354 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:01.046333    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/30e1183d-5ec4-44bc-a3ff-585db970d413-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30e1183d-5ec4-44bc-a3ff-585db970d413-plugins-config-volume\") pod \"30e1183d-5ec4-44bc-a3ff-585db970d413\" (UID: \"30e1183d-5ec4-44bc-a3ff-585db970d413\") "
Oct 31 00:03:01.046776 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:01.046751    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30e1183d-5ec4-44bc-a3ff-585db970d413-plugins-config-volume" pod "30e1183d-5ec4-44bc-a3ff-585db970d413" (UID: "30e1183d-5ec4-44bc-a3ff-585db970d413"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:03:01.048618 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:01.048581    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30e1183d-5ec4-44bc-a3ff-585db970d413-kube-api-access-wmj8n" pod "30e1183d-5ec4-44bc-a3ff-585db970d413" (UID: "30e1183d-5ec4-44bc-a3ff-585db970d413"). InnerVolumeSpecName "kube-api-access-wmj8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:03:01.147432 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:01.147398    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmj8n\" (UniqueName: \"kubernetes.io/projected/30e1183d-5ec4-44bc-a3ff-585db970d413-kube-api-access-wmj8n\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:01.147432 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:01.147432    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30e1183d-5ec4-44bc-a3ff-585db970d413-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:01.421434 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:01.421391    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:01.541505 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:01.541472    4921 generic.go:356] "Generic (PLEG): container finished" podID="30e1183d-5ec4-44bc-a3ff-585db970d413" containerID="5acbbb8d21278c8abc15f5f1e1f978ac482d8fecad6b01be69688f32b19b779f" exitCode=0
Oct 31 00:03:01.541715 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:01.541533    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5"
Oct 31 00:03:01.541715 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:01.541555    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5" event={"ID":"30e1183d-5ec4-44bc-a3ff-585db970d413","Type":"ContainerDied","Data":"5acbbb8d21278c8abc15f5f1e1f978ac482d8fecad6b01be69688f32b19b779f"}
Oct 31 00:03:01.541715 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:01.541657    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5" event={"ID":"30e1183d-5ec4-44bc-a3ff-585db970d413","Type":"ContainerDied","Data":"4ce68f6ad1e7c0d5316942a4c02daef98dfafdf410b73130ba92f7340e8e859c"}
Oct 31 00:03:01.541715 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:01.541684    4921 scope.go:122] "RemoveContainer" containerID="5acbbb8d21278c8abc15f5f1e1f978ac482d8fecad6b01be69688f32b19b779f"
Oct 31 00:03:01.552094 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:01.552073    4921 scope.go:122] "RemoveContainer" containerID="5acbbb8d21278c8abc15f5f1e1f978ac482d8fecad6b01be69688f32b19b779f"
Oct 31 00:03:01.552368 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:03:01.552348    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5acbbb8d21278c8abc15f5f1e1f978ac482d8fecad6b01be69688f32b19b779f\": container with ID starting with 5acbbb8d21278c8abc15f5f1e1f978ac482d8fecad6b01be69688f32b19b779f not found: ID does not exist" containerID="5acbbb8d21278c8abc15f5f1e1f978ac482d8fecad6b01be69688f32b19b779f"
Oct 31 00:03:01.552425 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:01.552377    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5acbbb8d21278c8abc15f5f1e1f978ac482d8fecad6b01be69688f32b19b779f"} err="failed to get container status \"5acbbb8d21278c8abc15f5f1e1f978ac482d8fecad6b01be69688f32b19b779f\": rpc error: code = NotFound desc = could not find container \"5acbbb8d21278c8abc15f5f1e1f978ac482d8fecad6b01be69688f32b19b779f\": container with ID starting with 5acbbb8d21278c8abc15f5f1e1f978ac482d8fecad6b01be69688f32b19b779f not found: ID does not exist"
Oct 31 00:03:01.568802 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:01.568777    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5"]
Oct 31 00:03:01.573774 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:01.573754    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5"]
Oct 31 00:03:01.802310 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:01.802212    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-inf-b-e5934f-564b7bc8cf-tdgp5" podUID="30e1183d-5ec4-44bc-a3ff-585db970d413" containerName="payload-processing" probeResult="failure" output="timeout: failed to connect service \"10.132.0.159:50052\" within 1s: context deadline exceeded"
Oct 31 00:03:02.127509 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:02.127428    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:02.861490 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:02.856912    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:02.883431 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:02.883394    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="30e1183d-5ec4-44bc-a3ff-585db970d413" path="/var/lib/kubelet/pods/30e1183d-5ec4-44bc-a3ff-585db970d413/volumes"
Oct 31 00:03:03.533648 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:03.533586    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:04.397379 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:04.397344    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:04.969112 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:04.969075    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:05.108982 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:05.108948    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:05.249876 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:05.249781    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"]
Oct 31 00:03:05.250094 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:05.250058    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb" podUID="c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" containerName="istio-proxy" containerID="cri-o://90c3cf18f316b0572758542becc54c57c2beeb7b347560767db6c8596f04756a" gracePeriod=30
Oct 31 00:03:05.268462 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:05.268430    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:05.513158 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:05.513062    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:05.786635 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:05.786501    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:06.171970 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:06.171935    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:07.046181 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:07.046150    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:07.814760 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:07.814722    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:08.542298 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:08.542264    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:08.766833 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:08.766797    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6" podUID="a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:03:09.224525 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:09.224490    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:09.952647 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:09.952617    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:10.531884 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.531824    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 31 00:03:10.563008 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.562976    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-data\") pod \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") "
Oct 31 00:03:10.563175 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.563022    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-token\" (UniqueName: \"kubernetes.io/projected/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-token\") pod \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") "
Oct 31 00:03:10.563175 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.563062    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-workload-socket\") pod \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") "
Oct 31 00:03:10.563175 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.563110    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-kube-api-access-p8rtr\" (UniqueName: \"kubernetes.io/projected/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-kube-api-access-p8rtr\") pod \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") "
Oct 31 00:03:10.563175 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.563149    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istiod-ca-cert\") pod \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") "
Oct 31 00:03:10.563411 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.563227    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-envoy\") pod \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") "
Oct 31 00:03:10.563411 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.563258    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-podinfo\") pod \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") "
Oct 31 00:03:10.563411 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.563272    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-data" pod "c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" (UID: "c52bd2b2-c6ff-4c45-aa3e-3d44586b5970"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:10.563411 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.563301    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-workload-certs\") pod \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") "
Oct 31 00:03:10.563411 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.563313    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-workload-socket" pod "c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" (UID: "c52bd2b2-c6ff-4c45-aa3e-3d44586b5970"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:10.563411 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.563367    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-credential-socket\") pod \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\" (UID: \"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970\") "
Oct 31 00:03:10.563773 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.563549    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-workload-certs" pod "c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" (UID: "c52bd2b2-c6ff-4c45-aa3e-3d44586b5970"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:10.563773 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.563613    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istiod-ca-cert" pod "c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" (UID: "c52bd2b2-c6ff-4c45-aa3e-3d44586b5970"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:03:10.563888 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.563816    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-credential-socket" pod "c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" (UID: "c52bd2b2-c6ff-4c45-aa3e-3d44586b5970"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:10.563953 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.563935    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:10.564016 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.563960    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:10.564016 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.563974    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:10.564016 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.563989    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:10.564016 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.564003    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:10.566171 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.566134    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-podinfo" pod "c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" (UID: "c52bd2b2-c6ff-4c45-aa3e-3d44586b5970"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:03:10.566290 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.566235    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-envoy" pod "c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" (UID: "c52bd2b2-c6ff-4c45-aa3e-3d44586b5970"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:10.566518 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.566483    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-kube-api-access-p8rtr" pod "c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" (UID: "c52bd2b2-c6ff-4c45-aa3e-3d44586b5970"). InnerVolumeSpecName "kube-api-access-p8rtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:03:10.566632 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.566580    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-token" pod "c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" (UID: "c52bd2b2-c6ff-4c45-aa3e-3d44586b5970"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:03:10.627882 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.627849    4921 generic.go:356] "Generic (PLEG): container finished" podID="c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" containerID="90c3cf18f316b0572758542becc54c57c2beeb7b347560767db6c8596f04756a" exitCode=0
Oct 31 00:03:10.628051 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.627911    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"
Oct 31 00:03:10.628051 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.627941    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb" event={"ID":"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970","Type":"ContainerDied","Data":"90c3cf18f316b0572758542becc54c57c2beeb7b347560767db6c8596f04756a"}
Oct 31 00:03:10.628051 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.627999    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb" event={"ID":"c52bd2b2-c6ff-4c45-aa3e-3d44586b5970","Type":"ContainerDied","Data":"deec2e4e8d713260c5ed16b682aa9b3668b96656363add70274ffcfb0ad91bb0"}
Oct 31 00:03:10.628051 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.628020    4921 scope.go:122] "RemoveContainer" containerID="90c3cf18f316b0572758542becc54c57c2beeb7b347560767db6c8596f04756a"
Oct 31 00:03:10.638288 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.638272    4921 scope.go:122] "RemoveContainer" containerID="a2b529fb72214c4a17fcd9d66173ef5653d9ba697d4fa9f5333129f410b2bb25"
Oct 31 00:03:10.647304 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.647286    4921 scope.go:122] "RemoveContainer" containerID="90c3cf18f316b0572758542becc54c57c2beeb7b347560767db6c8596f04756a"
Oct 31 00:03:10.647574 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:03:10.647551    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90c3cf18f316b0572758542becc54c57c2beeb7b347560767db6c8596f04756a\": container with ID starting with 90c3cf18f316b0572758542becc54c57c2beeb7b347560767db6c8596f04756a not found: ID does not exist" containerID="90c3cf18f316b0572758542becc54c57c2beeb7b347560767db6c8596f04756a"
Oct 31 00:03:10.647740 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.647586    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c3cf18f316b0572758542becc54c57c2beeb7b347560767db6c8596f04756a"} err="failed to get container status \"90c3cf18f316b0572758542becc54c57c2beeb7b347560767db6c8596f04756a\": rpc error: code = NotFound desc = could not find container \"90c3cf18f316b0572758542becc54c57c2beeb7b347560767db6c8596f04756a\": container with ID starting with 90c3cf18f316b0572758542becc54c57c2beeb7b347560767db6c8596f04756a not found: ID does not exist"
Oct 31 00:03:10.647740 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.647617    4921 scope.go:122] "RemoveContainer" containerID="a2b529fb72214c4a17fcd9d66173ef5653d9ba697d4fa9f5333129f410b2bb25"
Oct 31 00:03:10.647898 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:03:10.647879    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2b529fb72214c4a17fcd9d66173ef5653d9ba697d4fa9f5333129f410b2bb25\": container with ID starting with a2b529fb72214c4a17fcd9d66173ef5653d9ba697d4fa9f5333129f410b2bb25 not found: ID does not exist" containerID="a2b529fb72214c4a17fcd9d66173ef5653d9ba697d4fa9f5333129f410b2bb25"
Oct 31 00:03:10.647939 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.647903    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2b529fb72214c4a17fcd9d66173ef5653d9ba697d4fa9f5333129f410b2bb25"} err="failed to get container status \"a2b529fb72214c4a17fcd9d66173ef5653d9ba697d4fa9f5333129f410b2bb25\": rpc error: code = NotFound desc = could not find container \"a2b529fb72214c4a17fcd9d66173ef5653d9ba697d4fa9f5333129f410b2bb25\": container with ID starting with a2b529fb72214c4a17fcd9d66173ef5653d9ba697d4fa9f5333129f410b2bb25 not found: ID does not exist"
Oct 31 00:03:10.651238 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.651216    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"]
Oct 31 00:03:10.656167 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.656143    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e5934f-openshift-default-74496d4f89-nxfcb"]
Oct 31 00:03:10.665697 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.665668    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:10.665697 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.665691    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8rtr\" (UniqueName: \"kubernetes.io/projected/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-kube-api-access-p8rtr\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:10.665844 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.665703    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:10.665844 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.665712    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:10.714389 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.714355    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:10.748468 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.748432    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"]
Oct 31 00:03:10.752519 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.751488    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"]
Oct 31 00:03:10.852800 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.852716    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:10.882850 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:10.882819    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" path="/var/lib/kubelet/pods/c52bd2b2-c6ff-4c45-aa3e-3d44586b5970/volumes"
Oct 31 00:03:11.404135 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:03:11.404102    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:03:11.615324 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:11.615251    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:12.345856 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:12.345806    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:13.092338 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:13.092305    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:13.731155 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:13.731093    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:14.420040 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:14.420009    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:15.126995 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:15.126965    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:15.926678 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:15.926647    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:16.115313 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:16.115279    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b"]
Oct 31 00:03:16.127734 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:16.127702    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7"]
Oct 31 00:03:16.232011 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:16.231918    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:16.375013 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:16.374949    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:18.766144 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:18.766104    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6" podUID="a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:03:20.964701 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:20.964675    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6"
Oct 31 00:03:21.078040 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:21.077959    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90-plugins-config-volume\") pod \"a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90\" (UID: \"a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90\") "
Oct 31 00:03:21.078220 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:21.078065    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90-kube-api-access-pzvnv\" (UniqueName: \"kubernetes.io/projected/a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90-kube-api-access-pzvnv\") pod \"a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90\" (UID: \"a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90\") "
Oct 31 00:03:21.078349 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:21.078323    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90-plugins-config-volume" pod "a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90" (UID: "a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:03:21.080283 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:21.080260    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90-kube-api-access-pzvnv" pod "a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90" (UID: "a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90"). InnerVolumeSpecName "kube-api-access-pzvnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:03:21.115645 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:21.115586    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b" podUID="6ac65d9a-6c8f-43c9-aa20-caca662961f5" containerName="payload-processing" containerID="cri-o://5854633c74998edac768a608bb2c33ad52f5994a6b91a506bf6f0bad5a7d3435" gracePeriod=25
Oct 31 00:03:21.128318 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:21.128286    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7" podUID="53df0b12-f9f8-496b-89b7-74ab374eedda" containerName="payload-pre-processing" containerID="cri-o://509ba8184b0939230ef9e85b7b815e99d88b9013c1fc5132b1d0037de99d15ef" gracePeriod=25
Oct 31 00:03:21.179382 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:21.179359    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:21.179382 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:21.179384    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzvnv\" (UniqueName: \"kubernetes.io/projected/a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90-kube-api-access-pzvnv\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:21.703104 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:21.703075    4921 generic.go:356] "Generic (PLEG): container finished" podID="a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90" containerID="2aa1107dcd4feb5aaa86a3567ec5272c5b8cd5271e14e4e27e687757e4ca150b" exitCode=0
Oct 31 00:03:21.703301 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:21.703114    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6" event={"ID":"a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90","Type":"ContainerDied","Data":"2aa1107dcd4feb5aaa86a3567ec5272c5b8cd5271e14e4e27e687757e4ca150b"}
Oct 31 00:03:21.703301 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:21.703122    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6"
Oct 31 00:03:21.703301 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:21.703155    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6" event={"ID":"a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90","Type":"ContainerDied","Data":"f673f3d99da3854f4ae3ee4b407c80acb610cabaade368ab0fcd003b27a46383"}
Oct 31 00:03:21.703301 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:21.703177    4921 scope.go:122] "RemoveContainer" containerID="2aa1107dcd4feb5aaa86a3567ec5272c5b8cd5271e14e4e27e687757e4ca150b"
Oct 31 00:03:21.712819 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:21.712720    4921 scope.go:122] "RemoveContainer" containerID="2aa1107dcd4feb5aaa86a3567ec5272c5b8cd5271e14e4e27e687757e4ca150b"
Oct 31 00:03:21.712984 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:03:21.712967    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2aa1107dcd4feb5aaa86a3567ec5272c5b8cd5271e14e4e27e687757e4ca150b\": container with ID starting with 2aa1107dcd4feb5aaa86a3567ec5272c5b8cd5271e14e4e27e687757e4ca150b not found: ID does not exist" containerID="2aa1107dcd4feb5aaa86a3567ec5272c5b8cd5271e14e4e27e687757e4ca150b"
Oct 31 00:03:21.713027 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:21.712992    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aa1107dcd4feb5aaa86a3567ec5272c5b8cd5271e14e4e27e687757e4ca150b"} err="failed to get container status \"2aa1107dcd4feb5aaa86a3567ec5272c5b8cd5271e14e4e27e687757e4ca150b\": rpc error: code = NotFound desc = could not find container \"2aa1107dcd4feb5aaa86a3567ec5272c5b8cd5271e14e4e27e687757e4ca150b\": container with ID starting with 2aa1107dcd4feb5aaa86a3567ec5272c5b8cd5271e14e4e27e687757e4ca150b not found: ID does not exist"
Oct 31 00:03:21.725871 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:21.725849    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6"]
Oct 31 00:03:21.730122 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:21.730102    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e5934f-5748b99b5f-gffp6"]
Oct 31 00:03:22.830154 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:22.830109    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b" podUID="6ac65d9a-6c8f-43c9-aa20-caca662961f5" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:03:22.830742 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:22.830143    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7" podUID="53df0b12-f9f8-496b-89b7-74ab374eedda" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:03:22.882101 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:22.882069    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90" path="/var/lib/kubelet/pods/a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90/volumes"
Oct 31 00:03:25.774043 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:25.773998    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" containerID="cri-o://558229e1b6e6b04ee406250472fdf94e7ed0db4f910b10a21b1407e00fcf5bef" gracePeriod=45
Oct 31 00:03:25.778036 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:25.777999    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" containerID="cri-o://42f8965ee9c68532b35099a8f2594444465e07bae34210bbde84c246e4be6d20" gracePeriod=45
Oct 31 00:03:25.782929 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:25.782902    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": dial tcp 10.132.0.75:8000: connect: connection refused"
Oct 31 00:03:25.807439 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:25.807409    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": dial tcp 10.132.0.65:8000: connect: connection refused"
Oct 31 00:03:26.096947 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.096916    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 31 00:03:26.107395 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.107361    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 31 00:03:26.232273 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.232244    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-home\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-home\") pod \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") "
Oct 31 00:03:26.232466 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.232290    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-dshm\") pod \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") "
Oct 31 00:03:26.232466 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.232321    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-model-cache\") pod \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") "
Oct 31 00:03:26.232466 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.232387    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-tmp-dir\") pod \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") "
Oct 31 00:03:26.232466 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.232421    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-tmp-dir\") pod \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") "
Oct 31 00:03:26.232723 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.232514    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-model-cache\") pod \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") "
Oct 31 00:03:26.232723 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.232512    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-home" pod "3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" (UID: "3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:26.232723 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.232541    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bf081868-d868-477d-90d4-c7c8f9fb2c5e-kube-api-access-g6g26\" (UniqueName: \"kubernetes.io/projected/bf081868-d868-477d-90d4-c7c8f9fb2c5e-kube-api-access-g6g26\") pod \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") "
Oct 31 00:03:26.232723 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.232626    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-home\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-home\") pod \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") "
Oct 31 00:03:26.232723 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.232672    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-model-cache" pod "3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" (UID: "3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:26.232723 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.232685    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-tls-certs\") pod \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") "
Oct 31 00:03:26.232723 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.232699    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-tmp-dir" pod "3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" (UID: "3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:26.233115 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.232771    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bf081868-d868-477d-90d4-c7c8f9fb2c5e-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf081868-d868-477d-90d4-c7c8f9fb2c5e-tls-certs\") pod \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") "
Oct 31 00:03:26.233115 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.232828    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-dshm\") pod \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\" (UID: \"bf081868-d868-477d-90d4-c7c8f9fb2c5e\") "
Oct 31 00:03:26.233115 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.232852    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-tmp-dir" pod "bf081868-d868-477d-90d4-c7c8f9fb2c5e" (UID: "bf081868-d868-477d-90d4-c7c8f9fb2c5e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:26.233115 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.232865    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-kube-api-access-5b2h7\" (UniqueName: \"kubernetes.io/projected/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-kube-api-access-5b2h7\") pod \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\" (UID: \"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2\") "
Oct 31 00:03:26.233115 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.232913    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-model-cache" pod "bf081868-d868-477d-90d4-c7c8f9fb2c5e" (UID: "bf081868-d868-477d-90d4-c7c8f9fb2c5e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:26.233115 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.233013    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-home" pod "bf081868-d868-477d-90d4-c7c8f9fb2c5e" (UID: "bf081868-d868-477d-90d4-c7c8f9fb2c5e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:26.233430 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.233329    4921 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-tmp-dir\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:26.233430 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.233351    4921 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-tmp-dir\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:26.233430 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.233365    4921 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-model-cache\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:26.233430 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.233379    4921 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-home\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:26.233430 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.233393    4921 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-home\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:26.233430 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.233407    4921 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-model-cache\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:26.235506 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.235478    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-dshm" pod "3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" (UID: "3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:26.235506 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.235493    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-kube-api-access-5b2h7" pod "3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" (UID: "3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2"). InnerVolumeSpecName "kube-api-access-5b2h7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:03:26.235721 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.235563    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-tls-certs" pod "3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" (UID: "3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:03:26.235721 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.235625    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf081868-d868-477d-90d4-c7c8f9fb2c5e-kube-api-access-g6g26" pod "bf081868-d868-477d-90d4-c7c8f9fb2c5e" (UID: "bf081868-d868-477d-90d4-c7c8f9fb2c5e"). InnerVolumeSpecName "kube-api-access-g6g26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:03:26.235721 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.235674    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-dshm" pod "bf081868-d868-477d-90d4-c7c8f9fb2c5e" (UID: "bf081868-d868-477d-90d4-c7c8f9fb2c5e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:26.235831 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.235744    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf081868-d868-477d-90d4-c7c8f9fb2c5e-tls-certs" pod "bf081868-d868-477d-90d4-c7c8f9fb2c5e" (UID: "bf081868-d868-477d-90d4-c7c8f9fb2c5e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:03:26.334301 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.334217    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6g26\" (UniqueName: \"kubernetes.io/projected/bf081868-d868-477d-90d4-c7c8f9fb2c5e-kube-api-access-g6g26\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:26.334301 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.334244    4921 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-tls-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:26.334301 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.334253    4921 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf081868-d868-477d-90d4-c7c8f9fb2c5e-tls-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:26.334301 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.334264    4921 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf081868-d868-477d-90d4-c7c8f9fb2c5e-dshm\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:26.334301 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.334272    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5b2h7\" (UniqueName: \"kubernetes.io/projected/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-kube-api-access-5b2h7\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:26.334301 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.334282    4921 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2-dshm\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:26.731731 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.731698    4921 generic.go:356] "Generic (PLEG): container finished" podID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerID="558229e1b6e6b04ee406250472fdf94e7ed0db4f910b10a21b1407e00fcf5bef" exitCode=0
Oct 31 00:03:26.731922 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.731745    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"
Oct 31 00:03:26.731922 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.731782    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" event={"ID":"bf081868-d868-477d-90d4-c7c8f9fb2c5e","Type":"ContainerDied","Data":"558229e1b6e6b04ee406250472fdf94e7ed0db4f910b10a21b1407e00fcf5bef"}
Oct 31 00:03:26.731922 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.731824    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq" event={"ID":"bf081868-d868-477d-90d4-c7c8f9fb2c5e","Type":"ContainerDied","Data":"eb7b01fec9a0450df68cdbc2a3816e9844afa507daec81c0c1cb59a1703c3782"}
Oct 31 00:03:26.731922 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.731841    4921 scope.go:122] "RemoveContainer" containerID="558229e1b6e6b04ee406250472fdf94e7ed0db4f910b10a21b1407e00fcf5bef"
Oct 31 00:03:26.733336 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.733312    4921 generic.go:356] "Generic (PLEG): container finished" podID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerID="42f8965ee9c68532b35099a8f2594444465e07bae34210bbde84c246e4be6d20" exitCode=0
Oct 31 00:03:26.733451 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.733337    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" event={"ID":"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2","Type":"ContainerDied","Data":"42f8965ee9c68532b35099a8f2594444465e07bae34210bbde84c246e4be6d20"}
Oct 31 00:03:26.733451 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.733368    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"
Oct 31 00:03:26.733451 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.733389    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr" event={"ID":"3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2","Type":"ContainerDied","Data":"b9d569029718bbf8b2d8f21f18073530a78f277596f3e9e47a44e5b07291cf83"}
Oct 31 00:03:26.742370 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.742273    4921 scope.go:122] "RemoveContainer" containerID="558229e1b6e6b04ee406250472fdf94e7ed0db4f910b10a21b1407e00fcf5bef"
Oct 31 00:03:26.742687 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:03:26.742662    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"558229e1b6e6b04ee406250472fdf94e7ed0db4f910b10a21b1407e00fcf5bef\": container with ID starting with 558229e1b6e6b04ee406250472fdf94e7ed0db4f910b10a21b1407e00fcf5bef not found: ID does not exist" containerID="558229e1b6e6b04ee406250472fdf94e7ed0db4f910b10a21b1407e00fcf5bef"
Oct 31 00:03:26.742867 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.742691    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"558229e1b6e6b04ee406250472fdf94e7ed0db4f910b10a21b1407e00fcf5bef"} err="failed to get container status \"558229e1b6e6b04ee406250472fdf94e7ed0db4f910b10a21b1407e00fcf5bef\": rpc error: code = NotFound desc = could not find container \"558229e1b6e6b04ee406250472fdf94e7ed0db4f910b10a21b1407e00fcf5bef\": container with ID starting with 558229e1b6e6b04ee406250472fdf94e7ed0db4f910b10a21b1407e00fcf5bef not found: ID does not exist"
Oct 31 00:03:26.742867 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.742706    4921 scope.go:122] "RemoveContainer" containerID="42f8965ee9c68532b35099a8f2594444465e07bae34210bbde84c246e4be6d20"
Oct 31 00:03:26.751336 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.751317    4921 scope.go:122] "RemoveContainer" containerID="42f8965ee9c68532b35099a8f2594444465e07bae34210bbde84c246e4be6d20"
Oct 31 00:03:26.751585 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:03:26.751559    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42f8965ee9c68532b35099a8f2594444465e07bae34210bbde84c246e4be6d20\": container with ID starting with 42f8965ee9c68532b35099a8f2594444465e07bae34210bbde84c246e4be6d20 not found: ID does not exist" containerID="42f8965ee9c68532b35099a8f2594444465e07bae34210bbde84c246e4be6d20"
Oct 31 00:03:26.751668 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.751610    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42f8965ee9c68532b35099a8f2594444465e07bae34210bbde84c246e4be6d20"} err="failed to get container status \"42f8965ee9c68532b35099a8f2594444465e07bae34210bbde84c246e4be6d20\": rpc error: code = NotFound desc = could not find container \"42f8965ee9c68532b35099a8f2594444465e07bae34210bbde84c246e4be6d20\": container with ID starting with 42f8965ee9c68532b35099a8f2594444465e07bae34210bbde84c246e4be6d20 not found: ID does not exist"
Oct 31 00:03:26.758067 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.758048    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"]
Oct 31 00:03:26.760024 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.760003    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-dd3a15/premium-w5-dd3a15-kserve-6fc9b957dc-szdrr"]
Oct 31 00:03:26.776288 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.776264    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"]
Oct 31 00:03:26.780552 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.780528    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-dd3a15/distinct-w5-dd3a15-kserve-746bf55566-7q9tq"]
Oct 31 00:03:26.882098 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.882064    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" path="/var/lib/kubelet/pods/3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2/volumes"
Oct 31 00:03:26.882475 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:26.882462    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" path="/var/lib/kubelet/pods/bf081868-d868-477d-90d4-c7c8f9fb2c5e/volumes"
Oct 31 00:03:31.598448 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:31.598405    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"]
Oct 31 00:03:31.599014 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:31.598676    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf" podUID="ce487838-fd5e-45c8-9cb9-b29e538ef744" containerName="maas-api" containerID="cri-o://31516b15a9ec482446300d16f31f4cfca6553a3f5a0896a61511e7d29930e07e" gracePeriod=30
Oct 31 00:03:31.674559 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:31.674528    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:31.765018 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:31.764981    4921 generic.go:356] "Generic (PLEG): container finished" podID="ce487838-fd5e-45c8-9cb9-b29e538ef744" containerID="31516b15a9ec482446300d16f31f4cfca6553a3f5a0896a61511e7d29930e07e" exitCode=0
Oct 31 00:03:31.765207 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:31.765060    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf" event={"ID":"ce487838-fd5e-45c8-9cb9-b29e538ef744","Type":"ContainerDied","Data":"31516b15a9ec482446300d16f31f4cfca6553a3f5a0896a61511e7d29930e07e"}
Oct 31 00:03:31.843953 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:31.843907    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:31.939303 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:31.939279    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"
Oct 31 00:03:32.011911 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.011862    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:32.104898 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.104868    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce487838-fd5e-45c8-9cb9-b29e538ef744-kube-api-access-htl22\" (UniqueName: \"kubernetes.io/projected/ce487838-fd5e-45c8-9cb9-b29e538ef744-kube-api-access-htl22\") pod \"ce487838-fd5e-45c8-9cb9-b29e538ef744\" (UID: \"ce487838-fd5e-45c8-9cb9-b29e538ef744\") "
Oct 31 00:03:32.105104 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.104929    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ce487838-fd5e-45c8-9cb9-b29e538ef744-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce487838-fd5e-45c8-9cb9-b29e538ef744-openshift-service-ca\") pod \"ce487838-fd5e-45c8-9cb9-b29e538ef744\" (UID: \"ce487838-fd5e-45c8-9cb9-b29e538ef744\") "
Oct 31 00:03:32.105104 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.105032    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ce487838-fd5e-45c8-9cb9-b29e538ef744-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce487838-fd5e-45c8-9cb9-b29e538ef744-metrics-certs\") pod \"ce487838-fd5e-45c8-9cb9-b29e538ef744\" (UID: \"ce487838-fd5e-45c8-9cb9-b29e538ef744\") "
Oct 31 00:03:32.105104 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.105055    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ce487838-fd5e-45c8-9cb9-b29e538ef744-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce487838-fd5e-45c8-9cb9-b29e538ef744-maas-api-tls\") pod \"ce487838-fd5e-45c8-9cb9-b29e538ef744\" (UID: \"ce487838-fd5e-45c8-9cb9-b29e538ef744\") "
Oct 31 00:03:32.105378 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.105353    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce487838-fd5e-45c8-9cb9-b29e538ef744-openshift-service-ca" pod "ce487838-fd5e-45c8-9cb9-b29e538ef744" (UID: "ce487838-fd5e-45c8-9cb9-b29e538ef744"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:03:32.107391 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.107356    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce487838-fd5e-45c8-9cb9-b29e538ef744-kube-api-access-htl22" pod "ce487838-fd5e-45c8-9cb9-b29e538ef744" (UID: "ce487838-fd5e-45c8-9cb9-b29e538ef744"). InnerVolumeSpecName "kube-api-access-htl22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:03:32.107391 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.107381    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce487838-fd5e-45c8-9cb9-b29e538ef744-metrics-certs" pod "ce487838-fd5e-45c8-9cb9-b29e538ef744" (UID: "ce487838-fd5e-45c8-9cb9-b29e538ef744"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:03:32.107553 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.107490    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce487838-fd5e-45c8-9cb9-b29e538ef744-maas-api-tls" pod "ce487838-fd5e-45c8-9cb9-b29e538ef744" (UID: "ce487838-fd5e-45c8-9cb9-b29e538ef744"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:03:32.206675 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.206292    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htl22\" (UniqueName: \"kubernetes.io/projected/ce487838-fd5e-45c8-9cb9-b29e538ef744-kube-api-access-htl22\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:32.206675 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.206336    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce487838-fd5e-45c8-9cb9-b29e538ef744-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:32.206675 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.206352    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce487838-fd5e-45c8-9cb9-b29e538ef744-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:32.206675 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.206366    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce487838-fd5e-45c8-9cb9-b29e538ef744-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:32.403764 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.403731    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:32.810150 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.810055    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf" event={"ID":"ce487838-fd5e-45c8-9cb9-b29e538ef744","Type":"ContainerDied","Data":"1ceb87cb19acd9c524134036179a63601a7b3eb95a0eba629a07b1648ce9fac4"}
Oct 31 00:03:32.810716 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.810169    4921 scope.go:122] "RemoveContainer" containerID="31516b15a9ec482446300d16f31f4cfca6553a3f5a0896a61511e7d29930e07e"
Oct 31 00:03:32.810716 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.810346    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"
Oct 31 00:03:32.831844 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.831780    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7" podUID="53df0b12-f9f8-496b-89b7-74ab374eedda" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:03:32.832188 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.832069    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b" podUID="6ac65d9a-6c8f-43c9-aa20-caca662961f5" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:03:32.852685 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.852661    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"]
Oct 31 00:03:32.858272 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.858249    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd3a15-658dcc7c6b-n6wrf"]
Oct 31 00:03:32.887800 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:32.887769    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ce487838-fd5e-45c8-9cb9-b29e538ef744" path="/var/lib/kubelet/pods/ce487838-fd5e-45c8-9cb9-b29e538ef744/volumes"
Oct 31 00:03:38.926160 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:38.926119    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:39.144610 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:39.144558    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:39.273685 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:39.273583    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"]
Oct 31 00:03:39.273908 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:39.273835    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg" podUID="da75f51e-ddb3-40a1-b475-b252bc8954d0" containerName="istio-proxy" containerID="cri-o://60703ce96b2004c0bb39637852042a7132bdd7632988b621e8ed1a4d737e1658" gracePeriod=30
Oct 31 00:03:39.280641 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:39.280617    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"]
Oct 31 00:03:39.280821 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:39.280802    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerName="istio-proxy" containerID="cri-o://d9c8aa0022d72197aad63463916597ee008b09356df35404a621ee6d4067e7eb" gracePeriod=30
Oct 31 00:03:39.356990 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:39.356951    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:40.905891 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:40.905857    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"]
Oct 31 00:03:40.906310 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:40.906024    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k" podUID="ad2dd69d-1500-464c-9da4-92351faa35e7" containerName="discovery" containerID="cri-o://fec8884d2fc86ad23d5bf2f161c9867cde1321bd7a9fcd6df32f4393b5fcca64" gracePeriod=30
Oct 31 00:03:41.281053 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.280804    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 31 00:03:41.381428 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.381402    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b"
Oct 31 00:03:41.403585 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.403547    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-csr-dns-cert\") pod \"ad2dd69d-1500-464c-9da4-92351faa35e7\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") "
Oct 31 00:03:41.403786 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.403764    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-cacerts\" (UniqueName: \"kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-cacerts\") pod \"ad2dd69d-1500-464c-9da4-92351faa35e7\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") "
Oct 31 00:03:41.403900 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.403879    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-token\" (UniqueName: \"kubernetes.io/projected/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-token\") pod \"ad2dd69d-1500-464c-9da4-92351faa35e7\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") "
Oct 31 00:03:41.404031 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.403935    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad2dd69d-1500-464c-9da4-92351faa35e7-kube-api-access-zglr5\" (UniqueName: \"kubernetes.io/projected/ad2dd69d-1500-464c-9da4-92351faa35e7-kube-api-access-zglr5\") pod \"ad2dd69d-1500-464c-9da4-92351faa35e7\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") "
Oct 31 00:03:41.404031 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.403989    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-kubeconfig\") pod \"ad2dd69d-1500-464c-9da4-92351faa35e7\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") "
Oct 31 00:03:41.405521 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.405489    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad2dd69d-1500-464c-9da4-92351faa35e7-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad2dd69d-1500-464c-9da4-92351faa35e7-local-certs\") pod \"ad2dd69d-1500-464c-9da4-92351faa35e7\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") "
Oct 31 00:03:41.406495 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.406438    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-csr-ca-configmap" pod "ad2dd69d-1500-464c-9da4-92351faa35e7" (UID: "ad2dd69d-1500-464c-9da4-92351faa35e7"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:03:41.406757 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.406711    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-token" pod "ad2dd69d-1500-464c-9da4-92351faa35e7" (UID: "ad2dd69d-1500-464c-9da4-92351faa35e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:03:41.406757 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.406723    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-csr-ca-configmap\") pod \"ad2dd69d-1500-464c-9da4-92351faa35e7\" (UID: \"ad2dd69d-1500-464c-9da4-92351faa35e7\") "
Oct 31 00:03:41.406948 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:03:41.406767    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:03:41.407090 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.407067    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:41.407179 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.407091    4921 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-csr-ca-configmap\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:41.408205 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.407814    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad2dd69d-1500-464c-9da4-92351faa35e7-kube-api-access-zglr5" pod "ad2dd69d-1500-464c-9da4-92351faa35e7" (UID: "ad2dd69d-1500-464c-9da4-92351faa35e7"). InnerVolumeSpecName "kube-api-access-zglr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:03:41.409412 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.409301    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-csr-dns-cert" pod "ad2dd69d-1500-464c-9da4-92351faa35e7" (UID: "ad2dd69d-1500-464c-9da4-92351faa35e7"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:03:41.412553 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.412527    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-kubeconfig" pod "ad2dd69d-1500-464c-9da4-92351faa35e7" (UID: "ad2dd69d-1500-464c-9da4-92351faa35e7"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:03:41.412553 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.412534    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad2dd69d-1500-464c-9da4-92351faa35e7-local-certs" pod "ad2dd69d-1500-464c-9da4-92351faa35e7" (UID: "ad2dd69d-1500-464c-9da4-92351faa35e7"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:41.413452 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.413432    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-cacerts" pod "ad2dd69d-1500-464c-9da4-92351faa35e7" (UID: "ad2dd69d-1500-464c-9da4-92351faa35e7"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:03:41.426998 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.426973    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7"
Oct 31 00:03:41.507744 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.507662    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53df0b12-f9f8-496b-89b7-74ab374eedda-kube-api-access-sslq4\" (UniqueName: \"kubernetes.io/projected/53df0b12-f9f8-496b-89b7-74ab374eedda-kube-api-access-sslq4\") pod \"53df0b12-f9f8-496b-89b7-74ab374eedda\" (UID: \"53df0b12-f9f8-496b-89b7-74ab374eedda\") "
Oct 31 00:03:41.507744 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.507730    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/53df0b12-f9f8-496b-89b7-74ab374eedda-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53df0b12-f9f8-496b-89b7-74ab374eedda-plugins-config-volume\") pod \"53df0b12-f9f8-496b-89b7-74ab374eedda\" (UID: \"53df0b12-f9f8-496b-89b7-74ab374eedda\") "
Oct 31 00:03:41.507983 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.507806    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6ac65d9a-6c8f-43c9-aa20-caca662961f5-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ac65d9a-6c8f-43c9-aa20-caca662961f5-plugins-config-volume\") pod \"6ac65d9a-6c8f-43c9-aa20-caca662961f5\" (UID: \"6ac65d9a-6c8f-43c9-aa20-caca662961f5\") "
Oct 31 00:03:41.507983 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.507858    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6ac65d9a-6c8f-43c9-aa20-caca662961f5-kube-api-access-kddwp\" (UniqueName: \"kubernetes.io/projected/6ac65d9a-6c8f-43c9-aa20-caca662961f5-kube-api-access-kddwp\") pod \"6ac65d9a-6c8f-43c9-aa20-caca662961f5\" (UID: \"6ac65d9a-6c8f-43c9-aa20-caca662961f5\") "
Oct 31 00:03:41.508209 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.508182    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53df0b12-f9f8-496b-89b7-74ab374eedda-plugins-config-volume" pod "53df0b12-f9f8-496b-89b7-74ab374eedda" (UID: "53df0b12-f9f8-496b-89b7-74ab374eedda"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:03:41.508209 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.508189    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ac65d9a-6c8f-43c9-aa20-caca662961f5-plugins-config-volume" pod "6ac65d9a-6c8f-43c9-aa20-caca662961f5" (UID: "6ac65d9a-6c8f-43c9-aa20-caca662961f5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:03:41.508387 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.508186    4921 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-csr-dns-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:41.508387 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.508238    4921 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-cacerts\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:41.508387 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.508254    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zglr5\" (UniqueName: \"kubernetes.io/projected/ad2dd69d-1500-464c-9da4-92351faa35e7-kube-api-access-zglr5\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:41.508387 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.508263    4921 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad2dd69d-1500-464c-9da4-92351faa35e7-istio-kubeconfig\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:41.508387 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.508274    4921 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad2dd69d-1500-464c-9da4-92351faa35e7-local-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:41.510094 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.510068    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ac65d9a-6c8f-43c9-aa20-caca662961f5-kube-api-access-kddwp" pod "6ac65d9a-6c8f-43c9-aa20-caca662961f5" (UID: "6ac65d9a-6c8f-43c9-aa20-caca662961f5"). InnerVolumeSpecName "kube-api-access-kddwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:03:41.510210 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.510133    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53df0b12-f9f8-496b-89b7-74ab374eedda-kube-api-access-sslq4" pod "53df0b12-f9f8-496b-89b7-74ab374eedda" (UID: "53df0b12-f9f8-496b-89b7-74ab374eedda"). InnerVolumeSpecName "kube-api-access-sslq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:03:41.538947 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.538922    4921 patch_prober.go:29] interesting pod/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:03:41.539042 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.538966    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:03:41.609085 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.609054    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sslq4\" (UniqueName: \"kubernetes.io/projected/53df0b12-f9f8-496b-89b7-74ab374eedda-kube-api-access-sslq4\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:41.609085 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.609079    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53df0b12-f9f8-496b-89b7-74ab374eedda-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:41.609085 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.609090    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ac65d9a-6c8f-43c9-aa20-caca662961f5-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:41.609299 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.609099    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kddwp\" (UniqueName: \"kubernetes.io/projected/6ac65d9a-6c8f-43c9-aa20-caca662961f5-kube-api-access-kddwp\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:41.857550 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.857452    4921 generic.go:356] "Generic (PLEG): container finished" podID="6ac65d9a-6c8f-43c9-aa20-caca662961f5" containerID="5854633c74998edac768a608bb2c33ad52f5994a6b91a506bf6f0bad5a7d3435" exitCode=0
Oct 31 00:03:41.857550 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.857494    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b"
Oct 31 00:03:41.857550 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.857537    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b" event={"ID":"6ac65d9a-6c8f-43c9-aa20-caca662961f5","Type":"ContainerDied","Data":"5854633c74998edac768a608bb2c33ad52f5994a6b91a506bf6f0bad5a7d3435"}
Oct 31 00:03:41.857870 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.857608    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b" event={"ID":"6ac65d9a-6c8f-43c9-aa20-caca662961f5","Type":"ContainerDied","Data":"b139d3c0ddfa74c8b43f4382c92394bb130ad26b10a0b506bc729d73ba0e534b"}
Oct 31 00:03:41.857870 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.857641    4921 scope.go:122] "RemoveContainer" containerID="5854633c74998edac768a608bb2c33ad52f5994a6b91a506bf6f0bad5a7d3435"
Oct 31 00:03:41.858927 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.858904    4921 generic.go:356] "Generic (PLEG): container finished" podID="53df0b12-f9f8-496b-89b7-74ab374eedda" containerID="509ba8184b0939230ef9e85b7b815e99d88b9013c1fc5132b1d0037de99d15ef" exitCode=0
Oct 31 00:03:41.859061 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.858942    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7" event={"ID":"53df0b12-f9f8-496b-89b7-74ab374eedda","Type":"ContainerDied","Data":"509ba8184b0939230ef9e85b7b815e99d88b9013c1fc5132b1d0037de99d15ef"}
Oct 31 00:03:41.859061 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.858965    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7"
Oct 31 00:03:41.859061 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.858996    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7" event={"ID":"53df0b12-f9f8-496b-89b7-74ab374eedda","Type":"ContainerDied","Data":"541484f6341bd81f52a9d023766792c70b622617d8b1c0dbd045e6769bf51093"}
Oct 31 00:03:41.860514 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.860494    4921 generic.go:356] "Generic (PLEG): container finished" podID="ad2dd69d-1500-464c-9da4-92351faa35e7" containerID="fec8884d2fc86ad23d5bf2f161c9867cde1321bd7a9fcd6df32f4393b5fcca64" exitCode=0
Oct 31 00:03:41.860655 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.860544    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"
Oct 31 00:03:41.860655 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.860550    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k" event={"ID":"ad2dd69d-1500-464c-9da4-92351faa35e7","Type":"ContainerDied","Data":"fec8884d2fc86ad23d5bf2f161c9867cde1321bd7a9fcd6df32f4393b5fcca64"}
Oct 31 00:03:41.860655 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.860626    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k" event={"ID":"ad2dd69d-1500-464c-9da4-92351faa35e7","Type":"ContainerDied","Data":"dd4a08e7235d9db1f1b7c3e2c08a97c971bf3a7864a97f77e846a1c26f92cb3d"}
Oct 31 00:03:41.867777 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.867759    4921 scope.go:122] "RemoveContainer" containerID="5854633c74998edac768a608bb2c33ad52f5994a6b91a506bf6f0bad5a7d3435"
Oct 31 00:03:41.868098 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:03:41.868078    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5854633c74998edac768a608bb2c33ad52f5994a6b91a506bf6f0bad5a7d3435\": container with ID starting with 5854633c74998edac768a608bb2c33ad52f5994a6b91a506bf6f0bad5a7d3435 not found: ID does not exist" containerID="5854633c74998edac768a608bb2c33ad52f5994a6b91a506bf6f0bad5a7d3435"
Oct 31 00:03:41.868183 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.868110    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5854633c74998edac768a608bb2c33ad52f5994a6b91a506bf6f0bad5a7d3435"} err="failed to get container status \"5854633c74998edac768a608bb2c33ad52f5994a6b91a506bf6f0bad5a7d3435\": rpc error: code = NotFound desc = could not find container \"5854633c74998edac768a608bb2c33ad52f5994a6b91a506bf6f0bad5a7d3435\": container with ID starting with 5854633c74998edac768a608bb2c33ad52f5994a6b91a506bf6f0bad5a7d3435 not found: ID does not exist"
Oct 31 00:03:41.868183 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.868132    4921 scope.go:122] "RemoveContainer" containerID="509ba8184b0939230ef9e85b7b815e99d88b9013c1fc5132b1d0037de99d15ef"
Oct 31 00:03:41.878018 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.877998    4921 scope.go:122] "RemoveContainer" containerID="509ba8184b0939230ef9e85b7b815e99d88b9013c1fc5132b1d0037de99d15ef"
Oct 31 00:03:41.878337 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:03:41.878273    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"509ba8184b0939230ef9e85b7b815e99d88b9013c1fc5132b1d0037de99d15ef\": container with ID starting with 509ba8184b0939230ef9e85b7b815e99d88b9013c1fc5132b1d0037de99d15ef not found: ID does not exist" containerID="509ba8184b0939230ef9e85b7b815e99d88b9013c1fc5132b1d0037de99d15ef"
Oct 31 00:03:41.878337 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.878302    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"509ba8184b0939230ef9e85b7b815e99d88b9013c1fc5132b1d0037de99d15ef"} err="failed to get container status \"509ba8184b0939230ef9e85b7b815e99d88b9013c1fc5132b1d0037de99d15ef\": rpc error: code = NotFound desc = could not find container \"509ba8184b0939230ef9e85b7b815e99d88b9013c1fc5132b1d0037de99d15ef\": container with ID starting with 509ba8184b0939230ef9e85b7b815e99d88b9013c1fc5132b1d0037de99d15ef not found: ID does not exist"
Oct 31 00:03:41.878337 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.878317    4921 scope.go:122] "RemoveContainer" containerID="fec8884d2fc86ad23d5bf2f161c9867cde1321bd7a9fcd6df32f4393b5fcca64"
Oct 31 00:03:41.888097 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.888003    4921 scope.go:122] "RemoveContainer" containerID="fec8884d2fc86ad23d5bf2f161c9867cde1321bd7a9fcd6df32f4393b5fcca64"
Oct 31 00:03:41.888316 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:03:41.888296    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fec8884d2fc86ad23d5bf2f161c9867cde1321bd7a9fcd6df32f4393b5fcca64\": container with ID starting with fec8884d2fc86ad23d5bf2f161c9867cde1321bd7a9fcd6df32f4393b5fcca64 not found: ID does not exist" containerID="fec8884d2fc86ad23d5bf2f161c9867cde1321bd7a9fcd6df32f4393b5fcca64"
Oct 31 00:03:41.888385 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.888323    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fec8884d2fc86ad23d5bf2f161c9867cde1321bd7a9fcd6df32f4393b5fcca64"} err="failed to get container status \"fec8884d2fc86ad23d5bf2f161c9867cde1321bd7a9fcd6df32f4393b5fcca64\": rpc error: code = NotFound desc = could not find container \"fec8884d2fc86ad23d5bf2f161c9867cde1321bd7a9fcd6df32f4393b5fcca64\": container with ID starting with fec8884d2fc86ad23d5bf2f161c9867cde1321bd7a9fcd6df32f4393b5fcca64 not found: ID does not exist"
Oct 31 00:03:41.889059 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.889040    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"]
Oct 31 00:03:41.898412 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.898391    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6555k"]
Oct 31 00:03:41.930641 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.930618    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7"]
Oct 31 00:03:41.947769 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.947731    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d4db8f8cf-ngxnw"]
Oct 31 00:03:41.947986 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.947932    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw" podUID="a720b4f3-1ee9-4251-a83a-95f1357fe638" containerName="manager" containerID="cri-o://50df50e50916d0636df181a4d28151f8e461c932786e94656a6980ed07478c24" gracePeriod=30
Oct 31 00:03:41.949865 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.949842    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-dd3a15-7b7988d79f-st5g7"]
Oct 31 00:03:41.965911 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.965886    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b"]
Oct 31 00:03:41.970212 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:41.970185    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-dd3a15-6cbc458ccc-8qp5b"]
Oct 31 00:03:42.210529 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.210506    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw"
Oct 31 00:03:42.214500 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.214479    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a720b4f3-1ee9-4251-a83a-95f1357fe638-kube-api-access-x49cx\" (UniqueName: \"kubernetes.io/projected/a720b4f3-1ee9-4251-a83a-95f1357fe638-kube-api-access-x49cx\") pod \"a720b4f3-1ee9-4251-a83a-95f1357fe638\" (UID: \"a720b4f3-1ee9-4251-a83a-95f1357fe638\") "
Oct 31 00:03:42.214646 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.214620    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a720b4f3-1ee9-4251-a83a-95f1357fe638-webhook-cert\" (UniqueName: \"kubernetes.io/secret/a720b4f3-1ee9-4251-a83a-95f1357fe638-webhook-cert\") pod \"a720b4f3-1ee9-4251-a83a-95f1357fe638\" (UID: \"a720b4f3-1ee9-4251-a83a-95f1357fe638\") "
Oct 31 00:03:42.214710 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.214671    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a720b4f3-1ee9-4251-a83a-95f1357fe638-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a720b4f3-1ee9-4251-a83a-95f1357fe638-metrics-certs\") pod \"a720b4f3-1ee9-4251-a83a-95f1357fe638\" (UID: \"a720b4f3-1ee9-4251-a83a-95f1357fe638\") "
Oct 31 00:03:42.217090 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.216932    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a720b4f3-1ee9-4251-a83a-95f1357fe638-metrics-certs" pod "a720b4f3-1ee9-4251-a83a-95f1357fe638" (UID: "a720b4f3-1ee9-4251-a83a-95f1357fe638"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:03:42.217090 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.217023    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a720b4f3-1ee9-4251-a83a-95f1357fe638-kube-api-access-x49cx" pod "a720b4f3-1ee9-4251-a83a-95f1357fe638" (UID: "a720b4f3-1ee9-4251-a83a-95f1357fe638"). InnerVolumeSpecName "kube-api-access-x49cx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:03:42.217281 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.217201    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a720b4f3-1ee9-4251-a83a-95f1357fe638-webhook-cert" pod "a720b4f3-1ee9-4251-a83a-95f1357fe638" (UID: "a720b4f3-1ee9-4251-a83a-95f1357fe638"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:03:42.315833 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.315799    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a720b4f3-1ee9-4251-a83a-95f1357fe638-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:42.315833 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.315827    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x49cx\" (UniqueName: \"kubernetes.io/projected/a720b4f3-1ee9-4251-a83a-95f1357fe638-kube-api-access-x49cx\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:42.315833 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.315839    4921 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a720b4f3-1ee9-4251-a83a-95f1357fe638-webhook-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:42.866696 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.866657    4921 generic.go:356] "Generic (PLEG): container finished" podID="a720b4f3-1ee9-4251-a83a-95f1357fe638" containerID="50df50e50916d0636df181a4d28151f8e461c932786e94656a6980ed07478c24" exitCode=0
Oct 31 00:03:42.866883 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.866710    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw"
Oct 31 00:03:42.866883 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.866744    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw" event={"ID":"a720b4f3-1ee9-4251-a83a-95f1357fe638","Type":"ContainerDied","Data":"50df50e50916d0636df181a4d28151f8e461c932786e94656a6980ed07478c24"}
Oct 31 00:03:42.866883 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.866846    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4db8f8cf-ngxnw" event={"ID":"a720b4f3-1ee9-4251-a83a-95f1357fe638","Type":"ContainerDied","Data":"1a1f562d1b6db68e5f39f27e911529cbfad7d7becdfdd6eb46c1a7bb97bdaa45"}
Oct 31 00:03:42.867050 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.866882    4921 scope.go:122] "RemoveContainer" containerID="50df50e50916d0636df181a4d28151f8e461c932786e94656a6980ed07478c24"
Oct 31 00:03:42.877510 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.877492    4921 scope.go:122] "RemoveContainer" containerID="50df50e50916d0636df181a4d28151f8e461c932786e94656a6980ed07478c24"
Oct 31 00:03:42.877824 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:03:42.877804    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50df50e50916d0636df181a4d28151f8e461c932786e94656a6980ed07478c24\": container with ID starting with 50df50e50916d0636df181a4d28151f8e461c932786e94656a6980ed07478c24 not found: ID does not exist" containerID="50df50e50916d0636df181a4d28151f8e461c932786e94656a6980ed07478c24"
Oct 31 00:03:42.877912 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.877831    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50df50e50916d0636df181a4d28151f8e461c932786e94656a6980ed07478c24"} err="failed to get container status \"50df50e50916d0636df181a4d28151f8e461c932786e94656a6980ed07478c24\": rpc error: code = NotFound desc = could not find container \"50df50e50916d0636df181a4d28151f8e461c932786e94656a6980ed07478c24\": container with ID starting with 50df50e50916d0636df181a4d28151f8e461c932786e94656a6980ed07478c24 not found: ID does not exist"
Oct 31 00:03:42.881811 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.881791    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="53df0b12-f9f8-496b-89b7-74ab374eedda" path="/var/lib/kubelet/pods/53df0b12-f9f8-496b-89b7-74ab374eedda/volumes"
Oct 31 00:03:42.882174 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.882161    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6ac65d9a-6c8f-43c9-aa20-caca662961f5" path="/var/lib/kubelet/pods/6ac65d9a-6c8f-43c9-aa20-caca662961f5/volumes"
Oct 31 00:03:42.882553 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.882541    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ad2dd69d-1500-464c-9da4-92351faa35e7" path="/var/lib/kubelet/pods/ad2dd69d-1500-464c-9da4-92351faa35e7/volumes"
Oct 31 00:03:42.890698 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.890677    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d4db8f8cf-ngxnw"]
Oct 31 00:03:42.895437 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:42.895416    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7d4db8f8cf-ngxnw"]
Oct 31 00:03:43.596280 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.596227    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d4db8f8cf-tr6gw"]
Oct 31 00:03:43.596930 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.596907    4921 cpu_manager.go:414] "containerMap: removing container" podUID="484903ba-039f-440a-96d4-bbc02fc56f7f" containerName="cleanup"
Oct 31 00:03:43.597003 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.596933    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="484903ba-039f-440a-96d4-bbc02fc56f7f" containerName="cleanup"
Oct 31 00:03:43.597003 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.596948    4921 cpu_manager.go:414] "containerMap: removing container" podUID="62106426-3aa0-4918-b5db-ab1a0a70d1e5" containerName="istio-proxy"
Oct 31 00:03:43.597003 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.596956    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="62106426-3aa0-4918-b5db-ab1a0a70d1e5" containerName="istio-proxy"
Oct 31 00:03:43.597003 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.596969    4921 cpu_manager.go:414] "containerMap: removing container" podUID="1ef59b37-69e3-44db-b44a-474785053368" containerName="cleanup"
Oct 31 00:03:43.597003 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.596979    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ef59b37-69e3-44db-b44a-474785053368" containerName="cleanup"
Oct 31 00:03:43.597003 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.596988    4921 cpu_manager.go:414] "containerMap: removing container" podUID="441b53d1-a1f2-493b-a111-afff2d1aac61" containerName="istio-proxy"
Oct 31 00:03:43.597003 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.596996    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="441b53d1-a1f2-493b-a111-afff2d1aac61" containerName="istio-proxy"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597009    4921 cpu_manager.go:414] "containerMap: removing container" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597016    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597026    4921 cpu_manager.go:414] "containerMap: removing container" podUID="8adef569-361f-4e2b-82c2-43610bd3a7b8" containerName="istio-proxy"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597035    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8adef569-361f-4e2b-82c2-43610bd3a7b8" containerName="istio-proxy"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597050    4921 cpu_manager.go:414] "containerMap: removing container" podUID="8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" containerName="istio-proxy"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597057    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" containerName="istio-proxy"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597066    4921 cpu_manager.go:414] "containerMap: removing container" podUID="d32e7e03-43b2-463a-844f-b34c46203491" containerName="istio-proxy"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597073    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d32e7e03-43b2-463a-844f-b34c46203491" containerName="istio-proxy"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597087    4921 cpu_manager.go:414] "containerMap: removing container" podUID="7dc2062f-cb3b-4b8b-b38d-635eea0f547a" containerName="payload-processing"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597094    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7dc2062f-cb3b-4b8b-b38d-635eea0f547a" containerName="payload-processing"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597105    4921 cpu_manager.go:414] "containerMap: removing container" podUID="30e1183d-5ec4-44bc-a3ff-585db970d413" containerName="payload-processing"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597112    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="30e1183d-5ec4-44bc-a3ff-585db970d413" containerName="payload-processing"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597125    4921 cpu_manager.go:414] "containerMap: removing container" podUID="3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a" containerName="cleanup"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597132    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a" containerName="cleanup"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597143    4921 cpu_manager.go:414] "containerMap: removing container" podUID="6ac65d9a-6c8f-43c9-aa20-caca662961f5" containerName="payload-processing"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597150    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6ac65d9a-6c8f-43c9-aa20-caca662961f5" containerName="payload-processing"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597162    4921 cpu_manager.go:414] "containerMap: removing container" podUID="9927a847-b4b7-4c22-a3df-3ac672c98c80" containerName="istio-proxy"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597169    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9927a847-b4b7-4c22-a3df-3ac672c98c80" containerName="istio-proxy"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597183    4921 cpu_manager.go:414] "containerMap: removing container" podUID="a720b4f3-1ee9-4251-a83a-95f1357fe638" containerName="manager"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597190    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a720b4f3-1ee9-4251-a83a-95f1357fe638" containerName="manager"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597200    4921 cpu_manager.go:414] "containerMap: removing container" podUID="22dee8ec-69c0-4889-adb1-8ecde0d7b66a" containerName="istio-proxy"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597206    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="22dee8ec-69c0-4889-adb1-8ecde0d7b66a" containerName="istio-proxy"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597221    4921 cpu_manager.go:414] "containerMap: removing container" podUID="95ef5560-869d-42e3-80d5-090a164ad8e0" containerName="maas-api"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597229    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="95ef5560-869d-42e3-80d5-090a164ad8e0" containerName="maas-api"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597240    4921 cpu_manager.go:414] "containerMap: removing container" podUID="62106426-3aa0-4918-b5db-ab1a0a70d1e5" containerName="istio-proxy"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597247    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="62106426-3aa0-4918-b5db-ab1a0a70d1e5" containerName="istio-proxy"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597264    4921 cpu_manager.go:414] "containerMap: removing container" podUID="5e2b3853-7e76-44f3-9536-02f877d8f6b6" containerName="revoke-keys"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597271    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5e2b3853-7e76-44f3-9536-02f877d8f6b6" containerName="revoke-keys"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597282    4921 cpu_manager.go:414] "containerMap: removing container" podUID="441b53d1-a1f2-493b-a111-afff2d1aac61" containerName="istio-proxy"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597288    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="441b53d1-a1f2-493b-a111-afff2d1aac61" containerName="istio-proxy"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597300    4921 cpu_manager.go:414] "containerMap: removing container" podUID="53df0b12-f9f8-496b-89b7-74ab374eedda" containerName="payload-pre-processing"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597307    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="53df0b12-f9f8-496b-89b7-74ab374eedda" containerName="payload-pre-processing"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597316    4921 cpu_manager.go:414] "containerMap: removing container" podUID="55ce736b-a050-4941-a887-7d9a6229427f" containerName="payload-pre-processing"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597324    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="55ce736b-a050-4941-a887-7d9a6229427f" containerName="payload-pre-processing"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597336    4921 cpu_manager.go:414] "containerMap: removing container" podUID="efb5db91-83e2-4884-bd0d-6a7d10787929" containerName="maas-api"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597343    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="efb5db91-83e2-4884-bd0d-6a7d10787929" containerName="maas-api"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597357    4921 cpu_manager.go:414] "containerMap: removing container" podUID="ce487838-fd5e-45c8-9cb9-b29e538ef744" containerName="maas-api"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597364    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce487838-fd5e-45c8-9cb9-b29e538ef744" containerName="maas-api"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597376    4921 cpu_manager.go:414] "containerMap: removing container" podUID="b14e7bdd-df95-4c34-958c-3b023b9596fa" containerName="istio-proxy"
Oct 31 00:03:43.597363 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597383    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b14e7bdd-df95-4c34-958c-3b023b9596fa" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597392    4921 cpu_manager.go:414] "containerMap: removing container" podUID="1ef59b37-69e3-44db-b44a-474785053368" containerName="cleanup"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597399    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ef59b37-69e3-44db-b44a-474785053368" containerName="cleanup"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597409    4921 cpu_manager.go:414] "containerMap: removing container" podUID="4f146534-bcab-407d-ad28-d9528ca641c3" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597416    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f146534-bcab-407d-ad28-d9528ca641c3" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597430    4921 cpu_manager.go:414] "containerMap: removing container" podUID="e0f8155c-e961-4fec-9802-20e2ac4a0428" containerName="payload-processing"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597437    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e0f8155c-e961-4fec-9802-20e2ac4a0428" containerName="payload-processing"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597447    4921 cpu_manager.go:414] "containerMap: removing container" podUID="56c37261-af56-45b1-8dcf-60c89754d2f7" containerName="payload-pre-processing"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597454    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="56c37261-af56-45b1-8dcf-60c89754d2f7" containerName="payload-pre-processing"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597467    4921 cpu_manager.go:414] "containerMap: removing container" podUID="8069d118-e6cb-420b-9502-85918a0169ef" containerName="maas-api"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597473    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8069d118-e6cb-420b-9502-85918a0169ef" containerName="maas-api"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597483    4921 cpu_manager.go:414] "containerMap: removing container" podUID="ac24a789-f285-4a46-8121-579b4b3bd264" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597490    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ac24a789-f285-4a46-8121-579b4b3bd264" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597503    4921 cpu_manager.go:414] "containerMap: removing container" podUID="b14e7bdd-df95-4c34-958c-3b023b9596fa" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597511    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b14e7bdd-df95-4c34-958c-3b023b9596fa" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597519    4921 cpu_manager.go:414] "containerMap: removing container" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597526    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597535    4921 cpu_manager.go:414] "containerMap: removing container" podUID="c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597543    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597556    4921 cpu_manager.go:414] "containerMap: removing container" podUID="ad2dd69d-1500-464c-9da4-92351faa35e7" containerName="discovery"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597563    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad2dd69d-1500-464c-9da4-92351faa35e7" containerName="discovery"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597575    4921 cpu_manager.go:414] "containerMap: removing container" podUID="4993a595-ab1b-49b4-bb75-3efa3f127527" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597582    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4993a595-ab1b-49b4-bb75-3efa3f127527" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597612    4921 cpu_manager.go:414] "containerMap: removing container" podUID="c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597619    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597630    4921 cpu_manager.go:414] "containerMap: removing container" podUID="a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90" containerName="payload-pre-processing"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597637    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90" containerName="payload-pre-processing"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597650    4921 cpu_manager.go:414] "containerMap: removing container" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597657    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597667    4921 cpu_manager.go:414] "containerMap: removing container" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597676    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597686    4921 cpu_manager.go:414] "containerMap: removing container" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597693    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597711    4921 cpu_manager.go:414] "containerMap: removing container" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597718    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597732    4921 cpu_manager.go:414] "containerMap: removing container" podUID="3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a" containerName="cleanup"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597739    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a" containerName="cleanup"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597752    4921 cpu_manager.go:414] "containerMap: removing container" podUID="e977815f-d174-41e5-9485-2281325ca37c" containerName="payload-pre-processing"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597759    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e977815f-d174-41e5-9485-2281325ca37c" containerName="payload-pre-processing"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597870    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="22dee8ec-69c0-4889-adb1-8ecde0d7b66a" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597884    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a" containerName="cleanup"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597895    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="e977815f-d174-41e5-9485-2281325ca37c" containerName="payload-pre-processing"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597906    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="484903ba-039f-440a-96d4-bbc02fc56f7f" containerName="cleanup"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597915    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="62106426-3aa0-4918-b5db-ab1a0a70d1e5" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597924    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ef59b37-69e3-44db-b44a-474785053368" containerName="cleanup"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597933    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="441b53d1-a1f2-493b-a111-afff2d1aac61" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597944    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="43c0107d-53f5-4fa8-809b-5ecab19c6e58" containerName="main"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597953    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="8adef569-361f-4e2b-82c2-43610bd3a7b8" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597962    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a466c39-73fa-48a5-a599-1bdfcd5f5eb7" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597971    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="d32e7e03-43b2-463a-844f-b34c46203491" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597980    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="7dc2062f-cb3b-4b8b-b38d-635eea0f547a" containerName="payload-processing"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597990    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="30e1183d-5ec4-44bc-a3ff-585db970d413" containerName="payload-processing"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.597998    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a" containerName="cleanup"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598009    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="6ac65d9a-6c8f-43c9-aa20-caca662961f5" containerName="payload-processing"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598019    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="9927a847-b4b7-4c22-a3df-3ac672c98c80" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598027    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="a720b4f3-1ee9-4251-a83a-95f1357fe638" containerName="manager"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598037    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="22dee8ec-69c0-4889-adb1-8ecde0d7b66a" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598048    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="95ef5560-869d-42e3-80d5-090a164ad8e0" containerName="maas-api"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598057    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="62106426-3aa0-4918-b5db-ab1a0a70d1e5" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598067    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="5e2b3853-7e76-44f3-9536-02f877d8f6b6" containerName="revoke-keys"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598075    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="53df0b12-f9f8-496b-89b7-74ab374eedda" containerName="payload-pre-processing"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598085    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a" containerName="cleanup"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598092    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="55ce736b-a050-4941-a887-7d9a6229427f" containerName="payload-pre-processing"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598100    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="efb5db91-83e2-4884-bd0d-6a7d10787929" containerName="maas-api"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598109    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce487838-fd5e-45c8-9cb9-b29e538ef744" containerName="maas-api"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598119    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="b14e7bdd-df95-4c34-958c-3b023b9596fa" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598128    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f146534-bcab-407d-ad28-d9528ca641c3" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598136    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="e0f8155c-e961-4fec-9802-20e2ac4a0428" containerName="payload-processing"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598145    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="56c37261-af56-45b1-8dcf-60c89754d2f7" containerName="payload-pre-processing"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598155    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="8069d118-e6cb-420b-9502-85918a0169ef" containerName="maas-api"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598166    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="ac24a789-f285-4a46-8121-579b4b3bd264" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598174    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ef59b37-69e3-44db-b44a-474785053368" containerName="cleanup"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598181    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="b14e7bdd-df95-4c34-958c-3b023b9596fa" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598190    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="ac24a789-f285-4a46-8121-579b4b3bd264" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598200    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d920e12-0adb-4c9b-9e43-0c22f9b9f5f2" containerName="main"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598208    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598218    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad2dd69d-1500-464c-9da4-92351faa35e7" containerName="discovery"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598227    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="4993a595-ab1b-49b4-bb75-3efa3f127527" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598236    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="c52bd2b2-c6ff-4c45-aa3e-3d44586b5970" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598244    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="a98e6303-d1d9-47aa-8d6e-a99d7d6c2c90" containerName="payload-pre-processing"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598253    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="288e6fd4-35b6-4452-8069-0f22ad2c094b" containerName="main"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598262    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="bf081868-d868-477d-90d4-c7c8f9fb2c5e" containerName="main"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598271    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="f0f53351-2b81-489a-a08e-dd0d49682556" containerName="main"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598281    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="9927a847-b4b7-4c22-a3df-3ac672c98c80" containerName="istio-proxy"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598291    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf03d62a-8708-41ed-9013-90e30a26cd9a" containerName="main"
Oct 31 00:03:43.599019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.598304    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="4993a595-ab1b-49b4-bb75-3efa3f127527" containerName="istio-proxy"
Oct 31 00:03:43.603749 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.603719    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw"
Oct 31 00:03:43.611620 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.611181    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d4db8f8cf-tr6gw"]
Oct 31 00:03:43.611742 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.611626    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 31 00:03:43.611742 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.611738    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c7j2t\""
Oct 31 00:03:43.612622 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.612429    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 31 00:03:43.612622 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.612535    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 31 00:03:43.626970 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.626941    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fec54092-2a3f-4e67-a4ab-fe817098296f-metrics-certs\") pod \"maas-controller-7d4db8f8cf-tr6gw\" (UID: \"fec54092-2a3f-4e67-a4ab-fe817098296f\") " pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw"
Oct 31 00:03:43.627100 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.627019    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkm2s\" (UniqueName: \"kubernetes.io/projected/fec54092-2a3f-4e67-a4ab-fe817098296f-kube-api-access-lkm2s\") pod \"maas-controller-7d4db8f8cf-tr6gw\" (UID: \"fec54092-2a3f-4e67-a4ab-fe817098296f\") " pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw"
Oct 31 00:03:43.627100 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.627073    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fec54092-2a3f-4e67-a4ab-fe817098296f-webhook-cert\") pod \"maas-controller-7d4db8f8cf-tr6gw\" (UID: \"fec54092-2a3f-4e67-a4ab-fe817098296f\") " pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw"
Oct 31 00:03:43.728032 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.727992    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkm2s\" (UniqueName: \"kubernetes.io/projected/fec54092-2a3f-4e67-a4ab-fe817098296f-kube-api-access-lkm2s\") pod \"maas-controller-7d4db8f8cf-tr6gw\" (UID: \"fec54092-2a3f-4e67-a4ab-fe817098296f\") " pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw"
Oct 31 00:03:43.728268 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.728065    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fec54092-2a3f-4e67-a4ab-fe817098296f-webhook-cert\") pod \"maas-controller-7d4db8f8cf-tr6gw\" (UID: \"fec54092-2a3f-4e67-a4ab-fe817098296f\") " pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw"
Oct 31 00:03:43.728268 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.728167    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fec54092-2a3f-4e67-a4ab-fe817098296f-metrics-certs\") pod \"maas-controller-7d4db8f8cf-tr6gw\" (UID: \"fec54092-2a3f-4e67-a4ab-fe817098296f\") " pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw"
Oct 31 00:03:43.731615 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.731558    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fec54092-2a3f-4e67-a4ab-fe817098296f-webhook-cert\") pod \"maas-controller-7d4db8f8cf-tr6gw\" (UID: \"fec54092-2a3f-4e67-a4ab-fe817098296f\") " pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw"
Oct 31 00:03:43.731725 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.731631    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fec54092-2a3f-4e67-a4ab-fe817098296f-metrics-certs\") pod \"maas-controller-7d4db8f8cf-tr6gw\" (UID: \"fec54092-2a3f-4e67-a4ab-fe817098296f\") " pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw"
Oct 31 00:03:43.740817 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.740791    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkm2s\" (UniqueName: \"kubernetes.io/projected/fec54092-2a3f-4e67-a4ab-fe817098296f-kube-api-access-lkm2s\") pod \"maas-controller-7d4db8f8cf-tr6gw\" (UID: \"fec54092-2a3f-4e67-a4ab-fe817098296f\") " pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw"
Oct 31 00:03:43.926306 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:43.926214    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw"
Oct 31 00:03:44.320132 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:44.309563    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d4db8f8cf-tr6gw"]
Oct 31 00:03:44.355684 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:44.352856    4921 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:03:44.875198 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:44.874849    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 31 00:03:44.961671 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:44.953476    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a720b4f3-1ee9-4251-a83a-95f1357fe638" path="/var/lib/kubelet/pods/a720b4f3-1ee9-4251-a83a-95f1357fe638/volumes"
Oct 31 00:03:44.961671 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:44.961468    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-token\" (UniqueName: \"kubernetes.io/projected/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-token\") pod \"da75f51e-ddb3-40a1-b475-b252bc8954d0\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") "
Oct 31 00:03:44.961671 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:44.961518    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-podinfo\") pod \"da75f51e-ddb3-40a1-b475-b252bc8954d0\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") "
Oct 31 00:03:44.961671 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:44.961549    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-workload-certs\") pod \"da75f51e-ddb3-40a1-b475-b252bc8954d0\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") "
Oct 31 00:03:44.963420 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:44.961585    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-data\") pod \"da75f51e-ddb3-40a1-b475-b252bc8954d0\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") "
Oct 31 00:03:44.963557 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:44.963454    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-workload-socket\") pod \"da75f51e-ddb3-40a1-b475-b252bc8954d0\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") "
Oct 31 00:03:44.963557 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:44.963507    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-envoy\") pod \"da75f51e-ddb3-40a1-b475-b252bc8954d0\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") "
Oct 31 00:03:44.963557 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:44.963545    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/da75f51e-ddb3-40a1-b475-b252bc8954d0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da75f51e-ddb3-40a1-b475-b252bc8954d0-istiod-ca-cert\") pod \"da75f51e-ddb3-40a1-b475-b252bc8954d0\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") "
Oct 31 00:03:44.963801 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:44.963664    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-credential-socket\") pod \"da75f51e-ddb3-40a1-b475-b252bc8954d0\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") "
Oct 31 00:03:44.963801 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:44.963716    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/da75f51e-ddb3-40a1-b475-b252bc8954d0-kube-api-access-tnxq5\" (UniqueName: \"kubernetes.io/projected/da75f51e-ddb3-40a1-b475-b252bc8954d0-kube-api-access-tnxq5\") pod \"da75f51e-ddb3-40a1-b475-b252bc8954d0\" (UID: \"da75f51e-ddb3-40a1-b475-b252bc8954d0\") "
Oct 31 00:03:44.964653 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:44.964621    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-workload-socket" pod "da75f51e-ddb3-40a1-b475-b252bc8954d0" (UID: "da75f51e-ddb3-40a1-b475-b252bc8954d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:44.964878 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:44.964850    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-credential-socket" pod "da75f51e-ddb3-40a1-b475-b252bc8954d0" (UID: "da75f51e-ddb3-40a1-b475-b252bc8954d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:44.964952 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:44.964859    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-workload-certs" pod "da75f51e-ddb3-40a1-b475-b252bc8954d0" (UID: "da75f51e-ddb3-40a1-b475-b252bc8954d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:44.965029 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:44.965017    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-data" pod "da75f51e-ddb3-40a1-b475-b252bc8954d0" (UID: "da75f51e-ddb3-40a1-b475-b252bc8954d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:44.965548 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:44.965362    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da75f51e-ddb3-40a1-b475-b252bc8954d0-istiod-ca-cert" pod "da75f51e-ddb3-40a1-b475-b252bc8954d0" (UID: "da75f51e-ddb3-40a1-b475-b252bc8954d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:03:45.053452 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.052524    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-podinfo" pod "da75f51e-ddb3-40a1-b475-b252bc8954d0" (UID: "da75f51e-ddb3-40a1-b475-b252bc8954d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:03:45.053452 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.052680    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da75f51e-ddb3-40a1-b475-b252bc8954d0-kube-api-access-tnxq5" pod "da75f51e-ddb3-40a1-b475-b252bc8954d0" (UID: "da75f51e-ddb3-40a1-b475-b252bc8954d0"). InnerVolumeSpecName "kube-api-access-tnxq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:03:45.057126 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.054032    4921 generic.go:356] "Generic (PLEG): container finished" podID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerID="d9c8aa0022d72197aad63463916597ee008b09356df35404a621ee6d4067e7eb" exitCode=0
Oct 31 00:03:45.057126 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.054136    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" event={"ID":"cf6206f1-d136-4625-bf0a-bb3482bd7839","Type":"ContainerDied","Data":"d9c8aa0022d72197aad63463916597ee008b09356df35404a621ee6d4067e7eb"}
Oct 31 00:03:45.057126 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.055027    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-token" pod "da75f51e-ddb3-40a1-b475-b252bc8954d0" (UID: "da75f51e-ddb3-40a1-b475-b252bc8954d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:03:45.058666 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.057832    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-envoy" pod "da75f51e-ddb3-40a1-b475-b252bc8954d0" (UID: "da75f51e-ddb3-40a1-b475-b252bc8954d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:45.060513 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.060455    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw" event={"ID":"fec54092-2a3f-4e67-a4ab-fe817098296f","Type":"ContainerStarted","Data":"05dbd56cb4b4d58a320b964170d3c68d411ad87c6fa0038536e362ad7b2502e4"}
Oct 31 00:03:45.062124 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.062104    4921 generic.go:356] "Generic (PLEG): container finished" podID="da75f51e-ddb3-40a1-b475-b252bc8954d0" containerID="60703ce96b2004c0bb39637852042a7132bdd7632988b621e8ed1a4d737e1658" exitCode=0
Oct 31 00:03:45.062227 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.062148    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg" event={"ID":"da75f51e-ddb3-40a1-b475-b252bc8954d0","Type":"ContainerDied","Data":"60703ce96b2004c0bb39637852042a7132bdd7632988b621e8ed1a4d737e1658"}
Oct 31 00:03:45.062227 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.062187    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg" event={"ID":"da75f51e-ddb3-40a1-b475-b252bc8954d0","Type":"ContainerDied","Data":"05e146197064b0842d2b4cec6b46d69536f4f5d28ba1dfbdc812adb4cb6ea096"}
Oct 31 00:03:45.062227 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.062216    4921 scope.go:122] "RemoveContainer" containerID="60703ce96b2004c0bb39637852042a7132bdd7632988b621e8ed1a4d737e1658"
Oct 31 00:03:45.062407 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.062330    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"
Oct 31 00:03:45.065271 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.065136    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da75f51e-ddb3-40a1-b475-b252bc8954d0-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:45.065271 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.065168    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:45.065271 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.065177    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnxq5\" (UniqueName: \"kubernetes.io/projected/da75f51e-ddb3-40a1-b475-b252bc8954d0-kube-api-access-tnxq5\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:45.065271 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.065193    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:45.065271 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.065203    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:45.065271 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.065211    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:45.065271 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.065219    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:45.065271 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.065239    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:45.065271 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.065247    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da75f51e-ddb3-40a1-b475-b252bc8954d0-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:45.082719 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.082465    4921 scope.go:122] "RemoveContainer" containerID="60703ce96b2004c0bb39637852042a7132bdd7632988b621e8ed1a4d737e1658"
Oct 31 00:03:45.083042 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:03:45.082951    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60703ce96b2004c0bb39637852042a7132bdd7632988b621e8ed1a4d737e1658\": container with ID starting with 60703ce96b2004c0bb39637852042a7132bdd7632988b621e8ed1a4d737e1658 not found: ID does not exist" containerID="60703ce96b2004c0bb39637852042a7132bdd7632988b621e8ed1a4d737e1658"
Oct 31 00:03:45.083042 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.082989    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60703ce96b2004c0bb39637852042a7132bdd7632988b621e8ed1a4d737e1658"} err="failed to get container status \"60703ce96b2004c0bb39637852042a7132bdd7632988b621e8ed1a4d737e1658\": rpc error: code = NotFound desc = could not find container \"60703ce96b2004c0bb39637852042a7132bdd7632988b621e8ed1a4d737e1658\": container with ID starting with 60703ce96b2004c0bb39637852042a7132bdd7632988b621e8ed1a4d737e1658 not found: ID does not exist"
Oct 31 00:03:45.091505 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.091206    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 31 00:03:45.161862 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.160955    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"]
Oct 31 00:03:45.163115 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.163087    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-jxqwg"]
Oct 31 00:03:45.165864 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.165845    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-credential-socket\") pod \"cf6206f1-d136-4625-bf0a-bb3482bd7839\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") "
Oct 31 00:03:45.165948 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.165932    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-envoy\") pod \"cf6206f1-d136-4625-bf0a-bb3482bd7839\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") "
Oct 31 00:03:45.165999 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.165972    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cf6206f1-d136-4625-bf0a-bb3482bd7839-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf6206f1-d136-4625-bf0a-bb3482bd7839-istiod-ca-cert\") pod \"cf6206f1-d136-4625-bf0a-bb3482bd7839\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") "
Oct 31 00:03:45.166042 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.166014    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-podinfo\") pod \"cf6206f1-d136-4625-bf0a-bb3482bd7839\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") "
Oct 31 00:03:45.166081 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.166053    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-data\") pod \"cf6206f1-d136-4625-bf0a-bb3482bd7839\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") "
Oct 31 00:03:45.166121 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.166085    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-token\" (UniqueName: \"kubernetes.io/projected/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-token\") pod \"cf6206f1-d136-4625-bf0a-bb3482bd7839\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") "
Oct 31 00:03:45.166160 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.166117    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-workload-certs\") pod \"cf6206f1-d136-4625-bf0a-bb3482bd7839\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") "
Oct 31 00:03:45.166160 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.166139    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-credential-socket" pod "cf6206f1-d136-4625-bf0a-bb3482bd7839" (UID: "cf6206f1-d136-4625-bf0a-bb3482bd7839"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:45.166160 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.166142    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-workload-socket\") pod \"cf6206f1-d136-4625-bf0a-bb3482bd7839\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") "
Oct 31 00:03:45.166277 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.166200    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf6206f1-d136-4625-bf0a-bb3482bd7839-kube-api-access-tqmpb\" (UniqueName: \"kubernetes.io/projected/cf6206f1-d136-4625-bf0a-bb3482bd7839-kube-api-access-tqmpb\") pod \"cf6206f1-d136-4625-bf0a-bb3482bd7839\" (UID: \"cf6206f1-d136-4625-bf0a-bb3482bd7839\") "
Oct 31 00:03:45.166351 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.166333    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-workload-socket" pod "cf6206f1-d136-4625-bf0a-bb3482bd7839" (UID: "cf6206f1-d136-4625-bf0a-bb3482bd7839"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:45.166410 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.166386    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf6206f1-d136-4625-bf0a-bb3482bd7839-istiod-ca-cert" pod "cf6206f1-d136-4625-bf0a-bb3482bd7839" (UID: "cf6206f1-d136-4625-bf0a-bb3482bd7839"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:03:45.166488 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.166470    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-data" pod "cf6206f1-d136-4625-bf0a-bb3482bd7839" (UID: "cf6206f1-d136-4625-bf0a-bb3482bd7839"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:45.207623 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.166648    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:45.207623 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.166674    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:45.207623 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.166690    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf6206f1-d136-4625-bf0a-bb3482bd7839-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:45.207623 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.166705    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:45.207623 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.181672    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-workload-certs" pod "cf6206f1-d136-4625-bf0a-bb3482bd7839" (UID: "cf6206f1-d136-4625-bf0a-bb3482bd7839"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:45.221940 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.221860    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-podinfo" pod "cf6206f1-d136-4625-bf0a-bb3482bd7839" (UID: "cf6206f1-d136-4625-bf0a-bb3482bd7839"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:03:45.222752 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.222727    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-envoy" pod "cf6206f1-d136-4625-bf0a-bb3482bd7839" (UID: "cf6206f1-d136-4625-bf0a-bb3482bd7839"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:03:45.223041 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.223018    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-token" pod "cf6206f1-d136-4625-bf0a-bb3482bd7839" (UID: "cf6206f1-d136-4625-bf0a-bb3482bd7839"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:03:45.226739 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.226703    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf6206f1-d136-4625-bf0a-bb3482bd7839-kube-api-access-tqmpb" pod "cf6206f1-d136-4625-bf0a-bb3482bd7839" (UID: "cf6206f1-d136-4625-bf0a-bb3482bd7839"). InnerVolumeSpecName "kube-api-access-tqmpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:03:45.273678 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.267750    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:45.273678 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.267783    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:45.273678 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.267799    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:45.273678 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.267813    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqmpb\" (UniqueName: \"kubernetes.io/projected/cf6206f1-d136-4625-bf0a-bb3482bd7839-kube-api-access-tqmpb\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:45.273678 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:45.267828    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf6206f1-d136-4625-bf0a-bb3482bd7839-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:03:46.068274 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:46.068239    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"
Oct 31 00:03:46.068274 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:46.068258    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7" event={"ID":"cf6206f1-d136-4625-bf0a-bb3482bd7839","Type":"ContainerDied","Data":"cb43b909113a37df5eb1d446eeedb8800ab28b65eb338d8c27428b75e7f9e310"}
Oct 31 00:03:46.068846 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:46.068332    4921 scope.go:122] "RemoveContainer" containerID="d9c8aa0022d72197aad63463916597ee008b09356df35404a621ee6d4067e7eb"
Oct 31 00:03:46.070530 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:46.070499    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw" event={"ID":"fec54092-2a3f-4e67-a4ab-fe817098296f","Type":"ContainerStarted","Data":"f2379e33ddee8e88601f54f71e38878db794f28879bb1106dc6cab36e2a3b68c"}
Oct 31 00:03:46.070685 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:46.070570    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw"
Oct 31 00:03:46.094552 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:46.094508    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw" podStartSLOduration=2.2865666669999998 podStartE2EDuration="3.09449688s" totalImagesPullingTime="807.930213ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:03:46.092845803 +0000 UTC m=+2685.337701571" watchObservedRunningTime="2026-10-31 00:03:46.09449688 +0000 UTC m=+2685.339352648"
Oct 31 00:03:46.108080 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:46.108053    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"]
Oct 31 00:03:46.112127 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:46.112101    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-dd3a15-openshift-default-88dc7c85f-bcxk7"]
Oct 31 00:03:46.881509 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:46.881477    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" path="/var/lib/kubelet/pods/cf6206f1-d136-4625-bf0a-bb3482bd7839/volumes"
Oct 31 00:03:46.881962 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:46.881946    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="da75f51e-ddb3-40a1-b475-b252bc8954d0" path="/var/lib/kubelet/pods/da75f51e-ddb3-40a1-b475-b252bc8954d0/volumes"
Oct 31 00:03:48.091011 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:48.090976    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:48.218096 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:48.218064    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:49.280114 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:49.280080    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:54.852557 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:54.852498    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:54.984332 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:54.984281    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:55.116455 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:55.116345    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:03:57.079840 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:03:57.079812    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw"
Oct 31 00:04:02.271978 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:02.271946    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 31 00:04:02.282856 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:02.282834    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 31 00:04:11.092709 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.092673    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"]
Oct 31 00:04:11.093349 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093329    4921 cpu_manager.go:414] "containerMap: removing container" podUID="484903ba-039f-440a-96d4-bbc02fc56f7f" containerName="cleanup"
Oct 31 00:04:11.093398 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093352    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="484903ba-039f-440a-96d4-bbc02fc56f7f" containerName="cleanup"
Oct 31 00:04:11.093398 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093373    4921 cpu_manager.go:414] "containerMap: removing container" podUID="3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a" containerName="cleanup"
Oct 31 00:04:11.093398 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093382    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b40ccb0-fde6-4c47-b2e7-89f0aa28ea8a" containerName="cleanup"
Oct 31 00:04:11.093398 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093394    4921 cpu_manager.go:414] "containerMap: removing container" podUID="9927a847-b4b7-4c22-a3df-3ac672c98c80" containerName="istio-proxy"
Oct 31 00:04:11.093525 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093402    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9927a847-b4b7-4c22-a3df-3ac672c98c80" containerName="istio-proxy"
Oct 31 00:04:11.093525 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093420    4921 cpu_manager.go:414] "containerMap: removing container" podUID="22dee8ec-69c0-4889-adb1-8ecde0d7b66a" containerName="istio-proxy"
Oct 31 00:04:11.093525 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093428    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="22dee8ec-69c0-4889-adb1-8ecde0d7b66a" containerName="istio-proxy"
Oct 31 00:04:11.093525 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093455    4921 cpu_manager.go:414] "containerMap: removing container" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerName="istio-proxy"
Oct 31 00:04:11.093525 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093462    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerName="istio-proxy"
Oct 31 00:04:11.093525 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093474    4921 cpu_manager.go:414] "containerMap: removing container" podUID="1ef59b37-69e3-44db-b44a-474785053368" containerName="cleanup"
Oct 31 00:04:11.093525 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093482    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ef59b37-69e3-44db-b44a-474785053368" containerName="cleanup"
Oct 31 00:04:11.093525 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093490    4921 cpu_manager.go:414] "containerMap: removing container" podUID="4f146534-bcab-407d-ad28-d9528ca641c3" containerName="istio-proxy"
Oct 31 00:04:11.093525 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093498    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f146534-bcab-407d-ad28-d9528ca641c3" containerName="istio-proxy"
Oct 31 00:04:11.093525 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093514    4921 cpu_manager.go:414] "containerMap: removing container" podUID="ac24a789-f285-4a46-8121-579b4b3bd264" containerName="istio-proxy"
Oct 31 00:04:11.093525 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093521    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ac24a789-f285-4a46-8121-579b4b3bd264" containerName="istio-proxy"
Oct 31 00:04:11.093912 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093536    4921 cpu_manager.go:414] "containerMap: removing container" podUID="da75f51e-ddb3-40a1-b475-b252bc8954d0" containerName="istio-proxy"
Oct 31 00:04:11.093912 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093543    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="da75f51e-ddb3-40a1-b475-b252bc8954d0" containerName="istio-proxy"
Oct 31 00:04:11.093912 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093553    4921 cpu_manager.go:414] "containerMap: removing container" podUID="4993a595-ab1b-49b4-bb75-3efa3f127527" containerName="istio-proxy"
Oct 31 00:04:11.093912 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093560    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4993a595-ab1b-49b4-bb75-3efa3f127527" containerName="istio-proxy"
Oct 31 00:04:11.093912 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093686    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf6206f1-d136-4625-bf0a-bb3482bd7839" containerName="istio-proxy"
Oct 31 00:04:11.093912 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093699    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f146534-bcab-407d-ad28-d9528ca641c3" containerName="istio-proxy"
Oct 31 00:04:11.093912 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093712    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ef59b37-69e3-44db-b44a-474785053368" containerName="cleanup"
Oct 31 00:04:11.093912 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093722    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="da75f51e-ddb3-40a1-b475-b252bc8954d0" containerName="istio-proxy"
Oct 31 00:04:11.093912 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093734    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="484903ba-039f-440a-96d4-bbc02fc56f7f" containerName="cleanup"
Oct 31 00:04:11.093912 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.093743    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="441b53d1-a1f2-493b-a111-afff2d1aac61" containerName="istio-proxy"
Oct 31 00:04:11.097319 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.097300    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.145820 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.145787    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"]
Oct 31 00:04:11.218986 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.218955    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2811edb-f9ac-4178-b2d0-a7569051a989-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.218986 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.218992    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2811edb-f9ac-4178-b2d0-a7569051a989-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.219213 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.219081    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6mj5\" (UniqueName: \"kubernetes.io/projected/a2811edb-f9ac-4178-b2d0-a7569051a989-kube-api-access-z6mj5\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.219213 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.219100    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2811edb-f9ac-4178-b2d0-a7569051a989-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.219213 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.219174    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2811edb-f9ac-4178-b2d0-a7569051a989-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.219320 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.219297    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2811edb-f9ac-4178-b2d0-a7569051a989-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.219359 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.219332    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2811edb-f9ac-4178-b2d0-a7569051a989-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.219443 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.219424    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2811edb-f9ac-4178-b2d0-a7569051a989-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.219485 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.219455    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2811edb-f9ac-4178-b2d0-a7569051a989-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.320230 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.320194    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2811edb-f9ac-4178-b2d0-a7569051a989-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.320230 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.320234    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2811edb-f9ac-4178-b2d0-a7569051a989-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.320489 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.320255    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2811edb-f9ac-4178-b2d0-a7569051a989-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.320489 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.320272    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2811edb-f9ac-4178-b2d0-a7569051a989-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.320489 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.320313    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2811edb-f9ac-4178-b2d0-a7569051a989-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.320489 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.320341    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2811edb-f9ac-4178-b2d0-a7569051a989-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.320489 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.320432    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6mj5\" (UniqueName: \"kubernetes.io/projected/a2811edb-f9ac-4178-b2d0-a7569051a989-kube-api-access-z6mj5\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.320489 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.320458    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2811edb-f9ac-4178-b2d0-a7569051a989-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.320898 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.320494    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2811edb-f9ac-4178-b2d0-a7569051a989-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.320898 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.320808    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2811edb-f9ac-4178-b2d0-a7569051a989-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.321000 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.320930    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2811edb-f9ac-4178-b2d0-a7569051a989-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.321000 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.320966    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2811edb-f9ac-4178-b2d0-a7569051a989-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.321000 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.320991    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2811edb-f9ac-4178-b2d0-a7569051a989-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.321119 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.321094    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2811edb-f9ac-4178-b2d0-a7569051a989-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.323315 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.323290    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2811edb-f9ac-4178-b2d0-a7569051a989-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.323450 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.323432    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2811edb-f9ac-4178-b2d0-a7569051a989-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.333048 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.333023    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2811edb-f9ac-4178-b2d0-a7569051a989-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.333189 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.333170    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6mj5\" (UniqueName: \"kubernetes.io/projected/a2811edb-f9ac-4178-b2d0-a7569051a989-kube-api-access-z6mj5\") pod \"maas-default-gateway-openshift-default-5df48fcc99-zxwsq\" (UID: \"a2811edb-f9ac-4178-b2d0-a7569051a989\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.402385 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:04:11.402345    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:04:11.413524 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.413498    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:11.693791 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.693761    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"]
Oct 31 00:04:11.695997 ip-10-0-142-208 kubenswrapper[4921]: W1031 00:04:11.695968    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2811edb_f9ac_4178_b2d0_a7569051a989.slice/crio-76ba28dad4f2e1ff913bdc49276e6d2f29606502420ef22ec714fb2a7cb8e272 WatchSource:0}: Error finding container 76ba28dad4f2e1ff913bdc49276e6d2f29606502420ef22ec714fb2a7cb8e272: Status 404 returned error can't find the container with id 76ba28dad4f2e1ff913bdc49276e6d2f29606502420ef22ec714fb2a7cb8e272
Oct 31 00:04:11.698126 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.698091    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 31 00:04:11.698217 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.698157    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 31 00:04:11.698217 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:11.698183    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 31 00:04:12.206272 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:12.206232    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq" event={"ID":"a2811edb-f9ac-4178-b2d0-a7569051a989","Type":"ContainerStarted","Data":"9b69454f78529d4213ccc2a873de3f8aed7638263844983c5b86c9b20a687897"}
Oct 31 00:04:12.206799 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:12.206296    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq" event={"ID":"a2811edb-f9ac-4178-b2d0-a7569051a989","Type":"ContainerStarted","Data":"76ba28dad4f2e1ff913bdc49276e6d2f29606502420ef22ec714fb2a7cb8e272"}
Oct 31 00:04:12.229889 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:12.229837    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq" podStartSLOduration=1.22982396 podStartE2EDuration="1.22982396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:04:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:04:12.228701551 +0000 UTC m=+2711.473557322" watchObservedRunningTime="2026-10-31 00:04:12.22982396 +0000 UTC m=+2711.474679728"
Oct 31 00:04:12.414668 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:12.414627    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:12.416258 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:12.416236    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-zxwsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.166:15021/healthz/ready\": dial tcp 10.132.0.166:15021: connect: connection refused" start-of-body=
Oct 31 00:04:12.416316 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:12.416293    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq" podUID="a2811edb-f9ac-4178-b2d0-a7569051a989" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.166:15021/healthz/ready\": dial tcp 10.132.0.166:15021: connect: connection refused"
Oct 31 00:04:13.415398 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:13.415366    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-zxwsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.166:15021/healthz/ready\": dial tcp 10.132.0.166:15021: connect: connection refused" start-of-body=
Oct 31 00:04:13.415879 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:13.415417    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq" podUID="a2811edb-f9ac-4178-b2d0-a7569051a989" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.166:15021/healthz/ready\": dial tcp 10.132.0.166:15021: connect: connection refused"
Oct 31 00:04:14.414432 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:14.414403    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-zxwsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.166:15021/healthz/ready\": dial tcp 10.132.0.166:15021: connect: connection refused" start-of-body=
Oct 31 00:04:14.414662 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:14.414469    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq" podUID="a2811edb-f9ac-4178-b2d0-a7569051a989" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.166:15021/healthz/ready\": dial tcp 10.132.0.166:15021: connect: connection refused"
Oct 31 00:04:15.414333 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:15.414300    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-zxwsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.166:15021/healthz/ready\": dial tcp 10.132.0.166:15021: connect: connection refused" start-of-body=
Oct 31 00:04:15.414787 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:15.414349    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq" podUID="a2811edb-f9ac-4178-b2d0-a7569051a989" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.166:15021/healthz/ready\": dial tcp 10.132.0.166:15021: connect: connection refused"
Oct 31 00:04:15.586619 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:15.586008    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:04:15.694534 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:15.694439    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d4db8f8cf-tr6gw"]
Oct 31 00:04:15.695060 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:15.695026    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw" podUID="fec54092-2a3f-4e67-a4ab-fe817098296f" containerName="manager" containerID="cri-o://f2379e33ddee8e88601f54f71e38878db794f28879bb1106dc6cab36e2a3b68c" gracePeriod=30
Oct 31 00:04:15.997565 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:15.997537    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw"
Oct 31 00:04:16.092355 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.092322    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fec54092-2a3f-4e67-a4ab-fe817098296f-webhook-cert\" (UniqueName: \"kubernetes.io/secret/fec54092-2a3f-4e67-a4ab-fe817098296f-webhook-cert\") pod \"fec54092-2a3f-4e67-a4ab-fe817098296f\" (UID: \"fec54092-2a3f-4e67-a4ab-fe817098296f\") "
Oct 31 00:04:16.092574 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.092448    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fec54092-2a3f-4e67-a4ab-fe817098296f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/fec54092-2a3f-4e67-a4ab-fe817098296f-metrics-certs\") pod \"fec54092-2a3f-4e67-a4ab-fe817098296f\" (UID: \"fec54092-2a3f-4e67-a4ab-fe817098296f\") "
Oct 31 00:04:16.092574 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.092483    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fec54092-2a3f-4e67-a4ab-fe817098296f-kube-api-access-lkm2s\" (UniqueName: \"kubernetes.io/projected/fec54092-2a3f-4e67-a4ab-fe817098296f-kube-api-access-lkm2s\") pod \"fec54092-2a3f-4e67-a4ab-fe817098296f\" (UID: \"fec54092-2a3f-4e67-a4ab-fe817098296f\") "
Oct 31 00:04:16.095298 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.095261    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec54092-2a3f-4e67-a4ab-fe817098296f-metrics-certs" pod "fec54092-2a3f-4e67-a4ab-fe817098296f" (UID: "fec54092-2a3f-4e67-a4ab-fe817098296f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:04:16.095441 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.095404    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fec54092-2a3f-4e67-a4ab-fe817098296f-kube-api-access-lkm2s" pod "fec54092-2a3f-4e67-a4ab-fe817098296f" (UID: "fec54092-2a3f-4e67-a4ab-fe817098296f"). InnerVolumeSpecName "kube-api-access-lkm2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:04:16.095441 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.095417    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec54092-2a3f-4e67-a4ab-fe817098296f-webhook-cert" pod "fec54092-2a3f-4e67-a4ab-fe817098296f" (UID: "fec54092-2a3f-4e67-a4ab-fe817098296f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:04:16.194210 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.194169    4921 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fec54092-2a3f-4e67-a4ab-fe817098296f-webhook-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:04:16.194210 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.194201    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fec54092-2a3f-4e67-a4ab-fe817098296f-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:04:16.194210 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.194214    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkm2s\" (UniqueName: \"kubernetes.io/projected/fec54092-2a3f-4e67-a4ab-fe817098296f-kube-api-access-lkm2s\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:04:16.233606 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.233506    4921 generic.go:356] "Generic (PLEG): container finished" podID="fec54092-2a3f-4e67-a4ab-fe817098296f" containerID="f2379e33ddee8e88601f54f71e38878db794f28879bb1106dc6cab36e2a3b68c" exitCode=0
Oct 31 00:04:16.233606 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.233570    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw"
Oct 31 00:04:16.233883 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.233620    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw" event={"ID":"fec54092-2a3f-4e67-a4ab-fe817098296f","Type":"ContainerDied","Data":"f2379e33ddee8e88601f54f71e38878db794f28879bb1106dc6cab36e2a3b68c"}
Oct 31 00:04:16.233883 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.233715    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4db8f8cf-tr6gw" event={"ID":"fec54092-2a3f-4e67-a4ab-fe817098296f","Type":"ContainerDied","Data":"05dbd56cb4b4d58a320b964170d3c68d411ad87c6fa0038536e362ad7b2502e4"}
Oct 31 00:04:16.233883 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.233746    4921 scope.go:122] "RemoveContainer" containerID="f2379e33ddee8e88601f54f71e38878db794f28879bb1106dc6cab36e2a3b68c"
Oct 31 00:04:16.246368 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.246349    4921 scope.go:122] "RemoveContainer" containerID="f2379e33ddee8e88601f54f71e38878db794f28879bb1106dc6cab36e2a3b68c"
Oct 31 00:04:16.246676 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:04:16.246655    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2379e33ddee8e88601f54f71e38878db794f28879bb1106dc6cab36e2a3b68c\": container with ID starting with f2379e33ddee8e88601f54f71e38878db794f28879bb1106dc6cab36e2a3b68c not found: ID does not exist" containerID="f2379e33ddee8e88601f54f71e38878db794f28879bb1106dc6cab36e2a3b68c"
Oct 31 00:04:16.246801 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.246684    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2379e33ddee8e88601f54f71e38878db794f28879bb1106dc6cab36e2a3b68c"} err="failed to get container status \"f2379e33ddee8e88601f54f71e38878db794f28879bb1106dc6cab36e2a3b68c\": rpc error: code = NotFound desc = could not find container \"f2379e33ddee8e88601f54f71e38878db794f28879bb1106dc6cab36e2a3b68c\": container with ID starting with f2379e33ddee8e88601f54f71e38878db794f28879bb1106dc6cab36e2a3b68c not found: ID does not exist"
Oct 31 00:04:16.259641 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.259586    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d4db8f8cf-tr6gw"]
Oct 31 00:04:16.264226 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.264206    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7d4db8f8cf-tr6gw"]
Oct 31 00:04:16.414879 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.414849    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-zxwsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.166:15021/healthz/ready\": dial tcp 10.132.0.166:15021: connect: connection refused" start-of-body=
Oct 31 00:04:16.415297 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.414899    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq" podUID="a2811edb-f9ac-4178-b2d0-a7569051a989" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.166:15021/healthz/ready\": dial tcp 10.132.0.166:15021: connect: connection refused"
Oct 31 00:04:16.890344 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:16.890310    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fec54092-2a3f-4e67-a4ab-fe817098296f" path="/var/lib/kubelet/pods/fec54092-2a3f-4e67-a4ab-fe817098296f/volumes"
Oct 31 00:04:17.402459 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.402424    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:04:17.414171 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.414142    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-zxwsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.166:15021/healthz/ready\": dial tcp 10.132.0.166:15021: connect: connection refused" start-of-body=
Oct 31 00:04:17.414275 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.414204    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq" podUID="a2811edb-f9ac-4178-b2d0-a7569051a989" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.166:15021/healthz/ready\": dial tcp 10.132.0.166:15021: connect: connection refused"
Oct 31 00:04:17.535472 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.535440    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d4db8f8cf-2l8pm"]
Oct 31 00:04:17.535900 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.535883    4921 cpu_manager.go:414] "containerMap: removing container" podUID="fec54092-2a3f-4e67-a4ab-fe817098296f" containerName="manager"
Oct 31 00:04:17.535900 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.535896    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fec54092-2a3f-4e67-a4ab-fe817098296f" containerName="manager"
Oct 31 00:04:17.536000 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.535981    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="fec54092-2a3f-4e67-a4ab-fe817098296f" containerName="manager"
Oct 31 00:04:17.540476 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.540458    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4db8f8cf-2l8pm"
Oct 31 00:04:17.545209 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.544546    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 31 00:04:17.545995 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.545978    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c7j2t\""
Oct 31 00:04:17.546189 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.546177    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 31 00:04:17.546308 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.546299    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 31 00:04:17.551103 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.551079    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d4db8f8cf-2l8pm"]
Oct 31 00:04:17.709728 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.709625    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pwr2\" (UniqueName: \"kubernetes.io/projected/e6ac75bc-f580-4b94-b46d-5c6b203e5de5-kube-api-access-5pwr2\") pod \"maas-controller-7d4db8f8cf-2l8pm\" (UID: \"e6ac75bc-f580-4b94-b46d-5c6b203e5de5\") " pod="opendatahub/maas-controller-7d4db8f8cf-2l8pm"
Oct 31 00:04:17.709885 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.709726    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ac75bc-f580-4b94-b46d-5c6b203e5de5-metrics-certs\") pod \"maas-controller-7d4db8f8cf-2l8pm\" (UID: \"e6ac75bc-f580-4b94-b46d-5c6b203e5de5\") " pod="opendatahub/maas-controller-7d4db8f8cf-2l8pm"
Oct 31 00:04:17.709885 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.709806    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6ac75bc-f580-4b94-b46d-5c6b203e5de5-webhook-cert\") pod \"maas-controller-7d4db8f8cf-2l8pm\" (UID: \"e6ac75bc-f580-4b94-b46d-5c6b203e5de5\") " pod="opendatahub/maas-controller-7d4db8f8cf-2l8pm"
Oct 31 00:04:17.811301 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.811272    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6ac75bc-f580-4b94-b46d-5c6b203e5de5-webhook-cert\") pod \"maas-controller-7d4db8f8cf-2l8pm\" (UID: \"e6ac75bc-f580-4b94-b46d-5c6b203e5de5\") " pod="opendatahub/maas-controller-7d4db8f8cf-2l8pm"
Oct 31 00:04:17.811489 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.811350    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pwr2\" (UniqueName: \"kubernetes.io/projected/e6ac75bc-f580-4b94-b46d-5c6b203e5de5-kube-api-access-5pwr2\") pod \"maas-controller-7d4db8f8cf-2l8pm\" (UID: \"e6ac75bc-f580-4b94-b46d-5c6b203e5de5\") " pod="opendatahub/maas-controller-7d4db8f8cf-2l8pm"
Oct 31 00:04:17.811489 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.811383    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ac75bc-f580-4b94-b46d-5c6b203e5de5-metrics-certs\") pod \"maas-controller-7d4db8f8cf-2l8pm\" (UID: \"e6ac75bc-f580-4b94-b46d-5c6b203e5de5\") " pod="opendatahub/maas-controller-7d4db8f8cf-2l8pm"
Oct 31 00:04:17.813979 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.813956    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ac75bc-f580-4b94-b46d-5c6b203e5de5-metrics-certs\") pod \"maas-controller-7d4db8f8cf-2l8pm\" (UID: \"e6ac75bc-f580-4b94-b46d-5c6b203e5de5\") " pod="opendatahub/maas-controller-7d4db8f8cf-2l8pm"
Oct 31 00:04:17.814452 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.814427    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6ac75bc-f580-4b94-b46d-5c6b203e5de5-webhook-cert\") pod \"maas-controller-7d4db8f8cf-2l8pm\" (UID: \"e6ac75bc-f580-4b94-b46d-5c6b203e5de5\") " pod="opendatahub/maas-controller-7d4db8f8cf-2l8pm"
Oct 31 00:04:17.824398 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.824378    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pwr2\" (UniqueName: \"kubernetes.io/projected/e6ac75bc-f580-4b94-b46d-5c6b203e5de5-kube-api-access-5pwr2\") pod \"maas-controller-7d4db8f8cf-2l8pm\" (UID: \"e6ac75bc-f580-4b94-b46d-5c6b203e5de5\") " pod="opendatahub/maas-controller-7d4db8f8cf-2l8pm"
Oct 31 00:04:17.856176 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:17.856155    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4db8f8cf-2l8pm"
Oct 31 00:04:18.135281 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:18.135255    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d4db8f8cf-2l8pm"]
Oct 31 00:04:18.137780 ip-10-0-142-208 kubenswrapper[4921]: W1031 00:04:18.137752    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ac75bc_f580_4b94_b46d_5c6b203e5de5.slice/crio-4c1042a05506363b7b46c4e28325decdb7eba8b51bf6c22960629c9bc409ea20 WatchSource:0}: Error finding container 4c1042a05506363b7b46c4e28325decdb7eba8b51bf6c22960629c9bc409ea20: Status 404 returned error can't find the container with id 4c1042a05506363b7b46c4e28325decdb7eba8b51bf6c22960629c9bc409ea20
Oct 31 00:04:18.245630 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:18.245571    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4db8f8cf-2l8pm" event={"ID":"e6ac75bc-f580-4b94-b46d-5c6b203e5de5","Type":"ContainerStarted","Data":"4c1042a05506363b7b46c4e28325decdb7eba8b51bf6c22960629c9bc409ea20"}
Oct 31 00:04:18.414779 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:18.414682    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-zxwsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.166:15021/healthz/ready\": dial tcp 10.132.0.166:15021: connect: connection refused" start-of-body=
Oct 31 00:04:18.414779 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:18.414742    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq" podUID="a2811edb-f9ac-4178-b2d0-a7569051a989" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.166:15021/healthz/ready\": dial tcp 10.132.0.166:15021: connect: connection refused"
Oct 31 00:04:19.253782 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:19.253738    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4db8f8cf-2l8pm" event={"ID":"e6ac75bc-f580-4b94-b46d-5c6b203e5de5","Type":"ContainerStarted","Data":"dc6a683a22b218858d98417709e319c48bb42f777cef1b5d9a9899a933d2ca77"}
Oct 31 00:04:19.254299 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:19.253895    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d4db8f8cf-2l8pm"
Oct 31 00:04:19.275367 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:19.275309    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-7d4db8f8cf-2l8pm" podStartSLOduration=1.8620328339999999 podStartE2EDuration="2.275295276s" totalImagesPullingTime="413.262442ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:04:19.27483857 +0000 UTC m=+2718.519694341" watchObservedRunningTime="2026-10-31 00:04:19.275295276 +0000 UTC m=+2718.520151044"
Oct 31 00:04:19.966032 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:19.966000    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:19.966377 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:19.966354    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:19.967390 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:19.967373    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq"
Oct 31 00:04:30.261327 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:30.261294    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d4db8f8cf-2l8pm"
Oct 31 00:04:41.402748 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:04:41.402712    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:04:54.948767 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:54.948733    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:04:55.180073 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:04:55.180041    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:05:11.407134 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:05:11.407098    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:05:14.021914 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:05:14.021877    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9"]
Oct 31 00:05:14.024480 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:05:14.024445    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8bbc243c-tqvm9"]
Oct 31 00:05:14.881961 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:05:14.881931    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5e2b3853-7e76-44f3-9536-02f877d8f6b6" path="/var/lib/kubelet/pods/5e2b3853-7e76-44f3-9536-02f877d8f6b6/volumes"
Oct 31 00:05:32.395551 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:05:32.395513    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:05:32.550575 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:05:32.550542    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:05:40.739251 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:05:40.739211    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:05:40.865542 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:05:40.865409    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:05:41.402815 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:05:41.402779    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:05:45.020216 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:05:45.020168    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:05:54.998364 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:05:54.998320    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:05:55.240297 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:05:55.240260    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:06:11.403962 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:06:11.403924    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:06:40.476838 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:06:40.476801    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:06:41.403123 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:06:41.403085    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:06:55.060746 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:06:55.060709    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:06:55.306585 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:06:55.306541    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:07:06.010562 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:07:06.010528    4921 scope.go:122] "RemoveContainer" containerID="2d10608b31fccf48c0f487ab171c0d0dd2ee165bb2555cd36b68a5ae7c6d318a"
Oct 31 00:07:11.403280 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:07:11.403228    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:07:41.557123 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:07:41.556908    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:07:55.127292 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:07:55.127256    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:07:55.354821 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:07:55.354695    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:08:11.403702 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:08:11.403632    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:08:31.536649 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:08:31.536607    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:08:41.405313 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:08:41.405274    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:08:46.885726 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:08:46.885694    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:08:54.329620 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:08:54.328833    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-ghblg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:08:54.329620 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:08:54.328977    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg" podUID="31f7fe08-e50d-4112-ad82-34d9d4ccf5c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:08:54.559619 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:08:54.558694    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-kr9zt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:08:54.559619 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:08:54.558797    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-kr9zt" podUID="9b175126-9bea-4fd8-8139-7e392c602a9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:08:55.190507 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:08:55.190467    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:02.301742 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:02.301712    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 31 00:09:02.313344 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:02.313320    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 31 00:09:02.599853 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:02.599779    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:03.152266 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:03.152233    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:03.294052 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:03.294018    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:05.089326 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:05.089295    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:05.221748 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:05.221712    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:06.637909 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:06.637867    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:06.777215 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:06.777182    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:07.767871 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:07.767814    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"]
Oct 31 00:09:07.771972 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:07.771953    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"
Oct 31 00:09:07.783419 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:07.783380    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"]
Oct 31 00:09:07.796764 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:07.796739    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-93f1ad-serving-cert\""
Oct 31 00:09:07.868841 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:07.868799    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zdc2\" (UniqueName: \"kubernetes.io/projected/8423f148-8f98-4760-a644-b442bc8dbcd7-kube-api-access-5zdc2\") pod \"maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l\" (UID: \"8423f148-8f98-4760-a644-b442bc8dbcd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"
Oct 31 00:09:07.869203 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:07.868966    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:07.869316 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:07.869216    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8423f148-8f98-4760-a644-b442bc8dbcd7-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l\" (UID: \"8423f148-8f98-4760-a644-b442bc8dbcd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"
Oct 31 00:09:07.869362 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:07.869314    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8423f148-8f98-4760-a644-b442bc8dbcd7-metrics-certs\") pod \"maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l\" (UID: \"8423f148-8f98-4760-a644-b442bc8dbcd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"
Oct 31 00:09:07.869400 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:07.869367    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8423f148-8f98-4760-a644-b442bc8dbcd7-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l\" (UID: \"8423f148-8f98-4760-a644-b442bc8dbcd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"
Oct 31 00:09:07.970005 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:07.969969    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8423f148-8f98-4760-a644-b442bc8dbcd7-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l\" (UID: \"8423f148-8f98-4760-a644-b442bc8dbcd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"
Oct 31 00:09:07.970221 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:07.970027    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8423f148-8f98-4760-a644-b442bc8dbcd7-metrics-certs\") pod \"maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l\" (UID: \"8423f148-8f98-4760-a644-b442bc8dbcd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"
Oct 31 00:09:07.970221 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:07.970157    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8423f148-8f98-4760-a644-b442bc8dbcd7-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l\" (UID: \"8423f148-8f98-4760-a644-b442bc8dbcd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"
Oct 31 00:09:07.970366 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:07.970266    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zdc2\" (UniqueName: \"kubernetes.io/projected/8423f148-8f98-4760-a644-b442bc8dbcd7-kube-api-access-5zdc2\") pod \"maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l\" (UID: \"8423f148-8f98-4760-a644-b442bc8dbcd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"
Oct 31 00:09:07.970857 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:07.970824    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8423f148-8f98-4760-a644-b442bc8dbcd7-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l\" (UID: \"8423f148-8f98-4760-a644-b442bc8dbcd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"
Oct 31 00:09:07.972653 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:07.972630    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8423f148-8f98-4760-a644-b442bc8dbcd7-metrics-certs\") pod \"maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l\" (UID: \"8423f148-8f98-4760-a644-b442bc8dbcd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"
Oct 31 00:09:07.972762 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:07.972698    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8423f148-8f98-4760-a644-b442bc8dbcd7-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l\" (UID: \"8423f148-8f98-4760-a644-b442bc8dbcd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"
Oct 31 00:09:08.002297 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:08.002220    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zdc2\" (UniqueName: \"kubernetes.io/projected/8423f148-8f98-4760-a644-b442bc8dbcd7-kube-api-access-5zdc2\") pod \"maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l\" (UID: \"8423f148-8f98-4760-a644-b442bc8dbcd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"
Oct 31 00:09:08.032236 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:08.032166    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:08.088585 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:08.088558    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"
Oct 31 00:09:08.417386 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:08.417342    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"]
Oct 31 00:09:08.419969 ip-10-0-142-208 kubenswrapper[4921]: W1031 00:09:08.419940    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8423f148_8f98_4760_a644_b442bc8dbcd7.slice/crio-0acb70366639f0dce0a70ad403828aa438afbd5675ed58d45d43c04fc80f9f78 WatchSource:0}: Error finding container 0acb70366639f0dce0a70ad403828aa438afbd5675ed58d45d43c04fc80f9f78: Status 404 returned error can't find the container with id 0acb70366639f0dce0a70ad403828aa438afbd5675ed58d45d43c04fc80f9f78
Oct 31 00:09:08.421295 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:08.421277    4921 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:09:08.985895 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:08.982796    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:09.053901 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:09.053869    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l" event={"ID":"8423f148-8f98-4760-a644-b442bc8dbcd7","Type":"ContainerStarted","Data":"db221782ada9bafc09e4f12e3f66bd8c9c58a40f635af0e044bc4e694df1c9ad"}
Oct 31 00:09:09.054057 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:09.053922    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l" event={"ID":"8423f148-8f98-4760-a644-b442bc8dbcd7","Type":"ContainerStarted","Data":"0acb70366639f0dce0a70ad403828aa438afbd5675ed58d45d43c04fc80f9f78"}
Oct 31 00:09:09.054057 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:09.053998    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"
Oct 31 00:09:09.086952 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:09.086870    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l" podStartSLOduration=1.570863071 podStartE2EDuration="2.086855755s" totalImagesPullingTime="515.992684ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:09:09.085651333 +0000 UTC m=+3008.330507101" watchObservedRunningTime="2026-10-31 00:09:09.086855755 +0000 UTC m=+3008.331711519"
Oct 31 00:09:09.741003 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:09.740970    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:10.652545 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:10.652508    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:11.403627 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:09:11.403568    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:09:11.569926 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:11.569817    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:12.238092 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:12.238052    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:13.134021 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:13.133936    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:13.928981 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:13.928941    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:14.672136 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:14.672099    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:15.064716 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:15.064640    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"
Oct 31 00:09:15.699532 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:15.699495    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:16.619504 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:16.619468    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:16.776759 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:16.776722    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:17.261959 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:17.261930    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:17.418352 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:17.418321    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:17.866906 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:17.866867    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:18.484822 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:18.484790    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:18.953254 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:18.953205    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:19.672805 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:19.672761    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:20.439197 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:20.439167    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:21.227666 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:21.227629    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:21.957486 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:21.957449    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:22.801986 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:22.801922    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:23.561623 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:23.561536    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:24.232276 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:24.232244    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:24.976149 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:24.976116    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:25.619351 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:25.619308    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:26.439632 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:26.439574    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:27.227921 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:27.227888    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:27.944772 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:27.944739    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:28.736739 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:28.736704    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:29.433769 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:29.433734    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:30.140022 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:30.139991    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:30.826281 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:30.826241    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:31.556955 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:31.556920    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:32.241680 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:32.241648    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:32.922164 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:32.922134    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:33.620225 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:33.620192    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:34.325780 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:34.325748    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:35.143264 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:35.143232    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:35.831163 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:35.831128    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:36.537000 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:36.536968    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:37.339963 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:37.339925    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:38.146964 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:38.146920    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:38.731491 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:38.731456    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:39.420836 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:39.420793    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:40.127144 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:40.127114    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:40.926727 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:40.926685    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:41.403067 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:09:41.403031    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:09:41.631039 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:41.630996    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:42.336390 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:42.336347    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:43.021615 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:43.021552    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:43.724831 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:43.724794    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:44.429857 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:44.429820    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:45.135477 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:45.135442    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:45.831814 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:45.831783    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:46.547555 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:46.547509    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:47.237638 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:47.237575    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:48.024491 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:48.024455    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:48.752687 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:48.752656    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:49.435531 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:49.435497    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:50.131951 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:50.131914    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:50.831537 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:50.831501    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:51.525382 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:51.525341    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:52.228329 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:52.228299    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:52.931498 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:52.931463    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:53.631380 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:53.631345    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:54.329609 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:54.329570    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:55.111480 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:55.111444    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:55.246620 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:55.246567    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:55.828569 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:55.828527    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:56.591972 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:56.591930    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:57.231962 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:57.231928    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:57.949495 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:57.949440    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:58.646583 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:58.646429    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:59.338777 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:59.338746    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:09:59.512320 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:09:59.512283    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:00.218985 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:00.218922    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:01.124959 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:01.124921    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:01.857624 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:01.857522    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:02.550839 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:02.550805    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:03.344714 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:03.344678    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:04.162044 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:04.162008    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:04.632390 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:04.632295    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:05.155573 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:05.155540    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:05.936814 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:05.936783    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:06.731275 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:06.731246    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:07.452610 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:07.452552    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:08.176669 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:08.176511    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:09.005209 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:09.005159    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:09.843035 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:09.843004    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:10.079620 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:10.071720    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:10.455207 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:10.455162    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"]
Oct 31 00:10:10.455457 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:10.455423    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l" podUID="8423f148-8f98-4760-a644-b442bc8dbcd7" containerName="maas-api" containerID="cri-o://db221782ada9bafc09e4f12e3f66bd8c9c58a40f635af0e044bc4e694df1c9ad" gracePeriod=30
Oct 31 00:10:10.551061 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:10.551028    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:10.752931 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:10.752909    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"
Oct 31 00:10:10.782924 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:10.782889    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:10.896625 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:10.891868    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8423f148-8f98-4760-a644-b442bc8dbcd7-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8423f148-8f98-4760-a644-b442bc8dbcd7-metrics-certs\") pod \"8423f148-8f98-4760-a644-b442bc8dbcd7\" (UID: \"8423f148-8f98-4760-a644-b442bc8dbcd7\") "
Oct 31 00:10:10.896625 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:10.891937    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8423f148-8f98-4760-a644-b442bc8dbcd7-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8423f148-8f98-4760-a644-b442bc8dbcd7-maas-api-tls\") pod \"8423f148-8f98-4760-a644-b442bc8dbcd7\" (UID: \"8423f148-8f98-4760-a644-b442bc8dbcd7\") "
Oct 31 00:10:10.896625 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:10.892020    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8423f148-8f98-4760-a644-b442bc8dbcd7-kube-api-access-5zdc2\" (UniqueName: \"kubernetes.io/projected/8423f148-8f98-4760-a644-b442bc8dbcd7-kube-api-access-5zdc2\") pod \"8423f148-8f98-4760-a644-b442bc8dbcd7\" (UID: \"8423f148-8f98-4760-a644-b442bc8dbcd7\") "
Oct 31 00:10:10.896625 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:10.892079    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8423f148-8f98-4760-a644-b442bc8dbcd7-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8423f148-8f98-4760-a644-b442bc8dbcd7-openshift-service-ca\") pod \"8423f148-8f98-4760-a644-b442bc8dbcd7\" (UID: \"8423f148-8f98-4760-a644-b442bc8dbcd7\") "
Oct 31 00:10:10.896625 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:10.892793    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8423f148-8f98-4760-a644-b442bc8dbcd7-openshift-service-ca" pod "8423f148-8f98-4760-a644-b442bc8dbcd7" (UID: "8423f148-8f98-4760-a644-b442bc8dbcd7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:10:10.899360 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:10.899329    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8423f148-8f98-4760-a644-b442bc8dbcd7-metrics-certs" pod "8423f148-8f98-4760-a644-b442bc8dbcd7" (UID: "8423f148-8f98-4760-a644-b442bc8dbcd7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:10:10.909500 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:10.909373    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8423f148-8f98-4760-a644-b442bc8dbcd7-kube-api-access-5zdc2" pod "8423f148-8f98-4760-a644-b442bc8dbcd7" (UID: "8423f148-8f98-4760-a644-b442bc8dbcd7"). InnerVolumeSpecName "kube-api-access-5zdc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:10:10.909500 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:10.909473    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8423f148-8f98-4760-a644-b442bc8dbcd7-maas-api-tls" pod "8423f148-8f98-4760-a644-b442bc8dbcd7" (UID: "8423f148-8f98-4760-a644-b442bc8dbcd7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:10:10.930811 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:10.930782    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:10.993888 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:10.993813    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zdc2\" (UniqueName: \"kubernetes.io/projected/8423f148-8f98-4760-a644-b442bc8dbcd7-kube-api-access-5zdc2\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:10:10.993888 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:10.993845    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8423f148-8f98-4760-a644-b442bc8dbcd7-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:10:10.993888 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:10.993859    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8423f148-8f98-4760-a644-b442bc8dbcd7-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:10:10.993888 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:10.993874    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8423f148-8f98-4760-a644-b442bc8dbcd7-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:10:11.380996 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:11.380911    4921 generic.go:356] "Generic (PLEG): container finished" podID="8423f148-8f98-4760-a644-b442bc8dbcd7" containerID="db221782ada9bafc09e4f12e3f66bd8c9c58a40f635af0e044bc4e694df1c9ad" exitCode=0
Oct 31 00:10:11.380996 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:11.380963    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"
Oct 31 00:10:11.381502 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:11.381002    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l" event={"ID":"8423f148-8f98-4760-a644-b442bc8dbcd7","Type":"ContainerDied","Data":"db221782ada9bafc09e4f12e3f66bd8c9c58a40f635af0e044bc4e694df1c9ad"}
Oct 31 00:10:11.381502 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:11.381082    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l" event={"ID":"8423f148-8f98-4760-a644-b442bc8dbcd7","Type":"ContainerDied","Data":"0acb70366639f0dce0a70ad403828aa438afbd5675ed58d45d43c04fc80f9f78"}
Oct 31 00:10:11.381502 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:11.381111    4921 scope.go:122] "RemoveContainer" containerID="db221782ada9bafc09e4f12e3f66bd8c9c58a40f635af0e044bc4e694df1c9ad"
Oct 31 00:10:11.397214 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:11.397191    4921 scope.go:122] "RemoveContainer" containerID="db221782ada9bafc09e4f12e3f66bd8c9c58a40f635af0e044bc4e694df1c9ad"
Oct 31 00:10:11.397541 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:10:11.397519    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db221782ada9bafc09e4f12e3f66bd8c9c58a40f635af0e044bc4e694df1c9ad\": container with ID starting with db221782ada9bafc09e4f12e3f66bd8c9c58a40f635af0e044bc4e694df1c9ad not found: ID does not exist" containerID="db221782ada9bafc09e4f12e3f66bd8c9c58a40f635af0e044bc4e694df1c9ad"
Oct 31 00:10:11.397651 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:11.397549    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db221782ada9bafc09e4f12e3f66bd8c9c58a40f635af0e044bc4e694df1c9ad"} err="failed to get container status \"db221782ada9bafc09e4f12e3f66bd8c9c58a40f635af0e044bc4e694df1c9ad\": rpc error: code = NotFound desc = could not find container \"db221782ada9bafc09e4f12e3f66bd8c9c58a40f635af0e044bc4e694df1c9ad\": container with ID starting with db221782ada9bafc09e4f12e3f66bd8c9c58a40f635af0e044bc4e694df1c9ad not found: ID does not exist"
Oct 31 00:10:11.406465 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:10:11.406437    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:10:11.410220 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:11.410197    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"]
Oct 31 00:10:11.412217 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:11.412199    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-93f1ad-5bbf4df86-h2p9l"]
Oct 31 00:10:11.416513 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:11.416491    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:12.882237 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:12.882205    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8423f148-8f98-4760-a644-b442bc8dbcd7" path="/var/lib/kubelet/pods/8423f148-8f98-4760-a644-b442bc8dbcd7/volumes"
Oct 31 00:10:17.752019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:17.751987    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:17.908832 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:17.908782    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:18.157423 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:18.157386    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:40.953368 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:40.953324    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:41.402392 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:10:41.402359    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:10:41.868300 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:41.868181    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:47.779084 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:47.779048    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:10:55.284340 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:10:55.284303    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:11:11.402943 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:11:11.402893    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:11:35.451936 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:11:35.451899    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:11:35.575844 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:11:35.575811    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:11:41.402268 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:11:41.402229    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:11:55.360851 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:11:55.360812    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:11.416625 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:12:11.416562    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:12:27.091311 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:27.091274    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:28.858347 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:28.858288    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:29.293039 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:29.293002    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:29.423539 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:29.422396    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:33.008852 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:33.008816    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:33.214808 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:33.214772    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:34.163120 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.163084    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"]
Oct 31 00:12:34.163926 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.163903    4921 cpu_manager.go:414] "containerMap: removing container" podUID="8423f148-8f98-4760-a644-b442bc8dbcd7" containerName="maas-api"
Oct 31 00:12:34.164052 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.163929    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8423f148-8f98-4760-a644-b442bc8dbcd7" containerName="maas-api"
Oct 31 00:12:34.164114 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.164052    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="8423f148-8f98-4760-a644-b442bc8dbcd7" containerName="maas-api"
Oct 31 00:12:34.167509 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.167485    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"
Oct 31 00:12:34.192757 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.192729    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"]
Oct 31 00:12:34.206258 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.206229    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81990b9c-6b89-403d-ad1f-1e6e550325af-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n\" (UID: \"81990b9c-6b89-403d-ad1f-1e6e550325af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"
Oct 31 00:12:34.206412 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.206347    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81990b9c-6b89-403d-ad1f-1e6e550325af-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n\" (UID: \"81990b9c-6b89-403d-ad1f-1e6e550325af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"
Oct 31 00:12:34.206412 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.206407    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4k4h\" (UniqueName: \"kubernetes.io/projected/81990b9c-6b89-403d-ad1f-1e6e550325af-kube-api-access-w4k4h\") pod \"maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n\" (UID: \"81990b9c-6b89-403d-ad1f-1e6e550325af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"
Oct 31 00:12:34.206507 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.206428    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81990b9c-6b89-403d-ad1f-1e6e550325af-metrics-certs\") pod \"maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n\" (UID: \"81990b9c-6b89-403d-ad1f-1e6e550325af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"
Oct 31 00:12:34.209885 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.209857    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-c4c1ab-serving-cert\""
Oct 31 00:12:34.254798 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.254767    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:34.307256 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.307228    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81990b9c-6b89-403d-ad1f-1e6e550325af-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n\" (UID: \"81990b9c-6b89-403d-ad1f-1e6e550325af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"
Oct 31 00:12:34.307447 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.307277    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4k4h\" (UniqueName: \"kubernetes.io/projected/81990b9c-6b89-403d-ad1f-1e6e550325af-kube-api-access-w4k4h\") pod \"maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n\" (UID: \"81990b9c-6b89-403d-ad1f-1e6e550325af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"
Oct 31 00:12:34.307447 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.307300    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81990b9c-6b89-403d-ad1f-1e6e550325af-metrics-certs\") pod \"maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n\" (UID: \"81990b9c-6b89-403d-ad1f-1e6e550325af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"
Oct 31 00:12:34.307447 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.307356    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81990b9c-6b89-403d-ad1f-1e6e550325af-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n\" (UID: \"81990b9c-6b89-403d-ad1f-1e6e550325af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"
Oct 31 00:12:34.308000 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.307973    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81990b9c-6b89-403d-ad1f-1e6e550325af-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n\" (UID: \"81990b9c-6b89-403d-ad1f-1e6e550325af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"
Oct 31 00:12:34.310198 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.310175    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81990b9c-6b89-403d-ad1f-1e6e550325af-metrics-certs\") pod \"maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n\" (UID: \"81990b9c-6b89-403d-ad1f-1e6e550325af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"
Oct 31 00:12:34.310273 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.310175    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81990b9c-6b89-403d-ad1f-1e6e550325af-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n\" (UID: \"81990b9c-6b89-403d-ad1f-1e6e550325af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"
Oct 31 00:12:34.326927 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.326903    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4k4h\" (UniqueName: \"kubernetes.io/projected/81990b9c-6b89-403d-ad1f-1e6e550325af-kube-api-access-w4k4h\") pod \"maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n\" (UID: \"81990b9c-6b89-403d-ad1f-1e6e550325af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"
Oct 31 00:12:34.412506 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.412470    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:34.484534 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.484456    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"
Oct 31 00:12:34.764355 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:34.764329    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"]
Oct 31 00:12:34.766716 ip-10-0-142-208 kubenswrapper[4921]: W1031 00:12:34.766692    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81990b9c_6b89_403d_ad1f_1e6e550325af.slice/crio-88968f86372436f9edfdae0a98d5c566ddc0e4ceae791834ea40307f3b71c0c9 WatchSource:0}: Error finding container 88968f86372436f9edfdae0a98d5c566ddc0e4ceae791834ea40307f3b71c0c9: Status 404 returned error can't find the container with id 88968f86372436f9edfdae0a98d5c566ddc0e4ceae791834ea40307f3b71c0c9
Oct 31 00:12:35.146864 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:35.146834    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:35.180093 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:35.180060    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n" event={"ID":"81990b9c-6b89-403d-ad1f-1e6e550325af","Type":"ContainerStarted","Data":"88968f86372436f9edfdae0a98d5c566ddc0e4ceae791834ea40307f3b71c0c9"}
Oct 31 00:12:35.933586 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:35.933551    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:36.186317 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:36.186217    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n" event={"ID":"81990b9c-6b89-403d-ad1f-1e6e550325af","Type":"ContainerStarted","Data":"d37b8cac884091d3feba95340e0d9cd385dcdc4a61b52a602dc604b2d496e156"}
Oct 31 00:12:36.186317 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:36.186283    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"
Oct 31 00:12:36.237856 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:36.237799    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n" podStartSLOduration=1.790854078 podStartE2EDuration="2.237783279s" totalImagesPullingTime="446.929201ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:12:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:12:36.23707864 +0000 UTC m=+3215.481934410" watchObservedRunningTime="2026-10-31 00:12:36.237783279 +0000 UTC m=+3215.482639047"
Oct 31 00:12:36.949408 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:36.949370    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:37.634852 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:37.634814    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:38.329219 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:38.329182    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:39.046241 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:39.046202    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:39.740050 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:39.740017    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:40.432969 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:40.432932    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:41.132895 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:41.132861    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:41.402760 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:12:41.402676    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:12:41.930047 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:41.930012    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:42.197115 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:42.197041    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"
Oct 31 00:12:42.710633 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:42.705253    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:43.436900 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:43.436864    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:44.131927 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:44.131893    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:44.830685 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:44.830646    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:45.538850 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:45.538816    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:46.229328 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:46.229293    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:46.941950 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:46.941913    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:47.729775 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:47.729742    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:48.054773 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:48.054693    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:48.441914 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:48.441871    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:48.695815 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:48.695725    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:48.829246 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:48.829206    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:48.972613 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:48.972511    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:49.291399 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:49.291307    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:50.051171 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:50.051136    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:50.725960 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:50.725923    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:51.049102 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:51.048992    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:51.517875 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:51.517835    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:52.231867 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:52.231822    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:53.332652 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:53.332406    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:54.208286 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:54.208249    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:54.830549 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:54.830516    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:55.395620 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:55.395574    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:55.649954 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:55.649868    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:56.327666 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:56.327634    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:57.043145 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:57.043111    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:57.739346 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:57.739290    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:58.435896 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:58.435855    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:59.137769 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:59.137736    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:12:59.941098 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:12:59.941061    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:00.639835 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:00.639800    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:01.343189 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:01.343146    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:02.146616 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:02.143825    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:02.828733 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:02.828697    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:03.529151 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:03.529116    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:04.221015 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:04.220979    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:04.992212 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:04.992174    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:05.745520 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:05.745488    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:06.526867 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:06.526842    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:07.223233 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:07.223206    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:07.942280 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:07.942250    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:08.727795 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:08.727753    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:09.436900 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:09.436865    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:10.138829 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:10.138784    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:10.841916 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:10.841886    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:11.403553 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:13:11.403516    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:13:11.527237 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:11.527199    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:12.244330 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:12.244294    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:13.030951 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:13.030919    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:13.740548 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:13.740509    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:14.430710 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:14.430673    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:15.116560 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:15.116526    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:15.823377 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:15.823346    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:16.523640 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:16.523575    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:17.233980 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:17.233950    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:17.947684 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:17.944906    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:18.635647 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:18.635588    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:19.426481 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:19.426436    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:20.136431 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:20.136378    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:20.833002 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:20.832967    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:21.521995 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:21.521962    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:22.317185 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:22.317146    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:23.038479 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:23.038445    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:23.824006 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:23.823955    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:24.525193 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:24.525164    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:25.230279 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:25.230246    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:25.924249 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:25.924213    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:26.636018 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:26.635983    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:27.337341 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:27.337303    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:28.138506 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:28.138474    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:28.834954 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:28.834918    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:29.594976 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:29.594929    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:30.259449 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:30.259415    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:30.934824 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:30.934785    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:31.417288 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:31.417256    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:31.734139 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:31.734015    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:32.633474 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:32.633437    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:33.394866 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:33.394832    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:34.136689 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:34.136658    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:34.934623 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:34.934553    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:35.648474 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:35.648405    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:36.333077 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:36.333019    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:36.538110 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:36.538078    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:37.130832 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:37.130801    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:37.831768 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:37.831732    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:38.526237 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:38.526207    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:39.239167 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:39.239036    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:39.939915 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:39.939836    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:40.638679 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:40.638647    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:41.320790 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:41.320748    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:41.402686 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:13:41.402654    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:13:41.823788 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:41.823749    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:41.957611 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:41.957561    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"]
Oct 31 00:13:41.958335 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:41.958293    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n" podUID="81990b9c-6b89-403d-ad1f-1e6e550325af" containerName="maas-api" containerID="cri-o://d37b8cac884091d3feba95340e0d9cd385dcdc4a61b52a602dc604b2d496e156" gracePeriod=30
Oct 31 00:13:41.973832 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:41.973798    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:42.205074 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.204972    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:42.249040 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.249015    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"
Oct 31 00:13:42.257515 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.257494    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/81990b9c-6b89-403d-ad1f-1e6e550325af-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81990b9c-6b89-403d-ad1f-1e6e550325af-openshift-service-ca\") pod \"81990b9c-6b89-403d-ad1f-1e6e550325af\" (UID: \"81990b9c-6b89-403d-ad1f-1e6e550325af\") "
Oct 31 00:13:42.257698 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.257555    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/81990b9c-6b89-403d-ad1f-1e6e550325af-kube-api-access-w4k4h\" (UniqueName: \"kubernetes.io/projected/81990b9c-6b89-403d-ad1f-1e6e550325af-kube-api-access-w4k4h\") pod \"81990b9c-6b89-403d-ad1f-1e6e550325af\" (UID: \"81990b9c-6b89-403d-ad1f-1e6e550325af\") "
Oct 31 00:13:42.257698 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.257668    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/81990b9c-6b89-403d-ad1f-1e6e550325af-metrics-certs\" (UniqueName: \"kubernetes.io/secret/81990b9c-6b89-403d-ad1f-1e6e550325af-metrics-certs\") pod \"81990b9c-6b89-403d-ad1f-1e6e550325af\" (UID: \"81990b9c-6b89-403d-ad1f-1e6e550325af\") "
Oct 31 00:13:42.257866 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.257844    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81990b9c-6b89-403d-ad1f-1e6e550325af-openshift-service-ca" pod "81990b9c-6b89-403d-ad1f-1e6e550325af" (UID: "81990b9c-6b89-403d-ad1f-1e6e550325af"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:13:42.258027 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.258009    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81990b9c-6b89-403d-ad1f-1e6e550325af-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:13:42.259886 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.259859    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81990b9c-6b89-403d-ad1f-1e6e550325af-kube-api-access-w4k4h" pod "81990b9c-6b89-403d-ad1f-1e6e550325af" (UID: "81990b9c-6b89-403d-ad1f-1e6e550325af"). InnerVolumeSpecName "kube-api-access-w4k4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:13:42.259986 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.259920    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81990b9c-6b89-403d-ad1f-1e6e550325af-metrics-certs" pod "81990b9c-6b89-403d-ad1f-1e6e550325af" (UID: "81990b9c-6b89-403d-ad1f-1e6e550325af"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:13:42.339794 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.339716    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:42.358390 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.358363    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/81990b9c-6b89-403d-ad1f-1e6e550325af-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81990b9c-6b89-403d-ad1f-1e6e550325af-maas-api-tls\") pod \"81990b9c-6b89-403d-ad1f-1e6e550325af\" (UID: \"81990b9c-6b89-403d-ad1f-1e6e550325af\") "
Oct 31 00:13:42.358642 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.358588    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4k4h\" (UniqueName: \"kubernetes.io/projected/81990b9c-6b89-403d-ad1f-1e6e550325af-kube-api-access-w4k4h\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:13:42.358642 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.358633    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81990b9c-6b89-403d-ad1f-1e6e550325af-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:13:42.360584 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.360560    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81990b9c-6b89-403d-ad1f-1e6e550325af-maas-api-tls" pod "81990b9c-6b89-403d-ad1f-1e6e550325af" (UID: "81990b9c-6b89-403d-ad1f-1e6e550325af"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:13:42.459157 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.459125    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81990b9c-6b89-403d-ad1f-1e6e550325af-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:13:42.514031 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.513996    4921 generic.go:356] "Generic (PLEG): container finished" podID="81990b9c-6b89-403d-ad1f-1e6e550325af" containerID="d37b8cac884091d3feba95340e0d9cd385dcdc4a61b52a602dc604b2d496e156" exitCode=0
Oct 31 00:13:42.514229 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.514036    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n" event={"ID":"81990b9c-6b89-403d-ad1f-1e6e550325af","Type":"ContainerDied","Data":"d37b8cac884091d3feba95340e0d9cd385dcdc4a61b52a602dc604b2d496e156"}
Oct 31 00:13:42.514229 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.514057    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"
Oct 31 00:13:42.514229 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.514109    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n" event={"ID":"81990b9c-6b89-403d-ad1f-1e6e550325af","Type":"ContainerDied","Data":"88968f86372436f9edfdae0a98d5c566ddc0e4ceae791834ea40307f3b71c0c9"}
Oct 31 00:13:42.514229 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.514133    4921 scope.go:122] "RemoveContainer" containerID="d37b8cac884091d3feba95340e0d9cd385dcdc4a61b52a602dc604b2d496e156"
Oct 31 00:13:42.524556 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.524532    4921 scope.go:122] "RemoveContainer" containerID="d37b8cac884091d3feba95340e0d9cd385dcdc4a61b52a602dc604b2d496e156"
Oct 31 00:13:42.524933 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:13:42.524882    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d37b8cac884091d3feba95340e0d9cd385dcdc4a61b52a602dc604b2d496e156\": container with ID starting with d37b8cac884091d3feba95340e0d9cd385dcdc4a61b52a602dc604b2d496e156 not found: ID does not exist" containerID="d37b8cac884091d3feba95340e0d9cd385dcdc4a61b52a602dc604b2d496e156"
Oct 31 00:13:42.525010 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.524940    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d37b8cac884091d3feba95340e0d9cd385dcdc4a61b52a602dc604b2d496e156"} err="failed to get container status \"d37b8cac884091d3feba95340e0d9cd385dcdc4a61b52a602dc604b2d496e156\": rpc error: code = NotFound desc = could not find container \"d37b8cac884091d3feba95340e0d9cd385dcdc4a61b52a602dc604b2d496e156\": container with ID starting with d37b8cac884091d3feba95340e0d9cd385dcdc4a61b52a602dc604b2d496e156 not found: ID does not exist"
Oct 31 00:13:42.537980 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.537958    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"]
Oct 31 00:13:42.539975 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.539951    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n"]
Oct 31 00:13:42.882606 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.882563    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="81990b9c-6b89-403d-ad1f-1e6e550325af" path="/var/lib/kubelet/pods/81990b9c-6b89-403d-ad1f-1e6e550325af/volumes"
Oct 31 00:13:42.884711 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:42.884689    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:45.210952 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:45.210915    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c4c1ab-96c9ff5fd-v6m2n" podUID="81990b9c-6b89-403d-ad1f-1e6e550325af" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.169:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:13:48.926619 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:48.926575    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:49.061003 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:49.060966    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:49.381358 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:49.381252    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:53.896048 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:53.896018    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:13:55.467228 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:13:55.467191    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:14:02.331620 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:14:02.331571    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 31 00:14:02.344424 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:14:02.344403    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 31 00:14:10.238114 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:14:10.238075    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:14:11.402542 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:14:11.402503    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:14:12.584441 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:14:12.584397    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:14:13.965832 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:14:13.965792    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:14:19.871283 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:14:19.871245    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:14:38.340006 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:14:38.339969    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:14:39.525266 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:14:39.525232    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:14:41.472170 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:14:41.472037    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:14:54.298512 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:14:54.298472    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-ghblg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:14:54.298968 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:14:54.298536    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-ghblg" podUID="31f7fe08-e50d-4112-ad82-34d9d4ccf5c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:14:55.523956 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:14:55.523917    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:14:56.247338 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:14:56.247292    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:10.347897 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:10.347863    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:11.402637 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:15:11.402576    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:15:13.854558 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:13.854519    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n"]
Oct 31 00:15:13.855225 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:13.855205    4921 cpu_manager.go:414] "containerMap: removing container" podUID="81990b9c-6b89-403d-ad1f-1e6e550325af" containerName="maas-api"
Oct 31 00:15:13.855289 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:13.855231    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81990b9c-6b89-403d-ad1f-1e6e550325af" containerName="maas-api"
Oct 31 00:15:13.855389 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:13.855375    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="81990b9c-6b89-403d-ad1f-1e6e550325af" containerName="maas-api"
Oct 31 00:15:13.859036 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:13.859014    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n"
Oct 31 00:15:13.869387 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:13.869361    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n"]
Oct 31 00:15:13.909355 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:13.909320    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cde4852e-a681-434e-af2a-f37c74dec093-maas-api-tls\") pod \"maas-api-7f5c9bcb67-g6g9n\" (UID: \"cde4852e-a681-434e-af2a-f37c74dec093\") " pod="odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n"
Oct 31 00:15:13.909541 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:13.909489    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cde4852e-a681-434e-af2a-f37c74dec093-openshift-service-ca\") pod \"maas-api-7f5c9bcb67-g6g9n\" (UID: \"cde4852e-a681-434e-af2a-f37c74dec093\") " pod="odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n"
Oct 31 00:15:13.909645 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:13.909575    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8cvw\" (UniqueName: \"kubernetes.io/projected/cde4852e-a681-434e-af2a-f37c74dec093-kube-api-access-m8cvw\") pod \"maas-api-7f5c9bcb67-g6g9n\" (UID: \"cde4852e-a681-434e-af2a-f37c74dec093\") " pod="odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n"
Oct 31 00:15:13.909757 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:13.909696    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cde4852e-a681-434e-af2a-f37c74dec093-metrics-certs\") pod \"maas-api-7f5c9bcb67-g6g9n\" (UID: \"cde4852e-a681-434e-af2a-f37c74dec093\") " pod="odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n"
Oct 31 00:15:14.011169 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:14.011131    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8cvw\" (UniqueName: \"kubernetes.io/projected/cde4852e-a681-434e-af2a-f37c74dec093-kube-api-access-m8cvw\") pod \"maas-api-7f5c9bcb67-g6g9n\" (UID: \"cde4852e-a681-434e-af2a-f37c74dec093\") " pod="odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n"
Oct 31 00:15:14.011169 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:14.011170    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cde4852e-a681-434e-af2a-f37c74dec093-metrics-certs\") pod \"maas-api-7f5c9bcb67-g6g9n\" (UID: \"cde4852e-a681-434e-af2a-f37c74dec093\") " pod="odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n"
Oct 31 00:15:14.011436 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:14.011234    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cde4852e-a681-434e-af2a-f37c74dec093-maas-api-tls\") pod \"maas-api-7f5c9bcb67-g6g9n\" (UID: \"cde4852e-a681-434e-af2a-f37c74dec093\") " pod="odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n"
Oct 31 00:15:14.011436 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:14.011295    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cde4852e-a681-434e-af2a-f37c74dec093-openshift-service-ca\") pod \"maas-api-7f5c9bcb67-g6g9n\" (UID: \"cde4852e-a681-434e-af2a-f37c74dec093\") " pod="odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n"
Oct 31 00:15:14.012064 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:14.012033    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cde4852e-a681-434e-af2a-f37c74dec093-openshift-service-ca\") pod \"maas-api-7f5c9bcb67-g6g9n\" (UID: \"cde4852e-a681-434e-af2a-f37c74dec093\") " pod="odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n"
Oct 31 00:15:14.013989 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:14.013966    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cde4852e-a681-434e-af2a-f37c74dec093-metrics-certs\") pod \"maas-api-7f5c9bcb67-g6g9n\" (UID: \"cde4852e-a681-434e-af2a-f37c74dec093\") " pod="odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n"
Oct 31 00:15:14.014119 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:14.014023    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cde4852e-a681-434e-af2a-f37c74dec093-maas-api-tls\") pod \"maas-api-7f5c9bcb67-g6g9n\" (UID: \"cde4852e-a681-434e-af2a-f37c74dec093\") " pod="odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n"
Oct 31 00:15:14.023608 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:14.023562    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8cvw\" (UniqueName: \"kubernetes.io/projected/cde4852e-a681-434e-af2a-f37c74dec093-kube-api-access-m8cvw\") pod \"maas-api-7f5c9bcb67-g6g9n\" (UID: \"cde4852e-a681-434e-af2a-f37c74dec093\") " pod="odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n"
Oct 31 00:15:14.177263 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:14.177220    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n"
Oct 31 00:15:14.457221 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:14.457195    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n"]
Oct 31 00:15:14.459349 ip-10-0-142-208 kubenswrapper[4921]: W1031 00:15:14.459318    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde4852e_a681_434e_af2a_f37c74dec093.slice/crio-e1e9ac48932ad8bb0b70b6289d0e503d19de4cae0128d71fa33cc4e1402cd0fb WatchSource:0}: Error finding container e1e9ac48932ad8bb0b70b6289d0e503d19de4cae0128d71fa33cc4e1402cd0fb: Status 404 returned error can't find the container with id e1e9ac48932ad8bb0b70b6289d0e503d19de4cae0128d71fa33cc4e1402cd0fb
Oct 31 00:15:14.460847 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:14.460830    4921 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:15:15.318239 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:15.318146    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n" event={"ID":"cde4852e-a681-434e-af2a-f37c74dec093","Type":"ContainerStarted","Data":"6235e47ad9303314107ee8f3333d9024010067f1674f1dd68b38fb743aec5d25"}
Oct 31 00:15:15.318239 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:15.318195    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n" event={"ID":"cde4852e-a681-434e-af2a-f37c74dec093","Type":"ContainerStarted","Data":"e1e9ac48932ad8bb0b70b6289d0e503d19de4cae0128d71fa33cc4e1402cd0fb"}
Oct 31 00:15:15.318239 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:15.318235    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n"
Oct 31 00:15:15.340274 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:15.340226    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n" podStartSLOduration=1.829155894 podStartE2EDuration="2.340210189s" totalImagesPullingTime="511.054295ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:15:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:15:15.338405399 +0000 UTC m=+3374.583261167" watchObservedRunningTime="2026-10-31 00:15:15.340210189 +0000 UTC m=+3374.585065955"
Oct 31 00:15:16.962607 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:16.962561    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:20.777738 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:20.777709    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:21.067171 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:21.067092    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:21.328632 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:21.328534    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7f5c9bcb67-g6g9n"
Oct 31 00:15:21.607399 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:21.607253    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:21.806768 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:21.806732    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:24.510918 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:24.510885    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:24.651413 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:24.651384    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:25.655717 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.655687    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:25.697936 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.697905    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2"]
Oct 31 00:15:25.702021 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.701994    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2"
Oct 31 00:15:25.710106 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.710079    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-48ebba5a\""
Oct 31 00:15:25.711019 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.710996    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2"]
Oct 31 00:15:25.728004 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.727980    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6"]
Oct 31 00:15:25.732354 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.732317    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6"
Oct 31 00:15:25.749838 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.749811    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6"]
Oct 31 00:15:25.754913 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.754891    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-48ebba5a-dockercfg-7cj7p\""
Oct 31 00:15:25.789010 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.788975    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:25.842083 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.842055    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36e419c4-94cc-4d5f-92c9-3dbbef18834a-plugins-config-volume\") pod \"payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6\" (UID: \"36e419c4-94cc-4d5f-92c9-3dbbef18834a\") " pod="openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6"
Oct 31 00:15:25.842251 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.842100    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx2tm\" (UniqueName: \"kubernetes.io/projected/0db5a13d-71d9-4ad1-8ede-aed7ecf36042-kube-api-access-tx2tm\") pod \"payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2\" (UID: \"0db5a13d-71d9-4ad1-8ede-aed7ecf36042\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2"
Oct 31 00:15:25.842304 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.842247    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0db5a13d-71d9-4ad1-8ede-aed7ecf36042-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2\" (UID: \"0db5a13d-71d9-4ad1-8ede-aed7ecf36042\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2"
Oct 31 00:15:25.842362 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.842346    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khr7f\" (UniqueName: \"kubernetes.io/projected/36e419c4-94cc-4d5f-92c9-3dbbef18834a-kube-api-access-khr7f\") pod \"payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6\" (UID: \"36e419c4-94cc-4d5f-92c9-3dbbef18834a\") " pod="openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6"
Oct 31 00:15:25.923905 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.923802    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:25.943914 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.943879    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36e419c4-94cc-4d5f-92c9-3dbbef18834a-plugins-config-volume\") pod \"payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6\" (UID: \"36e419c4-94cc-4d5f-92c9-3dbbef18834a\") " pod="openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6"
Oct 31 00:15:25.944077 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.943924    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx2tm\" (UniqueName: \"kubernetes.io/projected/0db5a13d-71d9-4ad1-8ede-aed7ecf36042-kube-api-access-tx2tm\") pod \"payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2\" (UID: \"0db5a13d-71d9-4ad1-8ede-aed7ecf36042\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2"
Oct 31 00:15:25.944077 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.943991    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0db5a13d-71d9-4ad1-8ede-aed7ecf36042-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2\" (UID: \"0db5a13d-71d9-4ad1-8ede-aed7ecf36042\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2"
Oct 31 00:15:25.944077 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.944041    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khr7f\" (UniqueName: \"kubernetes.io/projected/36e419c4-94cc-4d5f-92c9-3dbbef18834a-kube-api-access-khr7f\") pod \"payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6\" (UID: \"36e419c4-94cc-4d5f-92c9-3dbbef18834a\") " pod="openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6"
Oct 31 00:15:25.944685 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.944667    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36e419c4-94cc-4d5f-92c9-3dbbef18834a-plugins-config-volume\") pod \"payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6\" (UID: \"36e419c4-94cc-4d5f-92c9-3dbbef18834a\") " pod="openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6"
Oct 31 00:15:25.944806 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.944786    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0db5a13d-71d9-4ad1-8ede-aed7ecf36042-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2\" (UID: \"0db5a13d-71d9-4ad1-8ede-aed7ecf36042\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2"
Oct 31 00:15:25.956492 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.956465    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx2tm\" (UniqueName: \"kubernetes.io/projected/0db5a13d-71d9-4ad1-8ede-aed7ecf36042-kube-api-access-tx2tm\") pod \"payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2\" (UID: \"0db5a13d-71d9-4ad1-8ede-aed7ecf36042\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2"
Oct 31 00:15:25.956642 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:25.956524    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khr7f\" (UniqueName: \"kubernetes.io/projected/36e419c4-94cc-4d5f-92c9-3dbbef18834a-kube-api-access-khr7f\") pod \"payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6\" (UID: \"36e419c4-94cc-4d5f-92c9-3dbbef18834a\") " pod="openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6"
Oct 31 00:15:26.017942 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:26.017912    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2"
Oct 31 00:15:26.060272 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:26.060235    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6"
Oct 31 00:15:26.302075 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:26.301984    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2"]
Oct 31 00:15:26.307447 ip-10-0-142-208 kubenswrapper[4921]: W1031 00:15:26.307413    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db5a13d_71d9_4ad1_8ede_aed7ecf36042.slice/crio-de750c9cb728b10bc19df778c5df5849b05bf62168e09a7c2440ad609987fe1d WatchSource:0}: Error finding container de750c9cb728b10bc19df778c5df5849b05bf62168e09a7c2440ad609987fe1d: Status 404 returned error can't find the container with id de750c9cb728b10bc19df778c5df5849b05bf62168e09a7c2440ad609987fe1d
Oct 31 00:15:26.359340 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:26.359314    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6"]
Oct 31 00:15:26.389653 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:26.389584    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6" event={"ID":"36e419c4-94cc-4d5f-92c9-3dbbef18834a","Type":"ContainerStarted","Data":"a878d514eb459dc604b9f5224e0b2b9d1fcc8bc74bbed70f903a2d855d2255a3"}
Oct 31 00:15:26.391499 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:26.391473    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2" event={"ID":"0db5a13d-71d9-4ad1-8ede-aed7ecf36042","Type":"ContainerStarted","Data":"de750c9cb728b10bc19df778c5df5849b05bf62168e09a7c2440ad609987fe1d"}
Oct 31 00:15:26.681017 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:26.680654    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:27.353097 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:27.353064    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:27.398336 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:27.398294    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2" event={"ID":"0db5a13d-71d9-4ad1-8ede-aed7ecf36042","Type":"ContainerStarted","Data":"2a94cb586833309b8647699361fb223d4dbb95e999f3dad3a7598de17e954845"}
Oct 31 00:15:27.398575 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:27.398374    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2"
Oct 31 00:15:27.399987 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:27.399962    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6" event={"ID":"36e419c4-94cc-4d5f-92c9-3dbbef18834a","Type":"ContainerStarted","Data":"6cce84ecf60561a1523a9174bc33c696088235e2c044d98844675a3a3393185d"}
Oct 31 00:15:27.400099 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:27.400023    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6"
Oct 31 00:15:27.419180 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:27.419138    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2" podStartSLOduration=2.419125459 podStartE2EDuration="2.419125459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:15:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:15:27.416388863 +0000 UTC m=+3386.661244631" watchObservedRunningTime="2026-10-31 00:15:27.419125459 +0000 UTC m=+3386.663981228"
Oct 31 00:15:27.437993 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:27.437949    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6" podStartSLOduration=2.437936893 podStartE2EDuration="2.437936893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:15:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:15:27.435957099 +0000 UTC m=+3386.680812867" watchObservedRunningTime="2026-10-31 00:15:27.437936893 +0000 UTC m=+3386.682792661"
Oct 31 00:15:28.279355 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:28.279316    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:28.967378 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:28.967342    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"]
Oct 31 00:15:28.967579 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:28.967556    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk" podUID="53817341-d005-4c2f-b1f9-925dbc988568" containerName="maas-api" containerID="cri-o://04ae6325c6589eb413b63bda6a01cb0cadc23af200ec3030f04019de456ece42" gracePeriod=30
Oct 31 00:15:29.034163 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:29.034128    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:29.729437 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:29.729402    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:30.216825 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.216797    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"
Oct 31 00:15:30.399390 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.399362    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/53817341-d005-4c2f-b1f9-925dbc988568-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53817341-d005-4c2f-b1f9-925dbc988568-maas-api-tls\") pod \"53817341-d005-4c2f-b1f9-925dbc988568\" (UID: \"53817341-d005-4c2f-b1f9-925dbc988568\") "
Oct 31 00:15:30.399632 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.399419    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/53817341-d005-4c2f-b1f9-925dbc988568-metrics-certs\" (UniqueName: \"kubernetes.io/secret/53817341-d005-4c2f-b1f9-925dbc988568-metrics-certs\") pod \"53817341-d005-4c2f-b1f9-925dbc988568\" (UID: \"53817341-d005-4c2f-b1f9-925dbc988568\") "
Oct 31 00:15:30.399632 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.399463    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53817341-d005-4c2f-b1f9-925dbc988568-kube-api-access-vxhn5\" (UniqueName: \"kubernetes.io/projected/53817341-d005-4c2f-b1f9-925dbc988568-kube-api-access-vxhn5\") pod \"53817341-d005-4c2f-b1f9-925dbc988568\" (UID: \"53817341-d005-4c2f-b1f9-925dbc988568\") "
Oct 31 00:15:30.399632 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.399499    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/53817341-d005-4c2f-b1f9-925dbc988568-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53817341-d005-4c2f-b1f9-925dbc988568-openshift-service-ca\") pod \"53817341-d005-4c2f-b1f9-925dbc988568\" (UID: \"53817341-d005-4c2f-b1f9-925dbc988568\") "
Oct 31 00:15:30.400029 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.399997    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53817341-d005-4c2f-b1f9-925dbc988568-openshift-service-ca" pod "53817341-d005-4c2f-b1f9-925dbc988568" (UID: "53817341-d005-4c2f-b1f9-925dbc988568"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:15:30.401932 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.401906    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53817341-d005-4c2f-b1f9-925dbc988568-metrics-certs" pod "53817341-d005-4c2f-b1f9-925dbc988568" (UID: "53817341-d005-4c2f-b1f9-925dbc988568"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:15:30.401932 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.401922    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53817341-d005-4c2f-b1f9-925dbc988568-kube-api-access-vxhn5" pod "53817341-d005-4c2f-b1f9-925dbc988568" (UID: "53817341-d005-4c2f-b1f9-925dbc988568"). InnerVolumeSpecName "kube-api-access-vxhn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:15:30.402079 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.401998    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53817341-d005-4c2f-b1f9-925dbc988568-maas-api-tls" pod "53817341-d005-4c2f-b1f9-925dbc988568" (UID: "53817341-d005-4c2f-b1f9-925dbc988568"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:15:30.418399 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.418368    4921 generic.go:356] "Generic (PLEG): container finished" podID="53817341-d005-4c2f-b1f9-925dbc988568" containerID="04ae6325c6589eb413b63bda6a01cb0cadc23af200ec3030f04019de456ece42" exitCode=0
Oct 31 00:15:30.418502 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.418408    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk" event={"ID":"53817341-d005-4c2f-b1f9-925dbc988568","Type":"ContainerDied","Data":"04ae6325c6589eb413b63bda6a01cb0cadc23af200ec3030f04019de456ece42"}
Oct 31 00:15:30.418502 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.418420    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"
Oct 31 00:15:30.418502 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.418473    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk" event={"ID":"53817341-d005-4c2f-b1f9-925dbc988568","Type":"ContainerDied","Data":"f962b5d4da7c5546652ff19d0da133d3784025ee220e37f7576747e7ba193ae4"}
Oct 31 00:15:30.418502 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.418497    4921 scope.go:122] "RemoveContainer" containerID="04ae6325c6589eb413b63bda6a01cb0cadc23af200ec3030f04019de456ece42"
Oct 31 00:15:30.428669 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.428647    4921 scope.go:122] "RemoveContainer" containerID="04ae6325c6589eb413b63bda6a01cb0cadc23af200ec3030f04019de456ece42"
Oct 31 00:15:30.428960 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:15:30.428936    4921 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04ae6325c6589eb413b63bda6a01cb0cadc23af200ec3030f04019de456ece42\": container with ID starting with 04ae6325c6589eb413b63bda6a01cb0cadc23af200ec3030f04019de456ece42 not found: ID does not exist" containerID="04ae6325c6589eb413b63bda6a01cb0cadc23af200ec3030f04019de456ece42"
Oct 31 00:15:30.429014 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.428974    4921 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ae6325c6589eb413b63bda6a01cb0cadc23af200ec3030f04019de456ece42"} err="failed to get container status \"04ae6325c6589eb413b63bda6a01cb0cadc23af200ec3030f04019de456ece42\": rpc error: code = NotFound desc = could not find container \"04ae6325c6589eb413b63bda6a01cb0cadc23af200ec3030f04019de456ece42\": container with ID starting with 04ae6325c6589eb413b63bda6a01cb0cadc23af200ec3030f04019de456ece42 not found: ID does not exist"
Oct 31 00:15:30.479702 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.479673    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"]
Oct 31 00:15:30.500949 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.500924    4921 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53817341-d005-4c2f-b1f9-925dbc988568-maas-api-tls\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:30.500949 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.500949    4921 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53817341-d005-4c2f-b1f9-925dbc988568-metrics-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:30.501105 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.500958    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxhn5\" (UniqueName: \"kubernetes.io/projected/53817341-d005-4c2f-b1f9-925dbc988568-kube-api-access-vxhn5\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:30.501105 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.500968    4921 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53817341-d005-4c2f-b1f9-925dbc988568-openshift-service-ca\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:30.504014 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.503982    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-55477bdbbc-c8swk"]
Oct 31 00:15:30.630779 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.630747    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:30.881908 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:30.881843    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="53817341-d005-4c2f-b1f9-925dbc988568" path="/var/lib/kubelet/pods/53817341-d005-4c2f-b1f9-925dbc988568/volumes"
Oct 31 00:15:31.328124 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:31.328084    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:32.052983 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:32.052901    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:32.740226 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:32.740189    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:33.438603 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:33.438564    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:34.289954 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:34.289916    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:35.010319 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:35.010290    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:35.635284 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:35.635251    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:36.339204 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:36.339167    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:37.044950 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:37.044915    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:37.739541 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:37.739510    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:38.408718 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:38.408688    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2"
Oct 31 00:15:38.408907 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:38.408885    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6"
Oct 31 00:15:38.455974 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:38.455943    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:39.213076 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:39.213042    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:39.835346 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:39.835310    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:40.938422 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:40.938387    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:41.403817 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:15:41.403782    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:15:41.639238 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:41.639203    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:42.344872 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:42.344833    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:43.129164 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:43.129128    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:43.836810 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:43.836782    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:44.530251 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:44.530225    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:45.221840 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:45.221811    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:45.928180 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:45.928140    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:46.630678 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:46.630630    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:47.432872 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:47.432834    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:48.142397 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:48.142360    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:48.838746 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:48.838714    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:49.532051 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:49.531992    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:50.222923 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:50.222882    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:50.415217 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:50.415180    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6"]
Oct 31 00:15:50.418236 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:50.418209    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2"]
Oct 31 00:15:50.512122 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:50.512034    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:50.640296 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:50.640264    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:50.988998 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:50.988955    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:51.120833 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:51.120774    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:51.254169 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:51.254083    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:55.416522 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.416466    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6" podUID="36e419c4-94cc-4d5f-92c9-3dbbef18834a" containerName="payload-processing" containerID="cri-o://6cce84ecf60561a1523a9174bc33c696088235e2c044d98844675a3a3393185d" gracePeriod=25
Oct 31 00:15:55.419011 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.418983    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2" podUID="0db5a13d-71d9-4ad1-8ede-aed7ecf36042" containerName="payload-pre-processing" containerID="cri-o://2a94cb586833309b8647699361fb223d4dbb95e999f3dad3a7598de17e954845" gracePeriod=25
Oct 31 00:15:55.554851 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.554821    4921 generic.go:356] "Generic (PLEG): container finished" podID="36e419c4-94cc-4d5f-92c9-3dbbef18834a" containerID="6cce84ecf60561a1523a9174bc33c696088235e2c044d98844675a3a3393185d" exitCode=0
Oct 31 00:15:55.555000 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.554902    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6" event={"ID":"36e419c4-94cc-4d5f-92c9-3dbbef18834a","Type":"ContainerDied","Data":"6cce84ecf60561a1523a9174bc33c696088235e2c044d98844675a3a3393185d"}
Oct 31 00:15:55.556779 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.556754    4921 generic.go:356] "Generic (PLEG): container finished" podID="0db5a13d-71d9-4ad1-8ede-aed7ecf36042" containerID="2a94cb586833309b8647699361fb223d4dbb95e999f3dad3a7598de17e954845" exitCode=0
Oct 31 00:15:55.556904 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.556796    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2" event={"ID":"0db5a13d-71d9-4ad1-8ede-aed7ecf36042","Type":"ContainerDied","Data":"2a94cb586833309b8647699361fb223d4dbb95e999f3dad3a7598de17e954845"}
Oct 31 00:15:55.574669 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.574629    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:55.682185 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.682121    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2"
Oct 31 00:15:55.719272 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.719248    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6"
Oct 31 00:15:55.768361 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.768326    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0db5a13d-71d9-4ad1-8ede-aed7ecf36042-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0db5a13d-71d9-4ad1-8ede-aed7ecf36042-plugins-config-volume\") pod \"0db5a13d-71d9-4ad1-8ede-aed7ecf36042\" (UID: \"0db5a13d-71d9-4ad1-8ede-aed7ecf36042\") "
Oct 31 00:15:55.768521 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.768460    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0db5a13d-71d9-4ad1-8ede-aed7ecf36042-kube-api-access-tx2tm\" (UniqueName: \"kubernetes.io/projected/0db5a13d-71d9-4ad1-8ede-aed7ecf36042-kube-api-access-tx2tm\") pod \"0db5a13d-71d9-4ad1-8ede-aed7ecf36042\" (UID: \"0db5a13d-71d9-4ad1-8ede-aed7ecf36042\") "
Oct 31 00:15:55.768773 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.768746    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0db5a13d-71d9-4ad1-8ede-aed7ecf36042-plugins-config-volume" pod "0db5a13d-71d9-4ad1-8ede-aed7ecf36042" (UID: "0db5a13d-71d9-4ad1-8ede-aed7ecf36042"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:15:55.770656 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.770632    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0db5a13d-71d9-4ad1-8ede-aed7ecf36042-kube-api-access-tx2tm" pod "0db5a13d-71d9-4ad1-8ede-aed7ecf36042" (UID: "0db5a13d-71d9-4ad1-8ede-aed7ecf36042"). InnerVolumeSpecName "kube-api-access-tx2tm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:15:55.869540 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.869513    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/36e419c4-94cc-4d5f-92c9-3dbbef18834a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36e419c4-94cc-4d5f-92c9-3dbbef18834a-plugins-config-volume\") pod \"36e419c4-94cc-4d5f-92c9-3dbbef18834a\" (UID: \"36e419c4-94cc-4d5f-92c9-3dbbef18834a\") "
Oct 31 00:15:55.869728 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.869547    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36e419c4-94cc-4d5f-92c9-3dbbef18834a-kube-api-access-khr7f\" (UniqueName: \"kubernetes.io/projected/36e419c4-94cc-4d5f-92c9-3dbbef18834a-kube-api-access-khr7f\") pod \"36e419c4-94cc-4d5f-92c9-3dbbef18834a\" (UID: \"36e419c4-94cc-4d5f-92c9-3dbbef18834a\") "
Oct 31 00:15:55.869914 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.869887    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx2tm\" (UniqueName: \"kubernetes.io/projected/0db5a13d-71d9-4ad1-8ede-aed7ecf36042-kube-api-access-tx2tm\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:55.870020 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.869917    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0db5a13d-71d9-4ad1-8ede-aed7ecf36042-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:55.870020 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.869938    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36e419c4-94cc-4d5f-92c9-3dbbef18834a-plugins-config-volume" pod "36e419c4-94cc-4d5f-92c9-3dbbef18834a" (UID: "36e419c4-94cc-4d5f-92c9-3dbbef18834a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:15:55.871874 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.871855    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36e419c4-94cc-4d5f-92c9-3dbbef18834a-kube-api-access-khr7f" pod "36e419c4-94cc-4d5f-92c9-3dbbef18834a" (UID: "36e419c4-94cc-4d5f-92c9-3dbbef18834a"). InnerVolumeSpecName "kube-api-access-khr7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:15:55.970738 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.970661    4921 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36e419c4-94cc-4d5f-92c9-3dbbef18834a-plugins-config-volume\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:55.970738 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:55.970697    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khr7f\" (UniqueName: \"kubernetes.io/projected/36e419c4-94cc-4d5f-92c9-3dbbef18834a-kube-api-access-khr7f\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:56.133904 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:56.133871    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:56.563222 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:56.563194    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2"
Oct 31 00:15:56.563803 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:56.563230    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2" event={"ID":"0db5a13d-71d9-4ad1-8ede-aed7ecf36042","Type":"ContainerDied","Data":"de750c9cb728b10bc19df778c5df5849b05bf62168e09a7c2440ad609987fe1d"}
Oct 31 00:15:56.563803 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:56.563291    4921 scope.go:122] "RemoveContainer" containerID="2a94cb586833309b8647699361fb223d4dbb95e999f3dad3a7598de17e954845"
Oct 31 00:15:56.564742 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:56.564727    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6"
Oct 31 00:15:56.564742 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:56.564726    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6" event={"ID":"36e419c4-94cc-4d5f-92c9-3dbbef18834a","Type":"ContainerDied","Data":"a878d514eb459dc604b9f5224e0b2b9d1fcc8bc74bbed70f903a2d855d2255a3"}
Oct 31 00:15:56.574100 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:56.574077    4921 scope.go:122] "RemoveContainer" containerID="6cce84ecf60561a1523a9174bc33c696088235e2c044d98844675a3a3393185d"
Oct 31 00:15:56.586861 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:56.586838    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2"]
Oct 31 00:15:56.591514 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:56.591494    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-48ebba5a-7db4767579-8hvl2"]
Oct 31 00:15:56.603513 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:56.603493    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6"]
Oct 31 00:15:56.606349 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:56.606330    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-48ebba5a-5c8d976d87-scdc6"]
Oct 31 00:15:56.733712 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:56.733631    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:56.885220 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:56.885189    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0db5a13d-71d9-4ad1-8ede-aed7ecf36042" path="/var/lib/kubelet/pods/0db5a13d-71d9-4ad1-8ede-aed7ecf36042/volumes"
Oct 31 00:15:56.885549 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:56.885537    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36e419c4-94cc-4d5f-92c9-3dbbef18834a" path="/var/lib/kubelet/pods/36e419c4-94cc-4d5f-92c9-3dbbef18834a/volumes"
Oct 31 00:15:58.047515 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.047486    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:58.419070 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.419037    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"]
Oct 31 00:15:58.419464 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.419451    4921 cpu_manager.go:414] "containerMap: removing container" podUID="0db5a13d-71d9-4ad1-8ede-aed7ecf36042" containerName="payload-pre-processing"
Oct 31 00:15:58.419521 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.419465    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0db5a13d-71d9-4ad1-8ede-aed7ecf36042" containerName="payload-pre-processing"
Oct 31 00:15:58.419521 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.419498    4921 cpu_manager.go:414] "containerMap: removing container" podUID="36e419c4-94cc-4d5f-92c9-3dbbef18834a" containerName="payload-processing"
Oct 31 00:15:58.419521 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.419504    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36e419c4-94cc-4d5f-92c9-3dbbef18834a" containerName="payload-processing"
Oct 31 00:15:58.419521 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.419515    4921 cpu_manager.go:414] "containerMap: removing container" podUID="53817341-d005-4c2f-b1f9-925dbc988568" containerName="maas-api"
Oct 31 00:15:58.419521 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.419520    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="53817341-d005-4c2f-b1f9-925dbc988568" containerName="maas-api"
Oct 31 00:15:58.419731 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.419583    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="36e419c4-94cc-4d5f-92c9-3dbbef18834a" containerName="payload-processing"
Oct 31 00:15:58.419731 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.419610    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="53817341-d005-4c2f-b1f9-925dbc988568" containerName="maas-api"
Oct 31 00:15:58.419731 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.419625    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="0db5a13d-71d9-4ad1-8ede-aed7ecf36042" containerName="payload-pre-processing"
Oct 31 00:15:58.424069 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.424043    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.440121 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.440098    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-authcfg-http-b33f34-openshift-default-dockercfg-f2fmk\""
Oct 31 00:15:58.449333 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.449305    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"]
Oct 31 00:15:58.495821 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.495794    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-istio-envoy\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.495999 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.495830    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-istio-data\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.495999 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.495858    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-workload-certs\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.496128 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.496012    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxb5n\" (UniqueName: \"kubernetes.io/projected/04322af5-a528-4dff-a008-62034273f5a0-kube-api-access-kxb5n\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.496128 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.496061    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04322af5-a528-4dff-a008-62034273f5a0-istio-token\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.496210 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.496140    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-credential-socket\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.496210 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.496188    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04322af5-a528-4dff-a008-62034273f5a0-istiod-ca-cert\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.496365 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.496347    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-workload-socket\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.496415 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.496378    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04322af5-a528-4dff-a008-62034273f5a0-istio-podinfo\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.504994 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.504968    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:58.608616 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.600816    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-workload-socket\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.608616 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.600863    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04322af5-a528-4dff-a008-62034273f5a0-istio-podinfo\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.608616 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.600915    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-istio-envoy\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.608616 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.600944    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-istio-data\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.608616 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.600967    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-workload-certs\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.608616 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.601011    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxb5n\" (UniqueName: \"kubernetes.io/projected/04322af5-a528-4dff-a008-62034273f5a0-kube-api-access-kxb5n\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.608616 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.601041    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04322af5-a528-4dff-a008-62034273f5a0-istio-token\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.608616 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.601074    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-credential-socket\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.608616 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.601105    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04322af5-a528-4dff-a008-62034273f5a0-istiod-ca-cert\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.608616 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.601760    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-workload-socket\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.608616 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.601901    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04322af5-a528-4dff-a008-62034273f5a0-istiod-ca-cert\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.608616 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.602095    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-workload-certs\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.608616 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.602777    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-credential-socket\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.608616 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.603296    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-istio-data\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.617623 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.610351    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04322af5-a528-4dff-a008-62034273f5a0-istio-podinfo\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.620513 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.620460    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxb5n\" (UniqueName: \"kubernetes.io/projected/04322af5-a528-4dff-a008-62034273f5a0-kube-api-access-kxb5n\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.621117 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.621086    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-istio-envoy\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.622947 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.622925    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04322af5-a528-4dff-a008-62034273f5a0-istio-token\") pod \"e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") " pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:58.638818 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.638794    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:15:58.737304 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:58.737228    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:15:59.020256 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:59.020230    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"]
Oct 31 00:15:59.022629 ip-10-0-142-208 kubenswrapper[4921]: W1031 00:15:59.022581    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04322af5_a528_4dff_a008_62034273f5a0.slice/crio-760f50fe73c86e5c0058a227d3674be683bd81f73eee4ca4e0d994c41ae7fab7 WatchSource:0}: Error finding container 760f50fe73c86e5c0058a227d3674be683bd81f73eee4ca4e0d994c41ae7fab7: Status 404 returned error can't find the container with id 760f50fe73c86e5c0058a227d3674be683bd81f73eee4ca4e0d994c41ae7fab7
Oct 31 00:15:59.024775 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:59.024734    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 31 00:15:59.024866 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:59.024803    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 31 00:15:59.024866 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:59.024834    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 31 00:15:59.594963 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:59.594927    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m" event={"ID":"04322af5-a528-4dff-a008-62034273f5a0","Type":"ContainerStarted","Data":"f6c140de4b8fa16515ef5a48f0ef528e08cf29de1f454f72c13128447e93083c"}
Oct 31 00:15:59.595374 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:59.594981    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m" event={"ID":"04322af5-a528-4dff-a008-62034273f5a0","Type":"ContainerStarted","Data":"760f50fe73c86e5c0058a227d3674be683bd81f73eee4ca4e0d994c41ae7fab7"}
Oct 31 00:15:59.620093 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:59.620045    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m" podStartSLOduration=1.620031775 podStartE2EDuration="1.620031775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:15:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:15:59.618404651 +0000 UTC m=+3418.863260419" watchObservedRunningTime="2026-10-31 00:15:59.620031775 +0000 UTC m=+3418.864887542"
Oct 31 00:15:59.742381 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:15:59.742274    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:16:00.743341 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:00.743301    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:16:01.604970 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:01.604940    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:16:01.605912 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:01.605890    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:16:01.921116 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:01.921083    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:02.054769 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:02.054714    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:03.138892 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:03.138851    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:03.313196 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:03.313153    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:03.511669 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:03.511536    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:03.942419 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:03.942369    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:04.652364 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:04.652307    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:05.477061 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:05.477011    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:06.323161 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:06.323122    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:07.074636 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:07.074030    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:07.860279 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:07.860239    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:08.658037 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:08.657999    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:09.447531 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:09.447488    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:10.257240 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:10.257198    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:11.050821 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:11.050780    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:11.421151 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:16:11.421112    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:16:11.856231 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:11.856136    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:12.633993 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:12.633960    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:13.361283 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:13.361191    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:14.123571 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:14.123541    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:14.837847 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:14.837803    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:15.522697 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:15.522605    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:15.704177 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:15.704144    4921 generic.go:356] "Generic (PLEG): container finished" podID="04322af5-a528-4dff-a008-62034273f5a0" containerID="f6c140de4b8fa16515ef5a48f0ef528e08cf29de1f454f72c13128447e93083c" exitCode=0
Oct 31 00:16:15.704380 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:15.704212    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m" event={"ID":"04322af5-a528-4dff-a008-62034273f5a0","Type":"ContainerDied","Data":"f6c140de4b8fa16515ef5a48f0ef528e08cf29de1f454f72c13128447e93083c"}
Oct 31 00:16:15.704659 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:15.704638    4921 scope.go:122] "RemoveContainer" containerID="f6c140de4b8fa16515ef5a48f0ef528e08cf29de1f454f72c13128447e93083c"
Oct 31 00:16:15.705871 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:15.705842    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 31 00:16:15.705944 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:15.705924    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 31 00:16:15.705984 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:15.705959    4921 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Oct 31 00:16:16.247626 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:16.240233    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:16.605176 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:16.605084    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:16:16.710855 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:16.710822    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m" event={"ID":"04322af5-a528-4dff-a008-62034273f5a0","Type":"ContainerStarted","Data":"3ed719a555a98b2ac855af9c2f1719f2653601a4a752931c91ef6e0b99d8833a"}
Oct 31 00:16:16.737977 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:16.737951    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:16:16.739315 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:16.739288    4921 patch_prober.go:29] interesting pod/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused" start-of-body=
Oct 31 00:16:16.739450 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:16.739335    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m" podUID="04322af5-a528-4dff-a008-62034273f5a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused"
Oct 31 00:16:17.029801 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:17.029770    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:17.162502 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:17.162462    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:17.738008 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:17.737970    4921 patch_prober.go:29] interesting pod/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused" start-of-body=
Oct 31 00:16:17.738425 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:17.738019    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m" podUID="04322af5-a528-4dff-a008-62034273f5a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused"
Oct 31 00:16:17.919823 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:17.919791    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:18.666371 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:18.666335    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:18.738042 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:18.738008    4921 patch_prober.go:29] interesting pod/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused" start-of-body=
Oct 31 00:16:18.738459 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:18.738068    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m" podUID="04322af5-a528-4dff-a008-62034273f5a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused"
Oct 31 00:16:19.589619 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:19.584616    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:19.737786 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:19.737752    4921 patch_prober.go:29] interesting pod/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused" start-of-body=
Oct 31 00:16:19.737984 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:19.737812    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m" podUID="04322af5-a528-4dff-a008-62034273f5a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused"
Oct 31 00:16:20.383370 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:20.383335    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:20.738077 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:20.737985    4921 patch_prober.go:29] interesting pod/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused" start-of-body=
Oct 31 00:16:20.738077 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:20.738047    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m" podUID="04322af5-a528-4dff-a008-62034273f5a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused"
Oct 31 00:16:21.151611 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:21.151562    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:21.737695 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:21.737658    4921 patch_prober.go:29] interesting pod/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused" start-of-body=
Oct 31 00:16:21.738136 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:21.737741    4921 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m" podUID="04322af5-a528-4dff-a008-62034273f5a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused"
Oct 31 00:16:21.954140 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:21.954105    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:22.625607 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:22.625555    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:22.742668 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:22.742642    4921 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:16:22.743078 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:22.742937    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:16:22.743665 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:22.743646    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:16:23.423670 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:23.423638    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:24.143783 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:24.143739    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:24.837923 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:24.837879    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:25.752218 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:25.752176    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:26.440212 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:26.440179    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:27.346857 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:27.346820    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:28.036125 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:28.036086    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:28.746508 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:28.746468    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:29.441135 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:29.441101    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:30.224420 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:30.224385    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:30.928906 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:30.928868    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:31.683437 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:31.683383    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:32.446786 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:32.446752    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:33.125095 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:33.125056    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:33.872158 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:33.872100    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:34.575547 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:34.575507    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:35.341493 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:35.341463    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:36.030174 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:36.030128    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:36.773616 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:36.769960    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:37.555450 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:37.555387    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:38.355636 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:38.352292    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:39.074619 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:39.073855    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:39.741494 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:39.741456    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:40.654997 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:40.654951    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:41.351332 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:41.351294    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:41.402588 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:16:41.402551    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:16:42.017807 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:42.017767    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:42.842853 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:42.842813    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:43.544103 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:43.544023    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:44.244629 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:44.244508    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:44.922718 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:44.922676    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:45.648693 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:45.648647    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:46.345386 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:46.345324    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:47.040883 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:47.040854    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:47.745308 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:47.745245    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:48.467741 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:48.467705    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:49.150117 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:49.150025    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:49.840466 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:49.840421    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:50.540504 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:50.540466    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:51.239192 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:51.239161    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:52.062029 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:52.061993    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:52.731007 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:52.730973    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:53.428984 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:53.428951    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:54.139039 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:54.139002    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:54.828950 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:54.828917    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:55.529321 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:55.529286    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:55.669192 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:55.669157    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:56.183105 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:56.183054    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:56.309337 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:56.309305    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:57.028857 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:57.028821    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:57.829911 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:57.829877    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:58.527129 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:58.527098    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:16:59.226417 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:16:59.226384    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:00.032330 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:00.032294    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:00.714520 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:00.714483    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:01.428956 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:01.428917    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:02.122017 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:02.121978    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:02.919306 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:02.919274    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:03.633908 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:03.633874    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:04.332722 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:04.332687    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:05.026162 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:05.026130    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:05.735581 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:05.735541    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:06.426519 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:06.426486    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:07.135044 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:07.135012    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:07.832168 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:07.832132    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:08.581467 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:08.581436    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:09.249918 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:09.249873    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:09.936541 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:09.936513    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:10.739625 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:10.739548    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:11.403650 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:17:11.403576    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:17:11.433489 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:11.433459    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:12.126238 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:12.126203    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:12.822401 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:12.822366    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:13.626448 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:13.626408    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:14.329424 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:14.329393    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:15.034206 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:15.034175    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:15.726175 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:15.726139    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:16.433138 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:16.433107    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:17.137110 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:17.137063    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:17.855162 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:17.855119    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:18.533929 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:18.533897    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:19.364046 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:19.364005    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:20.028163 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:20.028128    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:20.757533 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:20.747907    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:21.431185 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:21.431155    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:22.134833 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:22.134801    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:22.848582 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:22.848551    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:23.641213 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:23.641175    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:24.334684 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:24.334649    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:25.122770 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:25.122726    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:25.830172 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:25.830143    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:26.659514 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:26.659466    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:27.328263 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:27.328229    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:28.041874 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:28.041839    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:28.721791 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:28.721757    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:29.457179 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:29.456901    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:30.133210 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:30.133165    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:30.827364 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:30.827325    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:31.529024 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:31.528202    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:32.220981 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:32.220948    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:32.930533 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:32.930500    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:33.633679 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:33.633636    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:34.359810 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:34.359735    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:35.134003 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:35.133965    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:35.824622 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:35.824559    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:36.527827 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:36.527788    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:37.231917 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:37.231882    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:38.131112 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:38.131078    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:38.830199 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:38.830163    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:39.530028 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:39.529998    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:39.780270 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:39.780187    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:39.914292 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:39.914264    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:40.233159 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:40.233126    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:41.115983 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:41.114036    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:41.402815 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:17:41.402776    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:17:41.932535 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:41.932502    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:42.694779 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:42.694740    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:43.438574 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:43.438462    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:44.234227 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:44.234170    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:44.914271 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:44.914221    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:45.827689 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:45.827657    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:46.566627 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:46.566549    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:47.245655 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:47.245619    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:47.540960 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:47.540874    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:47.775225 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:47.775187    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:52.995480 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:52.995442    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:53.125353 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:53.125323    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:53.253953 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:53.253852    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:53.777045 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:53.777003    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:55.692353 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:55.692324    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:56.236502 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:56.236469    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:57.680945 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:57.680912    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:59.765884 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:59.765851    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:17:59.901609 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:17:59.901567    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:18:00.079132 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:00.079040    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"]
Oct 31 00:18:00.079341 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:00.079313    4921 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m" podUID="04322af5-a528-4dff-a008-62034273f5a0" containerName="istio-proxy" containerID="cri-o://3ed719a555a98b2ac855af9c2f1719f2653601a4a752931c91ef6e0b99d8833a" gracePeriod=30
Oct 31 00:18:00.138100 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:00.138066    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:18:05.331411 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.331366    4921 generic.go:356] "Generic (PLEG): container finished" podID="04322af5-a528-4dff-a008-62034273f5a0" containerID="3ed719a555a98b2ac855af9c2f1719f2653601a4a752931c91ef6e0b99d8833a" exitCode=0
Oct 31 00:18:05.332102 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.331432    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m" event={"ID":"04322af5-a528-4dff-a008-62034273f5a0","Type":"ContainerDied","Data":"3ed719a555a98b2ac855af9c2f1719f2653601a4a752931c91ef6e0b99d8833a"}
Oct 31 00:18:05.332102 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.331502    4921 scope.go:122] "RemoveContainer" containerID="f6c140de4b8fa16515ef5a48f0ef528e08cf29de1f454f72c13128447e93083c"
Oct 31 00:18:05.407775 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.407751    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:18:05.428911 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.428878    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-workload-certs\") pod \"04322af5-a528-4dff-a008-62034273f5a0\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") "
Oct 31 00:18:05.429085 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.428925    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-istio-data\") pod \"04322af5-a528-4dff-a008-62034273f5a0\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") "
Oct 31 00:18:05.429085 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.428985    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/04322af5-a528-4dff-a008-62034273f5a0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04322af5-a528-4dff-a008-62034273f5a0-istio-podinfo\") pod \"04322af5-a528-4dff-a008-62034273f5a0\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") "
Oct 31 00:18:05.429085 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.429026    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-workload-socket\") pod \"04322af5-a528-4dff-a008-62034273f5a0\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") "
Oct 31 00:18:05.429085 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.429057    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04322af5-a528-4dff-a008-62034273f5a0-istio-token\" (UniqueName: \"kubernetes.io/projected/04322af5-a528-4dff-a008-62034273f5a0-istio-token\") pod \"04322af5-a528-4dff-a008-62034273f5a0\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") "
Oct 31 00:18:05.429342 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.429184    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-workload-certs" pod "04322af5-a528-4dff-a008-62034273f5a0" (UID: "04322af5-a528-4dff-a008-62034273f5a0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:18:05.429342 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.429258    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-istio-data" pod "04322af5-a528-4dff-a008-62034273f5a0" (UID: "04322af5-a528-4dff-a008-62034273f5a0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:18:05.429342 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.429335    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-istio-envoy\") pod \"04322af5-a528-4dff-a008-62034273f5a0\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") "
Oct 31 00:18:05.429519 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.429445    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-workload-socket" pod "04322af5-a528-4dff-a008-62034273f5a0" (UID: "04322af5-a528-4dff-a008-62034273f5a0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:18:05.429519 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.429471    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/04322af5-a528-4dff-a008-62034273f5a0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04322af5-a528-4dff-a008-62034273f5a0-istiod-ca-cert\") pod \"04322af5-a528-4dff-a008-62034273f5a0\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") "
Oct 31 00:18:05.429519 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.429505    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04322af5-a528-4dff-a008-62034273f5a0-kube-api-access-kxb5n\" (UniqueName: \"kubernetes.io/projected/04322af5-a528-4dff-a008-62034273f5a0-kube-api-access-kxb5n\") pod \"04322af5-a528-4dff-a008-62034273f5a0\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") "
Oct 31 00:18:05.429745 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.429534    4921 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-credential-socket\") pod \"04322af5-a528-4dff-a008-62034273f5a0\" (UID: \"04322af5-a528-4dff-a008-62034273f5a0\") "
Oct 31 00:18:05.429875 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.429850    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04322af5-a528-4dff-a008-62034273f5a0-istiod-ca-cert" pod "04322af5-a528-4dff-a008-62034273f5a0" (UID: "04322af5-a528-4dff-a008-62034273f5a0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:18:05.430098 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.430073    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-credential-socket" pod "04322af5-a528-4dff-a008-62034273f5a0" (UID: "04322af5-a528-4dff-a008-62034273f5a0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:18:05.430098 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.430088    4921 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-workload-certs\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:18:05.430098 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.430107    4921 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-istio-data\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:18:05.430366 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.430121    4921 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-workload-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:18:05.430366 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.430134    4921 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04322af5-a528-4dff-a008-62034273f5a0-istiod-ca-cert\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:18:05.432192 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.432169    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/04322af5-a528-4dff-a008-62034273f5a0-istio-podinfo" pod "04322af5-a528-4dff-a008-62034273f5a0" (UID: "04322af5-a528-4dff-a008-62034273f5a0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:18:05.432273 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.432251    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-istio-envoy" pod "04322af5-a528-4dff-a008-62034273f5a0" (UID: "04322af5-a528-4dff-a008-62034273f5a0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:18:05.432325 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.432269    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04322af5-a528-4dff-a008-62034273f5a0-istio-token" pod "04322af5-a528-4dff-a008-62034273f5a0" (UID: "04322af5-a528-4dff-a008-62034273f5a0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:18:05.432325 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.432292    4921 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04322af5-a528-4dff-a008-62034273f5a0-kube-api-access-kxb5n" pod "04322af5-a528-4dff-a008-62034273f5a0" (UID: "04322af5-a528-4dff-a008-62034273f5a0"). InnerVolumeSpecName "kube-api-access-kxb5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:18:05.531717 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.531682    4921 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxb5n\" (UniqueName: \"kubernetes.io/projected/04322af5-a528-4dff-a008-62034273f5a0-kube-api-access-kxb5n\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:18:05.531717 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.531713    4921 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-credential-socket\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:18:05.531930 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.531741    4921 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04322af5-a528-4dff-a008-62034273f5a0-istio-podinfo\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:18:05.531930 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.531751    4921 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04322af5-a528-4dff-a008-62034273f5a0-istio-token\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:18:05.531930 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:05.531762    4921 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04322af5-a528-4dff-a008-62034273f5a0-istio-envoy\") on node \"ip-10-0-142-208.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:18:06.337438 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:06.337412    4921 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"
Oct 31 00:18:06.337916 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:06.337445    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m" event={"ID":"04322af5-a528-4dff-a008-62034273f5a0","Type":"ContainerDied","Data":"760f50fe73c86e5c0058a227d3674be683bd81f73eee4ca4e0d994c41ae7fab7"}
Oct 31 00:18:06.337916 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:06.337497    4921 scope.go:122] "RemoveContainer" containerID="3ed719a555a98b2ac855af9c2f1719f2653601a4a752931c91ef6e0b99d8833a"
Oct 31 00:18:06.361428 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:06.361403    4921 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"]
Oct 31 00:18:06.368031 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:06.368007    4921 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-authcfg-http-b33f34-openshift-default-b79949cc-2pj6m"]
Oct 31 00:18:06.882081 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:06.882046    4921 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="04322af5-a528-4dff-a008-62034273f5a0" path="/var/lib/kubelet/pods/04322af5-a528-4dff-a008-62034273f5a0/volumes"
Oct 31 00:18:11.403715 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:18:11.403678    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:18:18.921520 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:18.921476    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:18:19.056078 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:19.056042    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:18:41.402026 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:18:41.401980    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:18:51.013123 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:51.012745    4921 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-zxwsq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.166:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:18:51.013123 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:51.012814    4921 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zxwsq" podUID="a2811edb-f9ac-4178-b2d0-a7569051a989" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.166:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:18:55.752715 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:55.752678    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:18:56.293762 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:18:56.293727    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:19:00.522329 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:00.522298    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-58f8946bc6-2bcnq_838df128-c220-46d4-8fd7-a510fbcf34d8/manager/0.log"
Oct 31 00:19:01.428823 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:01.428794    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d4db8f8cf-2l8pm_e6ac75bc-f580-4b94-b46d-5c6b203e5de5/manager/0.log"
Oct 31 00:19:01.657486 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:01.657456    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-8l59t_762b14d4-9c86-435e-b185-76d16f68a175/server/0.log"
Oct 31 00:19:02.076352 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:02.076324    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-r2bg5_c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3/proxy/0.log"
Oct 31 00:19:02.361162 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:02.361085    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 31 00:19:02.377016 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:02.376993    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 31 00:19:03.488106 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:03.488078    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7f5c9bcb67-g6g9n_cde4852e-a681-434e-af2a-f37c74dec093/maas-api/0.log"
Oct 31 00:19:04.756102 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:04.756071    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-hc658_10323a62-1e87-4a58-b415-0add56c3618d/postgres/0.log"
Oct 31 00:19:08.604403 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:08.604368    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-hmb6d_0dd139da-49a9-4406-bfa3-369c639b5704/discovery/0.log"
Oct 31 00:19:08.806628 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:08.806601    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dfd47b86c-fz9nb_b9c61210-8afc-4d1a-a74b-9948b5b5f385/kube-auth-proxy/0.log"
Oct 31 00:19:09.941823 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:09.941792    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-ghblg_31f7fe08-e50d-4112-ad82-34d9d4ccf5c1/istio-proxy/0.log"
Oct 31 00:19:10.147186 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:10.147154    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-kr9zt_9b175126-9bea-4fd8-8139-7e392c602a9e/istio-proxy/0.log"
Oct 31 00:19:10.683862 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:10.683831    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-trpdx_e6053163-5f4f-4873-8a80-54343046bf85/istio-proxy/0.log"
Oct 31 00:19:10.885071 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:10.885043    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-zxwsq_a2811edb-f9ac-4178-b2d0-a7569051a989/istio-proxy/0.log"
Oct 31 00:19:11.266394 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:11.266370    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-kw26z_965ec8d0-31b7-4905-8a16-30a6a3e39f69/payload-pre-processing/0.log"
Oct 31 00:19:11.403317 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:19:11.403282    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:19:11.444643 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:11.444577    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-p2vlz_44393c6e-944b-47ab-b016-f6900a69d271/payload-processing/0.log"
Oct 31 00:19:11.632278 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:11.632210    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54c94948b5-5fm4s_f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b/router/0.log"
Oct 31 00:19:12.615653 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:12.615626    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js_257ac775-bcbb-4e52-a0a5-d9325172f2e4/main/0.log"
Oct 31 00:19:12.985322 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:12.985278    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-fgrs2_09131a8c-6b33-4793-b624-24489d63e66a/main/0.log"
Oct 31 00:19:13.541805 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:13.541781    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-259tq_21b8ce4a-9063-4336-a2c2-78d5554d40aa/main/0.log"
Oct 31 00:19:13.726745 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:13.726714    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7_38c70403-050b-4302-bba3-37fdec709026/main/0.log"
Oct 31 00:19:24.338774 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:24.338738    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-58f8946bc6-2bcnq_838df128-c220-46d4-8fd7-a510fbcf34d8/manager/0.log"
Oct 31 00:19:25.126724 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:25.126696    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d4db8f8cf-2l8pm_e6ac75bc-f580-4b94-b46d-5c6b203e5de5/manager/0.log"
Oct 31 00:19:25.354254 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:25.354226    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-8l59t_762b14d4-9c86-435e-b185-76d16f68a175/server/0.log"
Oct 31 00:19:25.788949 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:25.788920    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-r2bg5_c6e75b86-d5ea-4eb0-aff6-7b224eceb9c3/proxy/0.log"
Oct 31 00:19:26.557965 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:26.557932    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7f5c9bcb67-g6g9n_cde4852e-a681-434e-af2a-f37c74dec093/maas-api/0.log"
Oct 31 00:19:27.830880 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:27.830850    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-hc658_10323a62-1e87-4a58-b415-0add56c3618d/postgres/0.log"
Oct 31 00:19:30.974520 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:30.974481    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-hmb6d_0dd139da-49a9-4406-bfa3-369c639b5704/discovery/0.log"
Oct 31 00:19:31.174399 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:31.174368    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dfd47b86c-fz9nb_b9c61210-8afc-4d1a-a74b-9948b5b5f385/kube-auth-proxy/0.log"
Oct 31 00:19:32.302578 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:32.302545    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-ghblg_31f7fe08-e50d-4112-ad82-34d9d4ccf5c1/istio-proxy/0.log"
Oct 31 00:19:32.486141 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:32.486111    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-kr9zt_9b175126-9bea-4fd8-8139-7e392c602a9e/istio-proxy/0.log"
Oct 31 00:19:33.044185 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:33.044157    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-trpdx_e6053163-5f4f-4873-8a80-54343046bf85/istio-proxy/0.log"
Oct 31 00:19:33.248392 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:33.248360    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-zxwsq_a2811edb-f9ac-4178-b2d0-a7569051a989/istio-proxy/0.log"
Oct 31 00:19:33.619953 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:33.619927    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-kw26z_965ec8d0-31b7-4905-8a16-30a6a3e39f69/payload-pre-processing/0.log"
Oct 31 00:19:33.793618 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:33.793557    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-p2vlz_44393c6e-944b-47ab-b016-f6900a69d271/payload-processing/0.log"
Oct 31 00:19:33.971904 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:33.971878    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54c94948b5-5fm4s_f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b/router/0.log"
Oct 31 00:19:34.574751 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:34.574723    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js_257ac775-bcbb-4e52-a0a5-d9325172f2e4/main/0.log"
Oct 31 00:19:34.928825 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:34.928783    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-fgrs2_09131a8c-6b33-4793-b624-24489d63e66a/main/0.log"
Oct 31 00:19:35.484890 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:35.484862    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-259tq_21b8ce4a-9063-4336-a2c2-78d5554d40aa/main/0.log"
Oct 31 00:19:35.684732 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:35.684702    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7_38c70403-050b-4302-bba3-37fdec709026/main/0.log"
Oct 31 00:19:41.403020 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:19:41.402980    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:19:47.952586 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:47.952555    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:19:55.773149 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:55.773115    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:19:56.346360 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:19:56.346299    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:20:11.403197 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:20:11.403157    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:20:14.636304 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:20:14.636271    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d4db8f8cf-2l8pm_e6ac75bc-f580-4b94-b46d-5c6b203e5de5/manager/0.log"
Oct 31 00:20:14.905992 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:20:14.905911    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d4db8f8cf-2l8pm_e6ac75bc-f580-4b94-b46d-5c6b203e5de5/manager/0.log"
Oct 31 00:20:15.646268 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:20:15.646231    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-p2vlz_44393c6e-944b-47ab-b016-f6900a69d271/payload-processing/0.log"
Oct 31 00:20:15.835880 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:20:15.835851    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-p2vlz_44393c6e-944b-47ab-b016-f6900a69d271/payload-processing/0.log"
Oct 31 00:20:41.403736 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:20:41.403699    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:20:55.867439 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:20:55.867399    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:20:56.404556 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:20:56.404521    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:21:03.635716 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:03.635684    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d4db8f8cf-2l8pm_e6ac75bc-f580-4b94-b46d-5c6b203e5de5/manager/0.log"
Oct 31 00:21:03.907238 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:03.907133    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d4db8f8cf-2l8pm_e6ac75bc-f580-4b94-b46d-5c6b203e5de5/manager/0.log"
Oct 31 00:21:04.659314 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:04.659268    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-p2vlz_44393c6e-944b-47ab-b016-f6900a69d271/payload-processing/0.log"
Oct 31 00:21:04.835361 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:04.835303    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-p2vlz_44393c6e-944b-47ab-b016-f6900a69d271/payload-processing/0.log"
Oct 31 00:21:05.312131 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:05.312101    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:21:05.523701 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:05.523663    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:21:09.048072 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:09.048042    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nd66m_1bef686e-e4b6-44c2-b2c5-1cde73ddb2b1/global-pull-secret-syncer/0.log"
Oct 31 00:21:09.112231 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:09.112210    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-gpk5m_67fa89c3-92f0-4ead-871a-45446e25aad5/connection-checker/0.log"
Oct 31 00:21:09.147326 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:09.147304    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-hlltf_2074c06c-0759-4701-9a2d-48f024879fb2/connection-checker/0.log"
Oct 31 00:21:09.184083 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:09.184058    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-zlgnn_aa5373ec-3489-4bd2-80e0-ad75abead9e6/connection-checker/0.log"
Oct 31 00:21:09.248791 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:09.248748    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log"
Oct 31 00:21:09.451151 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:09.451121    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-208.us-east-2.compute.internal_2cfc9340daa6f45c0fb8540343ee68d0/haproxy/0.log"
Oct 31 00:21:11.402251 ip-10-0-142-208 kubenswrapper[4921]: E1031 00:21:11.402213    4921 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-894kd" containerName="extractor"
Oct 31 00:21:15.634458 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:15.634415    4921 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kctl_499f7257-2e41-413c-b6b7-12089b9514a7/konnectivity-agent/0.log" limit=1024
Oct 31 00:21:18.076162 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.076126    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-2w6gp_dc691df1-3f27-4829-955d-99b66893279d/cluster-monitoring-operator/0.log"
Oct 31 00:21:18.228414 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.228380    4921 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"]
Oct 31 00:21:18.228895 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.228877    4921 cpu_manager.go:414] "containerMap: removing container" podUID="04322af5-a528-4dff-a008-62034273f5a0" containerName="istio-proxy"
Oct 31 00:21:18.228953 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.228898    4921 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04322af5-a528-4dff-a008-62034273f5a0" containerName="istio-proxy"
Oct 31 00:21:18.229004 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.228995    4921 memory_manager.go:365] "RemoveStaleState removing state" podUID="04322af5-a528-4dff-a008-62034273f5a0" containerName="istio-proxy"
Oct 31 00:21:18.232221 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.232201    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"
Oct 31 00:21:18.242269 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.242247    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lrd6t\"/\"openshift-service-ca.crt\""
Oct 31 00:21:18.242507 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.242488    4921 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lrd6t\"/\"kube-root-ca.crt\""
Oct 31 00:21:18.242992 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.242975    4921 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lrd6t\"/\"default-dockercfg-7c4gn\""
Oct 31 00:21:18.244119 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.244097    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"]
Oct 31 00:21:18.324446 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.324414    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a009cd3e-664a-4789-b79c-6c534ac537ec-proc\") pod \"perf-node-gather-daemonset-rsvtj\" (UID: \"a009cd3e-664a-4789-b79c-6c534ac537ec\") " pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"
Oct 31 00:21:18.324650 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.324532    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a009cd3e-664a-4789-b79c-6c534ac537ec-sys\") pod \"perf-node-gather-daemonset-rsvtj\" (UID: \"a009cd3e-664a-4789-b79c-6c534ac537ec\") " pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"
Oct 31 00:21:18.324650 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.324633    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a009cd3e-664a-4789-b79c-6c534ac537ec-lib-modules\") pod \"perf-node-gather-daemonset-rsvtj\" (UID: \"a009cd3e-664a-4789-b79c-6c534ac537ec\") " pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"
Oct 31 00:21:18.324777 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.324668    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a009cd3e-664a-4789-b79c-6c534ac537ec-podres\") pod \"perf-node-gather-daemonset-rsvtj\" (UID: \"a009cd3e-664a-4789-b79c-6c534ac537ec\") " pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"
Oct 31 00:21:18.324777 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.324697    4921 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z84p6\" (UniqueName: \"kubernetes.io/projected/a009cd3e-664a-4789-b79c-6c534ac537ec-kube-api-access-z84p6\") pod \"perf-node-gather-daemonset-rsvtj\" (UID: \"a009cd3e-664a-4789-b79c-6c534ac537ec\") " pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"
Oct 31 00:21:18.375365 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.375258    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4mg4_e9e56af7-2986-45dc-b083-496f7f618e98/node-exporter/0.log"
Oct 31 00:21:18.401027 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.401006    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4mg4_e9e56af7-2986-45dc-b083-496f7f618e98/kube-rbac-proxy/0.log"
Oct 31 00:21:18.426021 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.425995    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a009cd3e-664a-4789-b79c-6c534ac537ec-sys\") pod \"perf-node-gather-daemonset-rsvtj\" (UID: \"a009cd3e-664a-4789-b79c-6c534ac537ec\") " pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"
Oct 31 00:21:18.426176 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.426030    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a009cd3e-664a-4789-b79c-6c534ac537ec-lib-modules\") pod \"perf-node-gather-daemonset-rsvtj\" (UID: \"a009cd3e-664a-4789-b79c-6c534ac537ec\") " pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"
Oct 31 00:21:18.426176 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.426051    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a009cd3e-664a-4789-b79c-6c534ac537ec-podres\") pod \"perf-node-gather-daemonset-rsvtj\" (UID: \"a009cd3e-664a-4789-b79c-6c534ac537ec\") " pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"
Oct 31 00:21:18.426176 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.426085    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z84p6\" (UniqueName: \"kubernetes.io/projected/a009cd3e-664a-4789-b79c-6c534ac537ec-kube-api-access-z84p6\") pod \"perf-node-gather-daemonset-rsvtj\" (UID: \"a009cd3e-664a-4789-b79c-6c534ac537ec\") " pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"
Oct 31 00:21:18.426176 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.426120    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a009cd3e-664a-4789-b79c-6c534ac537ec-sys\") pod \"perf-node-gather-daemonset-rsvtj\" (UID: \"a009cd3e-664a-4789-b79c-6c534ac537ec\") " pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"
Oct 31 00:21:18.426176 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.426140    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a009cd3e-664a-4789-b79c-6c534ac537ec-lib-modules\") pod \"perf-node-gather-daemonset-rsvtj\" (UID: \"a009cd3e-664a-4789-b79c-6c534ac537ec\") " pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"
Oct 31 00:21:18.426176 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.426149    4921 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a009cd3e-664a-4789-b79c-6c534ac537ec-proc\") pod \"perf-node-gather-daemonset-rsvtj\" (UID: \"a009cd3e-664a-4789-b79c-6c534ac537ec\") " pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"
Oct 31 00:21:18.426561 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.426192    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a009cd3e-664a-4789-b79c-6c534ac537ec-proc\") pod \"perf-node-gather-daemonset-rsvtj\" (UID: \"a009cd3e-664a-4789-b79c-6c534ac537ec\") " pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"
Oct 31 00:21:18.426561 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.426196    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a009cd3e-664a-4789-b79c-6c534ac537ec-podres\") pod \"perf-node-gather-daemonset-rsvtj\" (UID: \"a009cd3e-664a-4789-b79c-6c534ac537ec\") " pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"
Oct 31 00:21:18.427508 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.427491    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4mg4_e9e56af7-2986-45dc-b083-496f7f618e98/init-textfile/0.log"
Oct 31 00:21:18.438738 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.438716    4921 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z84p6\" (UniqueName: \"kubernetes.io/projected/a009cd3e-664a-4789-b79c-6c534ac537ec-kube-api-access-z84p6\") pod \"perf-node-gather-daemonset-rsvtj\" (UID: \"a009cd3e-664a-4789-b79c-6c534ac537ec\") " pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"
Oct 31 00:21:18.546211 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.546182    4921 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"
Oct 31 00:21:18.825096 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:18.825066    4921 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"]
Oct 31 00:21:18.827331 ip-10-0-142-208 kubenswrapper[4921]: W1031 00:21:18.827296    4921 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda009cd3e_664a_4789_b79c_6c534ac537ec.slice/crio-c1cb3af97c8c92c911458cf967a3c05bcf494e744f3923bdc140dd2ab016c92c WatchSource:0}: Error finding container c1cb3af97c8c92c911458cf967a3c05bcf494e744f3923bdc140dd2ab016c92c: Status 404 returned error can't find the container with id c1cb3af97c8c92c911458cf967a3c05bcf494e744f3923bdc140dd2ab016c92c
Oct 31 00:21:19.339096 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:19.339058    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj" event={"ID":"a009cd3e-664a-4789-b79c-6c534ac537ec","Type":"ContainerStarted","Data":"c12383ff4d7747716747ef09022bf3d39c45210c7fdbf11f4cf823a953677497"}
Oct 31 00:21:19.339548 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:19.339108    4921 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj" event={"ID":"a009cd3e-664a-4789-b79c-6c534ac537ec","Type":"ContainerStarted","Data":"c1cb3af97c8c92c911458cf967a3c05bcf494e744f3923bdc140dd2ab016c92c"}
Oct 31 00:21:19.339548 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:19.339201    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"
Oct 31 00:21:19.358887 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:19.358836    4921 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj" podStartSLOduration=1.358823836 podStartE2EDuration="1.358823836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:21:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:21:19.357524466 +0000 UTC m=+3738.602380234" watchObservedRunningTime="2026-10-31 00:21:19.358823836 +0000 UTC m=+3738.603679604"
Oct 31 00:21:20.304848 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:20.304817    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-z84cb_84480344-bd78-4528-bfe4-29b67541a818/networking-console-plugin/0.log"
Oct 31 00:21:20.989537 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:20.989510    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/2.log"
Oct 31 00:21:20.993683 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:20.993664    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-qs244_3536b8b5-e6a8-48c5-8319-8d75a7f4abd8/console-operator/3.log"
Oct 31 00:21:22.177803 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:22.177748    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-qhkwj_b3d1c4c4-03be-43ef-a2e4-bfc406dc7aca/volume-data-source-validator/0.log"
Oct 31 00:21:23.372898 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:23.372849    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-295nz_5ba7c1ba-4162-430e-b267-ebf3f9844750/dns/0.log"
Oct 31 00:21:23.397773 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:23.397746    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-295nz_5ba7c1ba-4162-430e-b267-ebf3f9844750/kube-rbac-proxy/0.log"
Oct 31 00:21:23.597110 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:23.597065    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pnk7r_9047f37e-2d3c-4978-a5c1-4078d505ab15/dns-node-resolver/0.log"
Oct 31 00:21:24.359165 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:24.359129    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xjtcb_deb3bcf9-5f63-469d-b5d5-c5d62ffada99/node-ca/0.log"
Oct 31 00:21:25.354263 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:25.354233    4921 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lrd6t/perf-node-gather-daemonset-rsvtj"
Oct 31 00:21:27.669141 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:27.669103    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-hmb6d_0dd139da-49a9-4406-bfa3-369c639b5704/discovery/0.log"
Oct 31 00:21:28.150511 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:28.150484    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dfd47b86c-fz9nb_b9c61210-8afc-4d1a-a74b-9948b5b5f385/kube-auth-proxy/0.log"
Oct 31 00:21:28.377231 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:28.377204    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-ghblg_31f7fe08-e50d-4112-ad82-34d9d4ccf5c1/istio-proxy/0.log"
Oct 31 00:21:28.419914 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:28.419817    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-kr9zt_9b175126-9bea-4fd8-8139-7e392c602a9e/istio-proxy/0.log"
Oct 31 00:21:28.539382 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:28.539357    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-trpdx_e6053163-5f4f-4873-8a80-54343046bf85/istio-proxy/0.log"
Oct 31 00:21:28.576120 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:28.576095    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-zxwsq_a2811edb-f9ac-4178-b2d0-a7569051a989/istio-proxy/0.log"
Oct 31 00:21:28.650603 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:28.650568    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-kw26z_965ec8d0-31b7-4905-8a16-30a6a3e39f69/payload-pre-processing/0.log"
Oct 31 00:21:28.694572 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:28.694509    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-p2vlz_44393c6e-944b-47ab-b016-f6900a69d271/payload-processing/0.log"
Oct 31 00:21:28.727162 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:28.727132    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54c94948b5-5fm4s_f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b/router/0.log"
Oct 31 00:21:31.108120 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:31.108080    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fsbsg_b1846d39-a52a-442d-8216-10f0798dbc36/serve-healthcheck-canary/0.log"
Oct 31 00:21:31.690218 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:31.690192    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-qdr5f_f9a4c974-1f79-40b2-9f49-427170c8764b/insights-operator/1.log"
Oct 31 00:21:31.692488 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:31.692466    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-qdr5f_f9a4c974-1f79-40b2-9f49-427170c8764b/insights-operator/2.log"
Oct 31 00:21:31.804372 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:31.804336    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-894kd_53725f0f-4d8e-4270-b319-3943c040f794/kube-rbac-proxy/0.log"
Oct 31 00:21:31.830746 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:31.830718    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-894kd_53725f0f-4d8e-4270-b319-3943c040f794/exporter/0.log"
Oct 31 00:21:31.857726 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:31.857697    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-894kd_53725f0f-4d8e-4270-b319-3943c040f794/extractor/0.log"
Oct 31 00:21:31.985040 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:31.984968    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_periodic-gathering-74v7f-6hdv9_d53cebe3-7403-4d17-8e70-2620bf4362a4/insights-gathering/0.log"
Oct 31 00:21:32.228730 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:32.228698    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-hmb6d_0dd139da-49a9-4406-bfa3-369c639b5704/discovery/0.log"
Oct 31 00:21:32.241554 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:32.241459    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dfd47b86c-fz9nb_b9c61210-8afc-4d1a-a74b-9948b5b5f385/kube-auth-proxy/0.log"
Oct 31 00:21:32.363646 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:32.363620    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-ghblg_31f7fe08-e50d-4112-ad82-34d9d4ccf5c1/istio-proxy/0.log"
Oct 31 00:21:32.384240 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:32.384221    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-kr9zt_9b175126-9bea-4fd8-8139-7e392c602a9e/istio-proxy/0.log"
Oct 31 00:21:32.446037 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:32.446014    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-trpdx_e6053163-5f4f-4873-8a80-54343046bf85/istio-proxy/0.log"
Oct 31 00:21:32.464693 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:32.464669    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df48fcc99-zxwsq_a2811edb-f9ac-4178-b2d0-a7569051a989/istio-proxy/0.log"
Oct 31 00:21:32.502148 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:32.502089    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-kw26z_965ec8d0-31b7-4905-8a16-30a6a3e39f69/payload-pre-processing/0.log"
Oct 31 00:21:32.519251 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:32.519229    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-p2vlz_44393c6e-944b-47ab-b016-f6900a69d271/payload-processing/0.log"
Oct 31 00:21:32.544746 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:32.544718    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54c94948b5-5fm4s_f4ffe6e0-c2cd-4ff0-87ba-3817e376bc9b/router/0.log"
Oct 31 00:21:34.618330 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:34.618300    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-6986c789f7-f4lx6_d6f250a6-8cd5-4658-a6d8-892c6f8cc652/manager/0.log"
Oct 31 00:21:34.637800 ip-10-0-142-208 kubenswrapper[4921]: I1031 00:21:34.637776    4921 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-6986c789f7-f4lx6_d6f250a6-8cd5-4658-a6d8-892c6f8cc652/copy-manifests/0.log"